[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:40:18 dist-test-slave-2d19 krb5kdc[23389](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:40:18 dist-test-slave-2d19 krb5kdc[23389](info): set up 2 sockets
Aug 07 22:40:18 dist-test-slave-2d19 krb5kdc[23389](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260807 22:40:20.038893 23377 mini_kdc.cc:121] Time spent starting KDC: real 1.378s user 0.006s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Aug 07 22:40:20 dist-test-slave-2d19 krb5kdc[23389](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142420, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:40:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:40:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.212.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
I20260807 22:40:20.171790 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:45517
--webserver_interface=127.22.212.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:45007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:45517
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:20.270660 23410 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:20.270900 23410 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:20.270941 23410 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:20.272181 23410 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:40:20.272248 23410 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:20.272289 23410 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:20.272323 23410 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:40:20.272344 23410 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:40:20.274155 23410 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:45007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:45517
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:45517
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23410
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:20.274449 23410 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:20.274688 23410 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:20.280750 23418 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:20.280758 23425 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:20.280767 23419 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:20.281060 23410 server_base.cc:1034] running on GCE node
I20260807 22:40:20.281350 23410 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:20.281687 23410 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:20.282832 23410 hybrid_clock.cc:648] HybridClock initialized: now 1786142420282827 us; error 53 us; skew 500 ppm
Aug 07 22:40:20 dist-test-slave-2d19 krb5kdc[23389](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142420, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:20.285907 23410 init.cc:377] Logged in from keytab as kudu/127.22.212.126@KRBTEST.COM (short username kudu)
I20260807 22:40:20.286433 23410 webserver.cc:460] Webserver started at http://127.22.212.126:43023/ using document root <none> and password file <none>
I20260807 22:40:20.286721 23410 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:20.286794 23410 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:20.286947 23410 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:20.288189 23410 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "f3410971c0a941b8aa8a669c05a5f47b"
format_stamp: "Formatted at 2026-08-07 22:40:20 on dist-test-slave-2d19"
server_key: "0a0aa5c72a4e351557a581114602a067"
server_key_iv: "fecac9afed8e60690fa353f1c22bb860"
server_key_version: "encryptionkey@0"
I20260807 22:40:20.288689 23410 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "f3410971c0a941b8aa8a669c05a5f47b"
format_stamp: "Formatted at 2026-08-07 22:40:20 on dist-test-slave-2d19"
server_key: "0a0aa5c72a4e351557a581114602a067"
server_key_iv: "fecac9afed8e60690fa353f1c22bb860"
server_key_version: "encryptionkey@0"
I20260807 22:40:20.290421 23410 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:40:20.291247 23432 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:20.291460 23410 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:40:20.291574 23410 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "f3410971c0a941b8aa8a669c05a5f47b"
format_stamp: "Formatted at 2026-08-07 22:40:20 on dist-test-slave-2d19"
server_key: "0a0aa5c72a4e351557a581114602a067"
server_key_iv: "fecac9afed8e60690fa353f1c22bb860"
server_key_version: "encryptionkey@0"
I20260807 22:40:20.291659 23410 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:20.308772 23410 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:20.311453 23410 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:20.311698 23410 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:20.322566 23410 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:45517
I20260807 22:40:20.322721 23529 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:45517 every 8 connection(s)
I20260807 22:40:20.323132 23410 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:40:20.324240 23530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:20.327076 23530 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3410971c0a941b8aa8a669c05a5f47b: Bootstrap starting.
I20260807 22:40:20.327677 23530 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f3410971c0a941b8aa8a669c05a5f47b: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:20.327941 23530 log.cc:824] T 00000000000000000000000000000000 P f3410971c0a941b8aa8a669c05a5f47b: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:20.328804 23530 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3410971c0a941b8aa8a669c05a5f47b: No bootstrap required, opened a new log
I20260807 22:40:20.329268 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 23410
I20260807 22:40:20.329385 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:40:20.330155 23377 external_mini_cluster.cc:1428] Setting key 20208fed00641f3f7d8fab3b6c288a4d
I20260807 22:40:20.330678 23530 raft_consensus.cc:348] T 00000000000000000000000000000000 P f3410971c0a941b8aa8a669c05a5f47b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3410971c0a941b8aa8a669c05a5f47b" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 45517 } }
I20260807 22:40:20.330847 23530 raft_consensus.cc:374] T 00000000000000000000000000000000 P f3410971c0a941b8aa8a669c05a5f47b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:20.330938 23530 raft_consensus.cc:729] T 00000000000000000000000000000000 P f3410971c0a941b8aa8a669c05a5f47b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3410971c0a941b8aa8a669c05a5f47b, State: Initialized, Role: FOLLOWER
I20260807 22:40:20.331465 23530 consensus_queue.cc:260] T 00000000000000000000000000000000 P f3410971c0a941b8aa8a669c05a5f47b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3410971c0a941b8aa8a669c05a5f47b" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 45517 } }
I20260807 22:40:20.331661 23530 raft_consensus.cc:388] T 00000000000000000000000000000000 P f3410971c0a941b8aa8a669c05a5f47b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:40:20.331738 23530 raft_consensus.cc:482] T 00000000000000000000000000000000 P f3410971c0a941b8aa8a669c05a5f47b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:40:20.331795 23530 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f3410971c0a941b8aa8a669c05a5f47b [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:20.332687 23530 raft_consensus.cc:504] T 00000000000000000000000000000000 P f3410971c0a941b8aa8a669c05a5f47b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3410971c0a941b8aa8a669c05a5f47b" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 45517 } }
I20260807 22:40:20.332780 23530 leader_election.cc:302] T 00000000000000000000000000000000 P f3410971c0a941b8aa8a669c05a5f47b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f3410971c0a941b8aa8a669c05a5f47b; no voters:
I20260807 22:40:20.332983 23530 leader_election.cc:288] T 00000000000000000000000000000000 P f3410971c0a941b8aa8a669c05a5f47b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:40:20.332998 23535 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f3410971c0a941b8aa8a669c05a5f47b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:40:20.333261 23535 raft_consensus.cc:686] T 00000000000000000000000000000000 P f3410971c0a941b8aa8a669c05a5f47b [term 1 LEADER]: Becoming Leader. State: Replica: f3410971c0a941b8aa8a669c05a5f47b, State: Running, Role: LEADER
I20260807 22:40:20.333348 23530 sys_catalog.cc:564] T 00000000000000000000000000000000 P f3410971c0a941b8aa8a669c05a5f47b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:40:20.333366 23535 consensus_queue.cc:237] T 00000000000000000000000000000000 P f3410971c0a941b8aa8a669c05a5f47b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3410971c0a941b8aa8a669c05a5f47b" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 45517 } }
I20260807 22:40:20.333797 23535 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3410971c0a941b8aa8a669c05a5f47b [sys.catalog]: SysCatalogTable state changed. Reason: New leader f3410971c0a941b8aa8a669c05a5f47b. Latest consensus state: current_term: 1 leader_uuid: "f3410971c0a941b8aa8a669c05a5f47b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3410971c0a941b8aa8a669c05a5f47b" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 45517 } } }
I20260807 22:40:20.333904 23535 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3410971c0a941b8aa8a669c05a5f47b [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:20.333843 23537 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3410971c0a941b8aa8a669c05a5f47b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f3410971c0a941b8aa8a669c05a5f47b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3410971c0a941b8aa8a669c05a5f47b" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 45517 } } }
I20260807 22:40:20.334210 23537 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3410971c0a941b8aa8a669c05a5f47b [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:20.336048 23547 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:40:20.337002 23547 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:40:20.338855 23547 catalog_manager.cc:1347] Generated new cluster ID: 62e6797c9a164bfabc8717467480e1c6
I20260807 22:40:20.338999 23547 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:40:20.346549 23547 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:40:20.347352 23547 catalog_manager.cc:1504] Loading token signing keys...
Aug 07 22:40:20 dist-test-slave-2d19 krb5kdc[23389](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142420, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:40:20.353518 23547 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f3410971c0a941b8aa8a669c05a5f47b: Generated new TSK 0
I20260807 22:40:20.353798 23533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:20.331052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60440 (local address 127.22.212.126:45517)
0807 22:40:20.331314 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:20.331324 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:20.331657 (+ 333us) server_negotiation.cc:407] Connection header received
0807 22:40:20.335274 (+ 3617us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:20.335301 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:20.335376 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:20.335548 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:20.337907 (+ 2359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:20.339983 (+ 2076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:20.341693 (+ 1710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:20.342785 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:20.342940 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:20.348750 (+ 5810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:20.348754 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:20.348755 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:20.348768 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:20.351259 (+ 2491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:20.351884 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:20.351887 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:20.351888 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:20.351997 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:20.352342 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:20.352343 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:20.352343 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:20.352634 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:20.352921 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:20.353221 (+ 300us) server_negotiation.cc:299] Negotiation successful
0807 22:40:20.353384 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":109,"threads_started":1}
I20260807 22:40:20.353816 23547 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.212.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab.
Entry for principal kudu/127.22.212.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab.
I20260807 22:40:20.390772 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.65:0
--local_ip_for_outbound_sockets=127.22.212.65
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:45517
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:45007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:20.484757 23565 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:20.484967 23565 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:20.484999 23565 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:20.486217 23565 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:20.486261 23565 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:20.486292 23565 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.65
I20260807 22:40:20.487891 23565 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:45007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:45517
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23565
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.65
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:20.488159 23565 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:20.488451 23565 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:20.493880 23581 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:20.493891 23577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:20.493887 23585 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:20.494243 23565 server_base.cc:1034] running on GCE node
I20260807 22:40:20.494503 23565 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:20.494841 23565 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:20.496037 23565 hybrid_clock.cc:648] HybridClock initialized: now 1786142420496020 us; error 39 us; skew 500 ppm
Aug 07 22:40:20 dist-test-slave-2d19 krb5kdc[23389](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142420, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:20.498781 23565 init.cc:377] Logged in from keytab as kudu/127.22.212.65@KRBTEST.COM (short username kudu)
I20260807 22:40:20.499399 23565 webserver.cc:460] Webserver started at http://127.22.212.65:42403/ using document root <none> and password file <none>
I20260807 22:40:20.499643 23565 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:20.499691 23565 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:20.499851 23565 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:20.501048 23565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-0/data/instance:
uuid: "986f937cc567493f914a491afc9e4517"
format_stamp: "Formatted at 2026-08-07 22:40:20 on dist-test-slave-2d19"
server_key: "8b728436c2abbbc4fe2a8f66f5247954"
server_key_iv: "44ec43f1f4c46f84924c00432cbac058"
server_key_version: "encryptionkey@0"
I20260807 22:40:20.501369 23565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance:
uuid: "986f937cc567493f914a491afc9e4517"
format_stamp: "Formatted at 2026-08-07 22:40:20 on dist-test-slave-2d19"
server_key: "8b728436c2abbbc4fe2a8f66f5247954"
server_key_iv: "44ec43f1f4c46f84924c00432cbac058"
server_key_version: "encryptionkey@0"
I20260807 22:40:20.502753 23565 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260807 22:40:20.503535 23595 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:20.503722 23565 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:40:20.503832 23565 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-0/wal
uuid: "986f937cc567493f914a491afc9e4517"
format_stamp: "Formatted at 2026-08-07 22:40:20 on dist-test-slave-2d19"
server_key: "8b728436c2abbbc4fe2a8f66f5247954"
server_key_iv: "44ec43f1f4c46f84924c00432cbac058"
server_key_version: "encryptionkey@0"
I20260807 22:40:20.503906 23565 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:20.522133 23565 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:20.524204 23565 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:20.524413 23565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:20.524691 23565 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:20.525019 23565 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:20.525074 23565 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:20.525121 23565 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:20.525152 23565 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:20.531772 23565 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.65:33833
I20260807 22:40:20.531816 23769 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.65:33833 every 8 connection(s)
I20260807 22:40:20.532159 23565 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
I20260807 22:40:20.537933 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 23565
I20260807 22:40:20.538038 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance
I20260807 22:40:20.538198 23377 external_mini_cluster.cc:1428] Setting key a158ae1ce88191eed400a54cdf0e537e
Aug 07 22:40:20 dist-test-slave-2d19 krb5kdc[23389](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142420, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:40:20.542552 23533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:20.533051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:52877 (local address 127.22.212.126:45517)
0807 22:40:20.533126 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:20.533128 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:20.533348 (+ 220us) server_negotiation.cc:407] Connection header received
0807 22:40:20.533942 (+ 594us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:20.533943 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:20.533956 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:20.534021 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:20.535117 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:20.535628 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:20.536764 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:20.536979 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:20.537072 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:20.539425 (+ 2353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:20.539427 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:20.539428 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:20.539436 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:20.541105 (+ 1669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:20.541597 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:20.541598 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:20.541598 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:20.541648 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:20.541919 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:20.541920 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:20.541920 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:20.542048 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:20.542101 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:20.542421 (+ 320us) server_negotiation.cc:299] Negotiation successful
0807 22:40:20.542487 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 22:40:20.542850 23776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:20.533049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45517 (local address 127.22.212.65:52877)
0807 22:40:20.533226 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:20.533264 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:20.533829 (+ 565us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:20.534086 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:20.534090 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:20.534731 (+ 641us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:20.535018 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:20.535023 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:20.535737 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:20.535738 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:20.536675 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:20.536677 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:20.537084 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:20.537085 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:20.537215 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:20.537650 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:20.537658 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:20.539330 (+ 1672us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:20.541185 (+ 1855us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:20.541192 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:20.541195 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:20.541518 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:20.541713 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:20.541714 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:20.541714 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:20.541857 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:20.542113 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:20.542119 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:20.542282 (+ 163us) client_negotiation.cc:769] Sending connection context
0807 22:40:20.542400 (+ 118us) client_negotiation.cc:240] Negotiation successful
0807 22:40:20.542578 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":83,"threads_started":1}
I20260807 22:40:20.543431 23772 heartbeater.cc:347] Connected to a master server at 127.22.212.126:45517
I20260807 22:40:20.543538 23772 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:20.543738 23772 heartbeater.cc:511] Master 127.22.212.126:45517 requested a full tablet report, sending...
I20260807 22:40:20.544426 23457 ts_manager.cc:194] Registered new tserver with Master: 986f937cc567493f914a491afc9e4517 (127.22.212.65:33833)
I20260807 22:40:20.545506 23457 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.65@KRBTEST.COM'} at 127.22.212.65:52877
WARNING: no policy specified for kudu/127.22.212.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab.
Entry for principal kudu/127.22.212.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab.
I20260807 22:40:20.567210 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.66:0
--local_ip_for_outbound_sockets=127.22.212.66
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:45517
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:45007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:20.652125 23782 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:20.652393 23782 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:20.652434 23782 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:20.653638 23782 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:20.653709 23782 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:20.653754 23782 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.66
I20260807 22:40:20.655246 23782 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:45007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:45517
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23782
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.66
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:20.655540 23782 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:20.655792 23782 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:20.660885 23791 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:20.660877 23787 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:20.661105 23782 server_base.cc:1034] running on GCE node
W20260807 22:40:20.660876 23795 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:20.661329 23782 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:20.661531 23782 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:20.662710 23782 hybrid_clock.cc:648] HybridClock initialized: now 1786142420662696 us; error 25 us; skew 500 ppm
Aug 07 22:40:20 dist-test-slave-2d19 krb5kdc[23389](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142420, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:20.665354 23782 init.cc:377] Logged in from keytab as kudu/127.22.212.66@KRBTEST.COM (short username kudu)
I20260807 22:40:20.665789 23782 webserver.cc:460] Webserver started at http://127.22.212.66:45159/ using document root <none> and password file <none>
I20260807 22:40:20.666050 23782 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:20.666121 23782 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:20.666272 23782 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:20.667325 23782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-1/data/instance:
uuid: "b0219531ac584d28a89422f00c31aeb0"
format_stamp: "Formatted at 2026-08-07 22:40:20 on dist-test-slave-2d19"
server_key: "70b73714c93f76ff77118a5b714d6ed5"
server_key_iv: "1f536e1915a0c51b7aef62ff48f5a50f"
server_key_version: "encryptionkey@0"
I20260807 22:40:20.667695 23782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance:
uuid: "b0219531ac584d28a89422f00c31aeb0"
format_stamp: "Formatted at 2026-08-07 22:40:20 on dist-test-slave-2d19"
server_key: "70b73714c93f76ff77118a5b714d6ed5"
server_key_iv: "1f536e1915a0c51b7aef62ff48f5a50f"
server_key_version: "encryptionkey@0"
I20260807 22:40:20.669212 23782 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 22:40:20.669989 23808 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:20.670198 23782 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260807 22:40:20.670313 23782 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-1/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-1/wal
uuid: "b0219531ac584d28a89422f00c31aeb0"
format_stamp: "Formatted at 2026-08-07 22:40:20 on dist-test-slave-2d19"
server_key: "70b73714c93f76ff77118a5b714d6ed5"
server_key_iv: "1f536e1915a0c51b7aef62ff48f5a50f"
server_key_version: "encryptionkey@0"
I20260807 22:40:20.670392 23782 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:20.678574 23782 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:20.680507 23782 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:20.680666 23782 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:20.680893 23782 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:20.681208 23782 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:20.681264 23782 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:20.681308 23782 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:20.681334 23782 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:20.688308 23782 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.66:39127
I20260807 22:40:20.688354 23994 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.66:39127 every 8 connection(s)
I20260807 22:40:20.688717 23782 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
I20260807 22:40:20.692855 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 23782
I20260807 22:40:20.692955 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance
I20260807 22:40:20.693137 23377 external_mini_cluster.cc:1428] Setting key 5a9d1d3ee3155cd55d3ba0715b6744ff
Aug 07 22:40:20 dist-test-slave-2d19 krb5kdc[23389](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142420, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:40:20.698921 23533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:20.689447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:40467 (local address 127.22.212.126:45517)
0807 22:40:20.689524 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:20.689526 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:20.689734 (+ 208us) server_negotiation.cc:407] Connection header received
0807 22:40:20.690307 (+ 573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:20.690308 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:20.690322 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:20.690372 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:20.691345 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:20.691880 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:20.692995 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:20.693295 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:20.693365 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:20.695996 (+ 2631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:20.695997 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:20.695998 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:20.696007 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:20.697510 (+ 1503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:20.697933 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:20.697934 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:20.697935 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:20.697997 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:20.698265 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:20.698266 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:20.698266 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:20.698385 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:20.698458 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:20.698746 (+ 288us) server_negotiation.cc:299] Negotiation successful
0807 22:40:20.698829 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 22:40:20.699129 24002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:20.689438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45517 (local address 127.22.212.66:40467)
0807 22:40:20.689613 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:20.689649 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:20.690189 (+ 540us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:20.690448 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:20.690451 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:20.691041 (+ 590us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:20.691240 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:20.691245 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:20.691993 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:20.691994 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:20.692862 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:20.692865 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:20.693422 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:20.693423 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:20.693586 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:20.694133 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:20.694145 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:20.695882 (+ 1737us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:20.697615 (+ 1733us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:20.697622 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:20.697625 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:20.697851 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:20.698077 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:20.698077 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:20.698078 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:20.698190 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:20.698460 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:20.698468 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:20.698608 (+ 140us) client_negotiation.cc:769] Sending connection context
0807 22:40:20.698712 (+ 104us) client_negotiation.cc:240] Negotiation successful
0807 22:40:20.698872 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":97,"threads_started":1}
I20260807 22:40:20.699599 23998 heartbeater.cc:347] Connected to a master server at 127.22.212.126:45517
I20260807 22:40:20.699705 23998 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:20.699913 23998 heartbeater.cc:511] Master 127.22.212.126:45517 requested a full tablet report, sending...
I20260807 22:40:20.700327 23457 ts_manager.cc:194] Registered new tserver with Master: b0219531ac584d28a89422f00c31aeb0 (127.22.212.66:39127)
I20260807 22:40:20.700742 23457 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.66@KRBTEST.COM'} at 127.22.212.66:40467
WARNING: no policy specified for kudu/127.22.212.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab.
Entry for principal kudu/127.22.212.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab.
I20260807 22:40:20.723049 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.67:0
--local_ip_for_outbound_sockets=127.22.212.67
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:45517
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:45007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:20.808066 24006 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:20.808302 24006 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:20.808327 24006 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:20.809439 24006 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:20.809477 24006 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:20.809504 24006 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.67
I20260807 22:40:20.810917 24006 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:45007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:45517
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24006
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.67
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:20.811113 24006 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:20.811292 24006 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:20.816687 24022 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:20.816813 24021 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:20.816687 24025 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:20.817314 24006 server_base.cc:1034] running on GCE node
I20260807 22:40:20.817564 24006 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:20.817818 24006 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:20.818977 24006 hybrid_clock.cc:648] HybridClock initialized: now 1786142420818954 us; error 60 us; skew 500 ppm
Aug 07 22:40:20 dist-test-slave-2d19 krb5kdc[23389](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142420, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:20.821715 24006 init.cc:377] Logged in from keytab as kudu/127.22.212.67@KRBTEST.COM (short username kudu)
I20260807 22:40:20.822190 24006 webserver.cc:460] Webserver started at http://127.22.212.67:43875/ using document root <none> and password file <none>
I20260807 22:40:20.822409 24006 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:20.822458 24006 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:20.822569 24006 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:20.823691 24006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-2/data/instance:
uuid: "1758a5731ded41c58873a17f53dc0902"
format_stamp: "Formatted at 2026-08-07 22:40:20 on dist-test-slave-2d19"
server_key: "e9f0fbc7f8590904ad17edac0572851b"
server_key_iv: "4f5e25102ef3778d613d4663831b65fd"
server_key_version: "encryptionkey@0"
I20260807 22:40:20.824030 24006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance:
uuid: "1758a5731ded41c58873a17f53dc0902"
format_stamp: "Formatted at 2026-08-07 22:40:20 on dist-test-slave-2d19"
server_key: "e9f0fbc7f8590904ad17edac0572851b"
server_key_iv: "4f5e25102ef3778d613d4663831b65fd"
server_key_version: "encryptionkey@0"
I20260807 22:40:20.825606 24006 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:40:20.826380 24039 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:20.826538 24006 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 22:40:20.826628 24006 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-2/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-2/wal
uuid: "1758a5731ded41c58873a17f53dc0902"
format_stamp: "Formatted at 2026-08-07 22:40:20 on dist-test-slave-2d19"
server_key: "e9f0fbc7f8590904ad17edac0572851b"
server_key_iv: "4f5e25102ef3778d613d4663831b65fd"
server_key_version: "encryptionkey@0"
I20260807 22:40:20.826685 24006 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:20.846544 24006 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:20.848606 24006 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:20.848719 24006 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:20.848915 24006 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:20.849264 24006 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:20.849304 24006 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:20.849351 24006 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:20.849378 24006 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:20.856127 24006 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.67:45601
I20260807 22:40:20.856189 24230 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.67:45601 every 8 connection(s)
I20260807 22:40:20.856551 24006 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
I20260807 22:40:20.858690 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 24006
I20260807 22:40:20.858788 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance
I20260807 22:40:20.858949 23377 external_mini_cluster.cc:1428] Setting key c3dad1edd273232e873dc7862f58af31
Aug 07 22:40:20 dist-test-slave-2d19 krb5kdc[23389](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142420, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:40:20.866374 23533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:20.857420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:47149 (local address 127.22.212.126:45517)
0807 22:40:20.857494 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:20.857496 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:20.857719 (+ 223us) server_negotiation.cc:407] Connection header received
0807 22:40:20.858284 (+ 565us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:20.858285 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:20.858298 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:20.858357 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:20.859576 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:20.860378 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:20.861346 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:20.861542 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:20.861596 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:20.863892 (+ 2296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:20.863894 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:20.863894 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:20.863901 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:20.865223 (+ 1322us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:20.865585 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:20.865585 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:20.865586 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:20.865636 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:20.865844 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:20.865844 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:20.865844 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:20.865943 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:20.865993 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:20.866245 (+ 252us) server_negotiation.cc:299] Negotiation successful
0807 22:40:20.866309 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 22:40:20.866595 24234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:20.857414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45517 (local address 127.22.212.67:47149)
0807 22:40:20.857597 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:20.857634 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:20.858172 (+ 538us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:20.858427 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:20.858431 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:20.859167 (+ 736us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:20.859469 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:20.859476 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:20.860462 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:20.860463 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:20.861271 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:20.861274 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:20.861616 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:20.861617 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:20.861720 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:20.862306 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:20.862315 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:20.863790 (+ 1475us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:20.865297 (+ 1507us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:20.865303 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:20.865305 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:20.865518 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:20.865694 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:20.865695 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:20.865695 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:20.865790 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:20.865998 (+ 208us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:20.866020 (+ 22us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:20.866135 (+ 115us) client_negotiation.cc:769] Sending connection context
0807 22:40:20.866217 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 22:40:20.866336 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":107,"threads_started":1}
I20260807 22:40:20.867096 24231 heartbeater.cc:347] Connected to a master server at 127.22.212.126:45517
I20260807 22:40:20.867204 24231 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:20.867403 24231 heartbeater.cc:511] Master 127.22.212.126:45517 requested a full tablet report, sending...
I20260807 22:40:20.867806 23457 ts_manager.cc:194] Registered new tserver with Master: 1758a5731ded41c58873a17f53dc0902 (127.22.212.67:45601)
I20260807 22:40:20.868191 23457 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.67@KRBTEST.COM'} at 127.22.212.67:47149
I20260807 22:40:20.870857 23377 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 22:40:20 dist-test-slave-2d19 krb5kdc[23389](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142420, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 22:40:20 dist-test-slave-2d19 krb5kdc[23389](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142420, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.22.212.65@KRBTEST.COM
I20260807 22:40:20.896349 24244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:20.888022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51174 (local address 127.22.212.65:33833)
0807 22:40:20.888203 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:20.888209 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:20.888227 (+ 18us) server_negotiation.cc:407] Connection header received
0807 22:40:20.888339 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:20.888343 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:20.888365 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:20.888453 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:20.889051 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:20.889768 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:20.890543 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:20.890870 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:20.890955 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:20.893257 (+ 2302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:20.893265 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:20.893265 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:20.893272 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:20.895076 (+ 1804us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:20.895396 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:20.895398 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:20.895399 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:20.895454 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:20.895658 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:20.895659 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:20.895660 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:20.895813 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:20.896053 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:20.896106 (+ 53us) server_negotiation.cc:299] Negotiation successful
0807 22:40:20.896192 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":82,"threads_started":1}
W20260807 22:40:20.896740 23634 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51174
Aug 07 22:40:20 dist-test-slave-2d19 krb5kdc[23389](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142420, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 22:40:20 dist-test-slave-2d19 krb5kdc[23389](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142420, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.212.65@KRBTEST.COM
I20260807 22:40:20.919884 24244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:20.912939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51178 (local address 127.22.212.65:33833)
0807 22:40:20.913024 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:20.913027 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:20.913126 (+ 99us) server_negotiation.cc:407] Connection header received
0807 22:40:20.913229 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:20.913230 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:20.913243 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:20.913313 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:20.913883 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:20.914378 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:20.915114 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:20.915322 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:20.915398 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:20.917718 (+ 2320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:20.917720 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:20.917721 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:20.917727 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:20.918935 (+ 1208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:20.919261 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:20.919261 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:20.919262 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:20.919313 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:20.919476 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:20.919476 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:20.919476 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:20.919574 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:20.919662 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:20.919733 (+ 71us) server_negotiation.cc:299] Negotiation successful
0807 22:40:20.919794 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 22:40:20.920499 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 23565
I20260807 22:40:20.936708 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 23782
I20260807 22:40:20.945938 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 24006
I20260807 22:40:20.957036 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 23410
2026-08-07T22:40:20Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2327 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:40:21 dist-test-slave-2d19 krb5kdc[24257](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:40:21 dist-test-slave-2d19 krb5kdc[24257](info): set up 2 sockets
Aug 07 22:40:21 dist-test-slave-2d19 krb5kdc[24257](info): commencing operation
krb5kdc: starting...
W20260807 22:40:22.227636 23377 mini_kdc.cc:121] Time spent starting KDC: real 1.245s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Aug 07 22:40:22 dist-test-slave-2d19 krb5kdc[24257](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142422, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:40:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:40:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.212.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
I20260807 22:40:22.355393 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:33609
--webserver_interface=127.22.212.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:39969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:33609
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:22.439260 24276 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:22.439514 24276 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:22.439555 24276 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:22.440733 24276 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:40:22.440814 24276 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:22.440838 24276 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:22.440860 24276 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:40:22.440889 24276 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:40:22.442382 24276 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:39969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:33609
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:33609
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24276
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:22.442689 24276 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:22.442914 24276 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:22.447945 24287 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:22.448143 24276 server_base.cc:1034] running on GCE node
W20260807 22:40:22.447942 24289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:22.447933 24286 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:22.448493 24276 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:22.448786 24276 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:22.450024 24276 hybrid_clock.cc:648] HybridClock initialized: now 1786142422449989 us; error 63 us; skew 500 ppm
Aug 07 22:40:22 dist-test-slave-2d19 krb5kdc[24257](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142422, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:22.452675 24276 init.cc:377] Logged in from keytab as kudu/127.22.212.126@KRBTEST.COM (short username kudu)
I20260807 22:40:22.453177 24276 webserver.cc:460] Webserver started at http://127.22.212.126:39767/ using document root <none> and password file <none>
I20260807 22:40:22.453428 24276 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:22.453506 24276 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:22.453650 24276 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:22.454761 24276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "5ffcf551c85b4d2e8448349b8e1f59ad"
format_stamp: "Formatted at 2026-08-07 22:40:22 on dist-test-slave-2d19"
server_key: "6280746ca257b4c36020581097a864dd"
server_key_iv: "d18eee2fb6796bcf20ced893a6aa7170"
server_key_version: "encryptionkey@0"
I20260807 22:40:22.455132 24276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "5ffcf551c85b4d2e8448349b8e1f59ad"
format_stamp: "Formatted at 2026-08-07 22:40:22 on dist-test-slave-2d19"
server_key: "6280746ca257b4c36020581097a864dd"
server_key_iv: "d18eee2fb6796bcf20ced893a6aa7170"
server_key_version: "encryptionkey@0"
I20260807 22:40:22.456569 24276 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260807 22:40:22.457341 24299 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:22.457517 24276 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 22:40:22.457626 24276 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "5ffcf551c85b4d2e8448349b8e1f59ad"
format_stamp: "Formatted at 2026-08-07 22:40:22 on dist-test-slave-2d19"
server_key: "6280746ca257b4c36020581097a864dd"
server_key_iv: "d18eee2fb6796bcf20ced893a6aa7170"
server_key_version: "encryptionkey@0"
I20260807 22:40:22.457700 24276 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:22.478221 24276 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:22.480198 24276 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:22.480368 24276 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:22.484196 24276 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:33609
I20260807 22:40:22.484287 24377 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:33609 every 8 connection(s)
I20260807 22:40:22.484661 24276 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:40:22.485623 24378 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:22.487908 24378 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ffcf551c85b4d2e8448349b8e1f59ad: Bootstrap starting.
I20260807 22:40:22.488529 24378 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5ffcf551c85b4d2e8448349b8e1f59ad: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:22.488819 24378 log.cc:824] T 00000000000000000000000000000000 P 5ffcf551c85b4d2e8448349b8e1f59ad: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:22.489620 24378 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ffcf551c85b4d2e8448349b8e1f59ad: No bootstrap required, opened a new log
I20260807 22:40:22.491245 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 24276
I20260807 22:40:22.491317 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:40:22.491221 24378 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5ffcf551c85b4d2e8448349b8e1f59ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ffcf551c85b4d2e8448349b8e1f59ad" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 33609 } }
I20260807 22:40:22.491428 24378 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5ffcf551c85b4d2e8448349b8e1f59ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:22.491484 23377 external_mini_cluster.cc:1428] Setting key 48aa5e46887d9ee94a0a723abd824ef7
I20260807 22:40:22.491496 24378 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5ffcf551c85b4d2e8448349b8e1f59ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffcf551c85b4d2e8448349b8e1f59ad, State: Initialized, Role: FOLLOWER
I20260807 22:40:22.491673 24378 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5ffcf551c85b4d2e8448349b8e1f59ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ffcf551c85b4d2e8448349b8e1f59ad" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 33609 } }
I20260807 22:40:22.491777 24378 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5ffcf551c85b4d2e8448349b8e1f59ad [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:40:22.491820 24378 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5ffcf551c85b4d2e8448349b8e1f59ad [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:40:22.491863 24378 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5ffcf551c85b4d2e8448349b8e1f59ad [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:22.492983 24378 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5ffcf551c85b4d2e8448349b8e1f59ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ffcf551c85b4d2e8448349b8e1f59ad" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 33609 } }
I20260807 22:40:22.493114 24378 leader_election.cc:302] T 00000000000000000000000000000000 P 5ffcf551c85b4d2e8448349b8e1f59ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5ffcf551c85b4d2e8448349b8e1f59ad; no voters:
I20260807 22:40:22.493304 24378 leader_election.cc:288] T 00000000000000000000000000000000 P 5ffcf551c85b4d2e8448349b8e1f59ad [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:40:22.493361 24394 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5ffcf551c85b4d2e8448349b8e1f59ad [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:40:22.493589 24378 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5ffcf551c85b4d2e8448349b8e1f59ad [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:40:22.493573 24394 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5ffcf551c85b4d2e8448349b8e1f59ad [term 1 LEADER]: Becoming Leader. State: Replica: 5ffcf551c85b4d2e8448349b8e1f59ad, State: Running, Role: LEADER
I20260807 22:40:22.493784 24394 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5ffcf551c85b4d2e8448349b8e1f59ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ffcf551c85b4d2e8448349b8e1f59ad" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 33609 } }
I20260807 22:40:22.494189 24395 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ffcf551c85b4d2e8448349b8e1f59ad [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5ffcf551c85b4d2e8448349b8e1f59ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ffcf551c85b4d2e8448349b8e1f59ad" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 33609 } } }
I20260807 22:40:22.494275 24395 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ffcf551c85b4d2e8448349b8e1f59ad [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:22.494401 24395 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ffcf551c85b4d2e8448349b8e1f59ad [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5ffcf551c85b4d2e8448349b8e1f59ad. Latest consensus state: current_term: 1 leader_uuid: "5ffcf551c85b4d2e8448349b8e1f59ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ffcf551c85b4d2e8448349b8e1f59ad" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 33609 } } }
I20260807 22:40:22.494451 24395 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ffcf551c85b4d2e8448349b8e1f59ad [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:22.494568 24408 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:40:22.495142 24408 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 07 22:40:22 dist-test-slave-2d19 krb5kdc[24257](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142422, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:40:22.499953 24408 catalog_manager.cc:1347] Generated new cluster ID: 0119e3a515f84fa6bbd9a336cbbcdd5a
I20260807 22:40:22.500011 24408 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:40:22.502851 24387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:22.491985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47216 (local address 127.22.212.126:33609)
0807 22:40:22.492195 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:22.492203 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:22.492228 (+ 25us) server_negotiation.cc:407] Connection header received
0807 22:40:22.492384 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:22.492390 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:22.492454 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:22.492563 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:22.493442 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:22.495018 (+ 1576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:22.495969 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:22.496591 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:22.496728 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:22.499296 (+ 2568us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:22.499300 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:22.499300 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:22.499312 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:22.501219 (+ 1907us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:22.501606 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:22.501610 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:22.501610 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:22.501717 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:22.501928 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:22.501930 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:22.501930 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:22.502176 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:22.502349 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:22.502447 (+ 98us) server_negotiation.cc:299] Negotiation successful
0807 22:40:22.502704 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":124,"threads_started":1}
I20260807 22:40:22.515076 24408 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:40:22.515645 24408 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:40:22.530493 24408 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5ffcf551c85b4d2e8448349b8e1f59ad: Generated new TSK 0
I20260807 22:40:22.530727 24408 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.212.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab.
Entry for principal kudu/127.22.212.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab.
I20260807 22:40:22.567574 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.65:0
--local_ip_for_outbound_sockets=127.22.212.65
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:33609
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:39969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:22.653429 24429 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:22.653718 24429 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:22.653745 24429 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:22.654950 24429 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:22.654999 24429 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:22.655035 24429 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.65
I20260807 22:40:22.656638 24429 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:39969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:33609
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24429
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.65
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:22.656863 24429 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:22.657056 24429 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:22.662366 24438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:22.662446 24443 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:22.662366 24437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:22.662581 24429 server_base.cc:1034] running on GCE node
I20260807 22:40:22.662813 24429 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:22.663079 24429 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:22.664237 24429 hybrid_clock.cc:648] HybridClock initialized: now 1786142422664221 us; error 28 us; skew 500 ppm
Aug 07 22:40:22 dist-test-slave-2d19 krb5kdc[24257](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142422, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:22.667277 24429 init.cc:377] Logged in from keytab as kudu/127.22.212.65@KRBTEST.COM (short username kudu)
I20260807 22:40:22.667794 24429 webserver.cc:460] Webserver started at http://127.22.212.65:41671/ using document root <none> and password file <none>
I20260807 22:40:22.668058 24429 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:22.668105 24429 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:22.668303 24429 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:22.669381 24429 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-0/data/instance:
uuid: "646b55ff18ec459c97b230dd2e6dd26c"
format_stamp: "Formatted at 2026-08-07 22:40:22 on dist-test-slave-2d19"
server_key: "d62cb4c20f232fa59ed810fe816466dd"
server_key_iv: "e0aaac6ac5dba303c42f404d32de937b"
server_key_version: "encryptionkey@0"
I20260807 22:40:22.669759 24429 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance:
uuid: "646b55ff18ec459c97b230dd2e6dd26c"
format_stamp: "Formatted at 2026-08-07 22:40:22 on dist-test-slave-2d19"
server_key: "d62cb4c20f232fa59ed810fe816466dd"
server_key_iv: "e0aaac6ac5dba303c42f404d32de937b"
server_key_version: "encryptionkey@0"
I20260807 22:40:22.671200 24429 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 22:40:22.672004 24453 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:22.672194 24429 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 22:40:22.672327 24429 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-0/wal
uuid: "646b55ff18ec459c97b230dd2e6dd26c"
format_stamp: "Formatted at 2026-08-07 22:40:22 on dist-test-slave-2d19"
server_key: "d62cb4c20f232fa59ed810fe816466dd"
server_key_iv: "e0aaac6ac5dba303c42f404d32de937b"
server_key_version: "encryptionkey@0"
I20260807 22:40:22.672405 24429 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:22.684682 24429 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:22.687042 24429 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:22.687215 24429 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:22.687450 24429 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:22.687770 24429 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:22.687826 24429 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:22.687870 24429 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:22.687897 24429 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:22.693928 24429 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.65:45881
I20260807 22:40:22.693972 24634 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.65:45881 every 8 connection(s)
I20260807 22:40:22.694382 24429 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
Aug 07 22:40:22 dist-test-slave-2d19 krb5kdc[24257](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142422, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:40:22.703838 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 24429
I20260807 22:40:22.703933 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance
I20260807 22:40:22.703938 24387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:22.695183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:58435 (local address 127.22.212.126:33609)
0807 22:40:22.695262 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:22.695264 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:22.695491 (+ 227us) server_negotiation.cc:407] Connection header received
0807 22:40:22.696690 (+ 1199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:22.696691 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:22.696704 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:22.696770 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:22.697355 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:22.697849 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:22.698829 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:22.699047 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:22.699102 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:22.701219 (+ 2117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:22.701220 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:22.701221 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:22.701228 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:22.702667 (+ 1439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:22.703039 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:22.703040 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:22.703040 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:22.703093 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:22.703312 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:22.703313 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:22.703313 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:22.703414 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:22.703466 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:22.703729 (+ 263us) server_negotiation.cc:299] Negotiation successful
0807 22:40:22.703819 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 22:40:22.703999 24637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:22.695166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:33609 (local address 127.22.212.65:58435)
0807 22:40:22.695328 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:22.695389 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:22.696586 (+ 1197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:22.696827 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:22.696830 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:22.697091 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:22.697284 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:22.697288 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:22.697935 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:22.697936 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:22.698750 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:22.698752 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:22.699125 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:22.699126 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:22.699234 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:22.699699 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:22.699707 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:22.701134 (+ 1427us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:22.702737 (+ 1603us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:22.702742 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:22.702743 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:22.702944 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:22.703154 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:22.703155 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:22.703155 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:22.703255 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:22.703471 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:22.703475 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:22.703584 (+ 109us) client_negotiation.cc:769] Sending connection context
0807 22:40:22.703678 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 22:40:22.703791 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":89,"threads_started":1}
I20260807 22:40:22.704133 23377 external_mini_cluster.cc:1428] Setting key fc069ee82509058fb4f23ad4ab4e4cf7
I20260807 22:40:22.704676 24635 heartbeater.cc:347] Connected to a master server at 127.22.212.126:33609
I20260807 22:40:22.704790 24635 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:22.705001 24635 heartbeater.cc:511] Master 127.22.212.126:33609 requested a full tablet report, sending...
I20260807 22:40:22.705597 24327 ts_manager.cc:194] Registered new tserver with Master: 646b55ff18ec459c97b230dd2e6dd26c (127.22.212.65:45881)
I20260807 22:40:22.706524 24327 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.65@KRBTEST.COM'} at 127.22.212.65:58435
WARNING: no policy specified for kudu/127.22.212.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab.
Entry for principal kudu/127.22.212.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab.
I20260807 22:40:22.732134 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.66:0
--local_ip_for_outbound_sockets=127.22.212.66
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:33609
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:39969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:22.815934 24647 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:22.816205 24647 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:22.816246 24647 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:22.817425 24647 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:22.817502 24647 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:22.817549 24647 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.66
I20260807 22:40:22.819096 24647 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:39969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:33609
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24647
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.66
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:22.819382 24647 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:22.819662 24647 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:22.824990 24654 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:22.825115 24653 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:22.825206 24658 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:22.825246 24647 server_base.cc:1034] running on GCE node
I20260807 22:40:22.825524 24647 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:22.825768 24647 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:22.826930 24647 hybrid_clock.cc:648] HybridClock initialized: now 1786142422826924 us; error 37 us; skew 500 ppm
Aug 07 22:40:22 dist-test-slave-2d19 krb5kdc[24257](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142422, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:22.829648 24647 init.cc:377] Logged in from keytab as kudu/127.22.212.66@KRBTEST.COM (short username kudu)
I20260807 22:40:22.830144 24647 webserver.cc:460] Webserver started at http://127.22.212.66:41759/ using document root <none> and password file <none>
I20260807 22:40:22.830394 24647 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:22.830466 24647 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:22.830647 24647 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:22.831694 24647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-1/data/instance:
uuid: "590ff019678848e4ae09a7091c7eba38"
format_stamp: "Formatted at 2026-08-07 22:40:22 on dist-test-slave-2d19"
server_key: "f9e49473c0b9ebfcf97da0f3666278b4"
server_key_iv: "169cb19dc0be36603abb6df4ff0ba756"
server_key_version: "encryptionkey@0"
I20260807 22:40:22.832089 24647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance:
uuid: "590ff019678848e4ae09a7091c7eba38"
format_stamp: "Formatted at 2026-08-07 22:40:22 on dist-test-slave-2d19"
server_key: "f9e49473c0b9ebfcf97da0f3666278b4"
server_key_iv: "169cb19dc0be36603abb6df4ff0ba756"
server_key_version: "encryptionkey@0"
I20260807 22:40:22.833537 24647 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 22:40:22.834374 24670 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:22.834558 24647 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:22.834667 24647 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-1/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-1/wal
uuid: "590ff019678848e4ae09a7091c7eba38"
format_stamp: "Formatted at 2026-08-07 22:40:22 on dist-test-slave-2d19"
server_key: "f9e49473c0b9ebfcf97da0f3666278b4"
server_key_iv: "169cb19dc0be36603abb6df4ff0ba756"
server_key_version: "encryptionkey@0"
I20260807 22:40:22.834743 24647 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:22.846974 24647 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:22.849535 24647 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:22.849653 24647 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:22.849840 24647 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:22.850198 24647 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:22.850241 24647 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:22.850265 24647 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:22.850315 24647 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:22.856633 24647 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.66:44411
I20260807 22:40:22.856667 24852 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.66:44411 every 8 connection(s)
I20260807 22:40:22.857017 24647 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
I20260807 22:40:22.857362 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 24647
I20260807 22:40:22.857447 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance
I20260807 22:40:22.857635 23377 external_mini_cluster.cc:1428] Setting key d3cebe59ea93c1d6d3578ad94c48529e
Aug 07 22:40:22 dist-test-slave-2d19 krb5kdc[24257](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142422, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:40:22.867766 24857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:22.857812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:33609 (local address 127.22.212.66:35309)
0807 22:40:22.858016 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:22.858068 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:22.859389 (+ 1321us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:22.859654 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:22.859659 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:22.860069 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:22.860416 (+ 347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:22.860423 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:22.861188 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:22.861189 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:22.861999 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:22.862001 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:22.862482 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:22.862483 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:22.862602 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:22.863134 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:22.863142 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:22.864539 (+ 1397us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:22.866414 (+ 1875us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:22.866420 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:22.866421 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:22.866653 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:22.866883 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:22.866883 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:22.866883 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:22.866978 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:22.867270 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:22.867274 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:22.867389 (+ 115us) client_negotiation.cc:769] Sending connection context
0807 22:40:22.867476 (+ 87us) client_negotiation.cc:240] Negotiation successful
0807 22:40:22.867601 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":95,"threads_started":1}
I20260807 22:40:22.867802 24387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:22.857816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:35309 (local address 127.22.212.126:33609)
0807 22:40:22.857868 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:22.857871 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:22.858173 (+ 302us) server_negotiation.cc:407] Connection header received
0807 22:40:22.859505 (+ 1332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:22.859506 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:22.859526 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:22.859577 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:22.860539 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:22.861080 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:22.862093 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:22.862391 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:22.862467 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:22.864643 (+ 2176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:22.864644 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:22.864645 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:22.864653 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:22.866272 (+ 1619us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:22.866742 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:22.866743 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:22.866744 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:22.866809 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:22.867049 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:22.867050 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:22.867050 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:22.867202 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:22.867276 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:22.867562 (+ 286us) server_negotiation.cc:299] Negotiation successful
0807 22:40:22.867675 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
WARNING: no policy specified for kudu/127.22.212.67@KRBTEST.COM; defaulting to no policy
I20260807 22:40:22.868487 24853 heartbeater.cc:347] Connected to a master server at 127.22.212.126:33609
I20260807 22:40:22.868633 24853 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:22.868817 24853 heartbeater.cc:511] Master 127.22.212.126:33609 requested a full tablet report, sending...
I20260807 22:40:22.869211 24327 ts_manager.cc:194] Registered new tserver with Master: 590ff019678848e4ae09a7091c7eba38 (127.22.212.66:44411)
I20260807 22:40:22.869609 24327 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.66@KRBTEST.COM'} at 127.22.212.66:35309
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab.
Entry for principal kudu/127.22.212.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab.
I20260807 22:40:22.887283 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.67:0
--local_ip_for_outbound_sockets=127.22.212.67
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:33609
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:39969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:22.972559 24860 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:22.972751 24860 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:22.972775 24860 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:22.973868 24860 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:22.973902 24860 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:22.973937 24860 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.67
I20260807 22:40:22.975723 24860 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:39969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:33609
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24860
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.67
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:22.975965 24860 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:22.976163 24860 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:22.981298 24874 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:22.981328 24871 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:22.981439 24870 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:22.981458 24860 server_base.cc:1034] running on GCE node
I20260807 22:40:22.981717 24860 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:22.982018 24860 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:22.983170 24860 hybrid_clock.cc:648] HybridClock initialized: now 1786142422983137 us; error 32 us; skew 500 ppm
Aug 07 22:40:22 dist-test-slave-2d19 krb5kdc[24257](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142422, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:22.986088 24860 init.cc:377] Logged in from keytab as kudu/127.22.212.67@KRBTEST.COM (short username kudu)
I20260807 22:40:22.986574 24860 webserver.cc:460] Webserver started at http://127.22.212.67:37305/ using document root <none> and password file <none>
I20260807 22:40:22.986850 24860 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:22.986940 24860 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:22.987103 24860 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:22.988333 24860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-2/data/instance:
uuid: "15251bffd39b4b908f89f4bb96ccdd3f"
format_stamp: "Formatted at 2026-08-07 22:40:22 on dist-test-slave-2d19"
server_key: "de8597e22d33caa82667622cad27fdd9"
server_key_iv: "feb3d1c239917699b6e3185d190fe0ef"
server_key_version: "encryptionkey@0"
I20260807 22:40:22.988735 24860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance:
uuid: "15251bffd39b4b908f89f4bb96ccdd3f"
format_stamp: "Formatted at 2026-08-07 22:40:22 on dist-test-slave-2d19"
server_key: "de8597e22d33caa82667622cad27fdd9"
server_key_iv: "feb3d1c239917699b6e3185d190fe0ef"
server_key_version: "encryptionkey@0"
I20260807 22:40:22.990180 24860 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260807 22:40:22.990957 24886 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:22.991149 24860 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 22:40:22.991264 24860 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-2/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-2/wal
uuid: "15251bffd39b4b908f89f4bb96ccdd3f"
format_stamp: "Formatted at 2026-08-07 22:40:22 on dist-test-slave-2d19"
server_key: "de8597e22d33caa82667622cad27fdd9"
server_key_iv: "feb3d1c239917699b6e3185d190fe0ef"
server_key_version: "encryptionkey@0"
I20260807 22:40:22.991353 24860 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:23.012238 24860 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:23.014518 24860 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:23.014716 24860 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:23.015095 24860 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:23.015488 24860 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:23.015551 24860 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:23.015599 24860 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:23.015632 24860 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:23.022171 24860 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.67:33029
I20260807 22:40:23.022212 25061 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.67:33029 every 8 connection(s)
I20260807 22:40:23.022619 24860 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
I20260807 22:40:23.023072 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 24860
I20260807 22:40:23.023173 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance
I20260807 22:40:23.023355 23377 external_mini_cluster.cc:1428] Setting key f4afbdc80719e0820c4d4806870dd7f3
Aug 07 22:40:23 dist-test-slave-2d19 krb5kdc[24257](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142422, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:40:23.032518 24387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:23.023471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:52573 (local address 127.22.212.126:33609)
0807 22:40:23.023557 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:23.023560 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:23.023812 (+ 252us) server_negotiation.cc:407] Connection header received
0807 22:40:23.025030 (+ 1218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:23.025031 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:23.025044 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:23.025098 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:23.025758 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:23.026251 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:23.027284 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:23.027478 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:23.027551 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:23.029793 (+ 2242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:23.029795 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:23.029795 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:23.029801 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:23.031296 (+ 1495us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:23.031677 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:23.031678 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:23.031678 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:23.031729 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:23.031948 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:23.031949 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:23.031949 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:23.032051 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:23.032101 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:23.032382 (+ 281us) server_negotiation.cc:299] Negotiation successful
0807 22:40:23.032449 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 22:40:23.032697 25064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:23.023466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:33609 (local address 127.22.212.67:52573)
0807 22:40:23.023672 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:23.023742 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:23.024915 (+ 1173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:23.025180 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:23.025184 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:23.025456 (+ 272us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:23.025651 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:23.025654 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:23.026350 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:23.026351 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:23.027181 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:23.027183 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:23.027574 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:23.027575 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:23.027698 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:23.028202 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:23.028211 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:23.029702 (+ 1491us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:23.031367 (+ 1665us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:23.031373 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:23.031375 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:23.031610 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:23.031786 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:23.031787 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:23.031787 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:23.031893 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:23.032106 (+ 213us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:23.032111 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:23.032222 (+ 111us) client_negotiation.cc:769] Sending connection context
0807 22:40:23.032353 (+ 131us) client_negotiation.cc:240] Negotiation successful
0807 22:40:23.032476 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":116,"threads_started":1}
I20260807 22:40:23.033195 25062 heartbeater.cc:347] Connected to a master server at 127.22.212.126:33609
I20260807 22:40:23.033313 25062 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:23.033499 25062 heartbeater.cc:511] Master 127.22.212.126:33609 requested a full tablet report, sending...
I20260807 22:40:23.033900 24327 ts_manager.cc:194] Registered new tserver with Master: 15251bffd39b4b908f89f4bb96ccdd3f (127.22.212.67:33029)
I20260807 22:40:23.034263 24327 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.67@KRBTEST.COM'} at 127.22.212.67:52573
I20260807 22:40:23.035175 23377 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:40:23.042240 24387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:23.036699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47218 (local address 127.22.212.126:33609)
0807 22:40:23.036767 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:23.036769 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:23.036855 (+ 86us) server_negotiation.cc:407] Connection header received
0807 22:40:23.036891 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:23.036892 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:23.036900 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:23.036950 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:23.037429 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:23.037941 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:23.038607 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:23.038830 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:23.038882 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:23.039991 (+ 1109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:23.039992 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:23.039992 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:23.039997 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:23.041267 (+ 1270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:23.041586 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:23.041587 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:23.041587 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:23.041637 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:23.041799 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:23.041800 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:23.041800 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:23.041932 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:23.042006 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:23.042097 (+ 91us) server_negotiation.cc:299] Negotiation successful
0807 22:40:23.042155 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 22:40:23.044560 24327 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47218:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:40:23.046273 24327 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:40:23.053277 25087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:23.049003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34814 (local address 127.22.212.66:44411)
0807 22:40:23.049383 (+ 380us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:23.049387 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:23.049396 (+ 9us) server_negotiation.cc:407] Connection header received
0807 22:40:23.049433 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:23.049435 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:23.049450 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:23.049528 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:23.049994 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:23.051084 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:23.052149 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:23.052805 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:23.052917 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:23.052982 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:23.053158 (+ 176us) server_negotiation.cc:299] Negotiation successful
0807 22:40:23.053199 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":332,"thread_start_us":117,"threads_started":1}
I20260807 22:40:23.053268 25080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:23.048813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.66:44411 (local address 127.0.0.1:34814)
0807 22:40:23.048924 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:23.048964 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:23.049034 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:23.049560 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:23.049563 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:23.049565 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:23.049797 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:23.049910 (+ 113us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:23.051230 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:23.051231 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:23.052050 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:23.052053 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:23.052935 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:23.052936 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:23.053020 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:23.053035 (+ 15us) client_negotiation.cc:769] Sending connection context
0807 22:40:23.053138 (+ 103us) client_negotiation.cc:240] Negotiation successful
0807 22:40:23.053193 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":86,"thread_start_us":83,"threads_started":1}
I20260807 22:40:23.053529 25081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:23.049036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.67:33029 (local address 127.0.0.1:42048)
0807 22:40:23.049212 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:23.049220 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:23.049361 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:23.049642 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:23.049642 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:23.049643 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:23.049679 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:23.049680 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:23.050818 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:23.050819 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:23.052310 (+ 1491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:23.052313 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:23.053288 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:23.053289 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:23.053368 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:23.053373 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 22:40:23.053408 (+ 35us) client_negotiation.cc:240] Negotiation successful
0807 22:40:23.053461 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"mutex_wait_us":37,"thread_start_us":108,"threads_started":1}
I20260807 22:40:23.053968 25089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:23.049329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42048 (local address 127.22.212.67:33029)
0807 22:40:23.049491 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:23.049496 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:23.049506 (+ 10us) server_negotiation.cc:407] Connection header received
0807 22:40:23.049545 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:23.049547 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:23.049563 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:23.049643 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:23.049732 (+ 89us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:23.050521 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:23.052419 (+ 1898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:23.053180 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:23.053701 (+ 521us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:23.053770 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:23.053795 (+ 25us) server_negotiation.cc:299] Negotiation successful
0807 22:40:23.053852 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":97,"threads_started":1}
I20260807 22:40:23.054054 25086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:23.048922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34378 (local address 127.22.212.65:45881)
0807 22:40:23.049324 (+ 402us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:23.049329 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:23.049338 (+ 9us) server_negotiation.cc:407] Connection header received
0807 22:40:23.049383 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:23.049385 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:23.049403 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:23.049481 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:23.049753 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:23.050842 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:23.052451 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:23.053181 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:23.053256 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:23.053312 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:23.053924 (+ 612us) server_negotiation.cc:299] Negotiation successful
0807 22:40:23.053971 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":77,"threads_started":1}
I20260807 22:40:23.053994 25088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:23.048814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:45881 (local address 127.0.0.1:34378)
0807 22:40:23.049180 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:23.049192 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:23.049247 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:23.049577 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:23.049578 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:23.049580 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:23.049663 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:23.049665 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:23.050952 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:23.050953 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:23.052310 (+ 1357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:23.052313 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:23.053754 (+ 1441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:23.053754 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:23.053815 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:23.053818 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:40:23.053875 (+ 57us) client_negotiation.cc:240] Negotiation successful
0807 22:40:23.053927 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":344,"mutex_wait_us":57,"thread_start_us":65,"threads_started":1}
I20260807 22:40:23.054106 24749 tablet_service.cc:1467] Processing CreateTablet for tablet acc3b5d7790c4a3986a73137701dda83 (DEFAULT_TABLE table=test-table [id=998f1d353cdb43daacd5ce1a10466942]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:23.054535 24749 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet acc3b5d7790c4a3986a73137701dda83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:23.054629 24957 tablet_service.cc:1467] Processing CreateTablet for tablet acc3b5d7790c4a3986a73137701dda83 (DEFAULT_TABLE table=test-table [id=998f1d353cdb43daacd5ce1a10466942]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:23.054967 24957 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet acc3b5d7790c4a3986a73137701dda83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:23.054951 24530 tablet_service.cc:1467] Processing CreateTablet for tablet acc3b5d7790c4a3986a73137701dda83 (DEFAULT_TABLE table=test-table [id=998f1d353cdb43daacd5ce1a10466942]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:23.055296 24530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet acc3b5d7790c4a3986a73137701dda83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:23.057956 25090 tablet_bootstrap.cc:492] T acc3b5d7790c4a3986a73137701dda83 P 646b55ff18ec459c97b230dd2e6dd26c: Bootstrap starting.
I20260807 22:40:23.058480 25091 tablet_bootstrap.cc:492] T acc3b5d7790c4a3986a73137701dda83 P 590ff019678848e4ae09a7091c7eba38: Bootstrap starting.
I20260807 22:40:23.058794 25090 tablet_bootstrap.cc:654] T acc3b5d7790c4a3986a73137701dda83 P 646b55ff18ec459c97b230dd2e6dd26c: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:23.059125 25091 tablet_bootstrap.cc:654] T acc3b5d7790c4a3986a73137701dda83 P 590ff019678848e4ae09a7091c7eba38: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:23.059367 25090 log.cc:824] T acc3b5d7790c4a3986a73137701dda83 P 646b55ff18ec459c97b230dd2e6dd26c: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:23.059688 25091 log.cc:824] T acc3b5d7790c4a3986a73137701dda83 P 590ff019678848e4ae09a7091c7eba38: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:23.060014 25093 tablet_bootstrap.cc:492] T acc3b5d7790c4a3986a73137701dda83 P 15251bffd39b4b908f89f4bb96ccdd3f: Bootstrap starting.
I20260807 22:40:23.060241 25090 tablet_bootstrap.cc:492] T acc3b5d7790c4a3986a73137701dda83 P 646b55ff18ec459c97b230dd2e6dd26c: No bootstrap required, opened a new log
I20260807 22:40:23.060344 25090 ts_tablet_manager.cc:1397] T acc3b5d7790c4a3986a73137701dda83 P 646b55ff18ec459c97b230dd2e6dd26c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 22:40:23.060549 25091 tablet_bootstrap.cc:492] T acc3b5d7790c4a3986a73137701dda83 P 590ff019678848e4ae09a7091c7eba38: No bootstrap required, opened a new log
I20260807 22:40:23.060653 25091 ts_tablet_manager.cc:1397] T acc3b5d7790c4a3986a73137701dda83 P 590ff019678848e4ae09a7091c7eba38: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 22:40:23.060779 25093 tablet_bootstrap.cc:654] T acc3b5d7790c4a3986a73137701dda83 P 15251bffd39b4b908f89f4bb96ccdd3f: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:23.061407 25093 log.cc:824] T acc3b5d7790c4a3986a73137701dda83 P 15251bffd39b4b908f89f4bb96ccdd3f: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:23.062104 25093 tablet_bootstrap.cc:492] T acc3b5d7790c4a3986a73137701dda83 P 15251bffd39b4b908f89f4bb96ccdd3f: No bootstrap required, opened a new log
I20260807 22:40:23.062189 25093 ts_tablet_manager.cc:1397] T acc3b5d7790c4a3986a73137701dda83 P 15251bffd39b4b908f89f4bb96ccdd3f: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260807 22:40:23.062459 25090 raft_consensus.cc:348] T acc3b5d7790c4a3986a73137701dda83 P 646b55ff18ec459c97b230dd2e6dd26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "646b55ff18ec459c97b230dd2e6dd26c" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 45881 } } peers { permanent_uuid: "590ff019678848e4ae09a7091c7eba38" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 44411 } } peers { permanent_uuid: "15251bffd39b4b908f89f4bb96ccdd3f" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 33029 } }
I20260807 22:40:23.062652 25090 raft_consensus.cc:374] T acc3b5d7790c4a3986a73137701dda83 P 646b55ff18ec459c97b230dd2e6dd26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:23.062690 25090 raft_consensus.cc:729] T acc3b5d7790c4a3986a73137701dda83 P 646b55ff18ec459c97b230dd2e6dd26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 646b55ff18ec459c97b230dd2e6dd26c, State: Initialized, Role: FOLLOWER
I20260807 22:40:23.062845 25090 consensus_queue.cc:260] T acc3b5d7790c4a3986a73137701dda83 P 646b55ff18ec459c97b230dd2e6dd26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "646b55ff18ec459c97b230dd2e6dd26c" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 45881 } } peers { permanent_uuid: "590ff019678848e4ae09a7091c7eba38" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 44411 } } peers { permanent_uuid: "15251bffd39b4b908f89f4bb96ccdd3f" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 33029 } }
I20260807 22:40:23.062902 25091 raft_consensus.cc:348] T acc3b5d7790c4a3986a73137701dda83 P 590ff019678848e4ae09a7091c7eba38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "646b55ff18ec459c97b230dd2e6dd26c" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 45881 } } peers { permanent_uuid: "590ff019678848e4ae09a7091c7eba38" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 44411 } } peers { permanent_uuid: "15251bffd39b4b908f89f4bb96ccdd3f" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 33029 } }
I20260807 22:40:23.063074 25091 raft_consensus.cc:374] T acc3b5d7790c4a3986a73137701dda83 P 590ff019678848e4ae09a7091c7eba38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:23.063122 25091 raft_consensus.cc:729] T acc3b5d7790c4a3986a73137701dda83 P 590ff019678848e4ae09a7091c7eba38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ff019678848e4ae09a7091c7eba38, State: Initialized, Role: FOLLOWER
I20260807 22:40:23.063156 25090 ts_tablet_manager.cc:1428] T acc3b5d7790c4a3986a73137701dda83 P 646b55ff18ec459c97b230dd2e6dd26c: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260807 22:40:23.063237 25091 consensus_queue.cc:260] T acc3b5d7790c4a3986a73137701dda83 P 590ff019678848e4ae09a7091c7eba38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "646b55ff18ec459c97b230dd2e6dd26c" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 45881 } } peers { permanent_uuid: "590ff019678848e4ae09a7091c7eba38" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 44411 } } peers { permanent_uuid: "15251bffd39b4b908f89f4bb96ccdd3f" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 33029 } }
I20260807 22:40:23.063293 24635 heartbeater.cc:503] Master 127.22.212.126:33609 was elected leader, sending a full tablet report...
I20260807 22:40:23.063536 24853 heartbeater.cc:503] Master 127.22.212.126:33609 was elected leader, sending a full tablet report...
I20260807 22:40:23.063534 25091 ts_tablet_manager.cc:1428] T acc3b5d7790c4a3986a73137701dda83 P 590ff019678848e4ae09a7091c7eba38: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 22:40:23.064177 25093 raft_consensus.cc:348] T acc3b5d7790c4a3986a73137701dda83 P 15251bffd39b4b908f89f4bb96ccdd3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "646b55ff18ec459c97b230dd2e6dd26c" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 45881 } } peers { permanent_uuid: "590ff019678848e4ae09a7091c7eba38" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 44411 } } peers { permanent_uuid: "15251bffd39b4b908f89f4bb96ccdd3f" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 33029 } }
I20260807 22:40:23.064422 25093 raft_consensus.cc:374] T acc3b5d7790c4a3986a73137701dda83 P 15251bffd39b4b908f89f4bb96ccdd3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:23.064471 25093 raft_consensus.cc:729] T acc3b5d7790c4a3986a73137701dda83 P 15251bffd39b4b908f89f4bb96ccdd3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15251bffd39b4b908f89f4bb96ccdd3f, State: Initialized, Role: FOLLOWER
I20260807 22:40:23.064612 25093 consensus_queue.cc:260] T acc3b5d7790c4a3986a73137701dda83 P 15251bffd39b4b908f89f4bb96ccdd3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "646b55ff18ec459c97b230dd2e6dd26c" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 45881 } } peers { permanent_uuid: "590ff019678848e4ae09a7091c7eba38" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 44411 } } peers { permanent_uuid: "15251bffd39b4b908f89f4bb96ccdd3f" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 33029 } }
I20260807 22:40:23.064917 25093 ts_tablet_manager.cc:1428] T acc3b5d7790c4a3986a73137701dda83 P 15251bffd39b4b908f89f4bb96ccdd3f: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260807 22:40:23.064986 25062 heartbeater.cc:503] Master 127.22.212.126:33609 was elected leader, sending a full tablet report...
W20260807 22:40:23.107645 24854 tablet.cc:2369] T acc3b5d7790c4a3986a73137701dda83 P 590ff019678848e4ae09a7091c7eba38: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:40:23.194901 25101 raft_consensus.cc:482] T acc3b5d7790c4a3986a73137701dda83 P 590ff019678848e4ae09a7091c7eba38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:40:23.195063 25101 raft_consensus.cc:504] T acc3b5d7790c4a3986a73137701dda83 P 590ff019678848e4ae09a7091c7eba38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "646b55ff18ec459c97b230dd2e6dd26c" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 45881 } } peers { permanent_uuid: "590ff019678848e4ae09a7091c7eba38" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 44411 } } peers { permanent_uuid: "15251bffd39b4b908f89f4bb96ccdd3f" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 33029 } }
W20260807 22:40:23.195226 24636 tablet.cc:2369] T acc3b5d7790c4a3986a73137701dda83 P 646b55ff18ec459c97b230dd2e6dd26c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:40:23.195582 25101 leader_election.cc:288] T acc3b5d7790c4a3986a73137701dda83 P 590ff019678848e4ae09a7091c7eba38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 646b55ff18ec459c97b230dd2e6dd26c (127.22.212.65:45881), 15251bffd39b4b908f89f4bb96ccdd3f (127.22.212.67:33029)
I20260807 22:40:23.199510 25089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:23.196088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:37085 (local address 127.22.212.67:33029)
0807 22:40:23.196158 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:23.196160 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:23.196221 (+ 61us) server_negotiation.cc:407] Connection header received
0807 22:40:23.196335 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:23.196336 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:23.196345 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:23.196397 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:23.196528 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:23.197202 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:23.198574 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:23.199140 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:23.199218 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:23.199229 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:23.199400 (+ 171us) server_negotiation.cc:299] Negotiation successful
0807 22:40:23.199440 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 22:40:23.199523 25086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:23.195922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:47771 (local address 127.22.212.65:45881)
0807 22:40:23.196015 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:23.196017 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:23.196027 (+ 10us) server_negotiation.cc:407] Connection header received
0807 22:40:23.196059 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:23.196060 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:23.196077 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:23.196164 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:23.196349 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:23.197112 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:23.198574 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:23.199136 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:23.199229 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:23.199238 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:23.199400 (+ 162us) server_negotiation.cc:299] Negotiation successful
0807 22:40:23.199440 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 22:40:23.199512 24857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:23.195824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:45881 (local address 127.22.212.66:47771)
0807 22:40:23.195897 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:23.195909 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:23.195974 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:23.196190 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:23.196191 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:23.196193 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:23.196289 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:23.196291 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:23.197198 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:23.197199 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:23.198466 (+ 1267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:23.198469 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:23.199240 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:23.199241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:23.199316 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:23.199318 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 22:40:23.199374 (+ 56us) client_negotiation.cc:240] Negotiation successful
0807 22:40:23.199420 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":17}
I20260807 22:40:23.199542 25104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:23.195949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.67:33029 (local address 127.22.212.66:37085)
0807 22:40:23.196168 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:23.196177 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:23.196228 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:23.196410 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:23.196410 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:23.196412 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:23.196466 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:23.196467 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:23.197279 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:23.197280 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:23.198466 (+ 1186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:23.198468 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:23.199232 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:23.199233 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:23.199313 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:23.199318 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 22:40:23.199374 (+ 56us) client_negotiation.cc:240] Negotiation successful
0807 22:40:23.199419 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"mutex_wait_us":8,"thread_start_us":137,"threads_started":1}
I20260807 22:40:23.199903 24568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc3b5d7790c4a3986a73137701dda83" candidate_uuid: "590ff019678848e4ae09a7091c7eba38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "646b55ff18ec459c97b230dd2e6dd26c" is_pre_election: true
I20260807 22:40:23.200047 24568 raft_consensus.cc:2454] T acc3b5d7790c4a3986a73137701dda83 P 646b55ff18ec459c97b230dd2e6dd26c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 590ff019678848e4ae09a7091c7eba38 in term 0.
I20260807 22:40:23.200238 24673 leader_election.cc:302] T acc3b5d7790c4a3986a73137701dda83 P 590ff019678848e4ae09a7091c7eba38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 590ff019678848e4ae09a7091c7eba38, 646b55ff18ec459c97b230dd2e6dd26c; no voters:
I20260807 22:40:23.200441 25101 raft_consensus.cc:2781] T acc3b5d7790c4a3986a73137701dda83 P 590ff019678848e4ae09a7091c7eba38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:40:23.200383 24996 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc3b5d7790c4a3986a73137701dda83" candidate_uuid: "590ff019678848e4ae09a7091c7eba38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15251bffd39b4b908f89f4bb96ccdd3f" is_pre_election: true
I20260807 22:40:23.200507 25101 raft_consensus.cc:482] T acc3b5d7790c4a3986a73137701dda83 P 590ff019678848e4ae09a7091c7eba38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:40:23.200534 25101 raft_consensus.cc:3037] T acc3b5d7790c4a3986a73137701dda83 P 590ff019678848e4ae09a7091c7eba38 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:23.200575 24996 raft_consensus.cc:2454] T acc3b5d7790c4a3986a73137701dda83 P 15251bffd39b4b908f89f4bb96ccdd3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 590ff019678848e4ae09a7091c7eba38 in term 0.
I20260807 22:40:23.201341 25101 raft_consensus.cc:504] T acc3b5d7790c4a3986a73137701dda83 P 590ff019678848e4ae09a7091c7eba38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "646b55ff18ec459c97b230dd2e6dd26c" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 45881 } } peers { permanent_uuid: "590ff019678848e4ae09a7091c7eba38" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 44411 } } peers { permanent_uuid: "15251bffd39b4b908f89f4bb96ccdd3f" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 33029 } }
I20260807 22:40:23.201486 25101 leader_election.cc:288] T acc3b5d7790c4a3986a73137701dda83 P 590ff019678848e4ae09a7091c7eba38 [CANDIDATE]: Term 1 election: Requested vote from peers 646b55ff18ec459c97b230dd2e6dd26c (127.22.212.65:45881), 15251bffd39b4b908f89f4bb96ccdd3f (127.22.212.67:33029)
I20260807 22:40:23.201673 24568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc3b5d7790c4a3986a73137701dda83" candidate_uuid: "590ff019678848e4ae09a7091c7eba38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "646b55ff18ec459c97b230dd2e6dd26c"
I20260807 22:40:23.201684 24996 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acc3b5d7790c4a3986a73137701dda83" candidate_uuid: "590ff019678848e4ae09a7091c7eba38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15251bffd39b4b908f89f4bb96ccdd3f"
I20260807 22:40:23.201771 24568 raft_consensus.cc:3037] T acc3b5d7790c4a3986a73137701dda83 P 646b55ff18ec459c97b230dd2e6dd26c [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:23.201767 24996 raft_consensus.cc:3037] T acc3b5d7790c4a3986a73137701dda83 P 15251bffd39b4b908f89f4bb96ccdd3f [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:23.202487 24568 raft_consensus.cc:2454] T acc3b5d7790c4a3986a73137701dda83 P 646b55ff18ec459c97b230dd2e6dd26c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590ff019678848e4ae09a7091c7eba38 in term 1.
I20260807 22:40:23.202569 24996 raft_consensus.cc:2454] T acc3b5d7790c4a3986a73137701dda83 P 15251bffd39b4b908f89f4bb96ccdd3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590ff019678848e4ae09a7091c7eba38 in term 1.
I20260807 22:40:23.202711 24673 leader_election.cc:302] T acc3b5d7790c4a3986a73137701dda83 P 590ff019678848e4ae09a7091c7eba38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 590ff019678848e4ae09a7091c7eba38, 646b55ff18ec459c97b230dd2e6dd26c; no voters:
I20260807 22:40:23.202801 25101 raft_consensus.cc:2781] T acc3b5d7790c4a3986a73137701dda83 P 590ff019678848e4ae09a7091c7eba38 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:40:23.202984 25101 raft_consensus.cc:686] T acc3b5d7790c4a3986a73137701dda83 P 590ff019678848e4ae09a7091c7eba38 [term 1 LEADER]: Becoming Leader. State: Replica: 590ff019678848e4ae09a7091c7eba38, State: Running, Role: LEADER
I20260807 22:40:23.203106 25101 consensus_queue.cc:237] T acc3b5d7790c4a3986a73137701dda83 P 590ff019678848e4ae09a7091c7eba38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "646b55ff18ec459c97b230dd2e6dd26c" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 45881 } } peers { permanent_uuid: "590ff019678848e4ae09a7091c7eba38" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 44411 } } peers { permanent_uuid: "15251bffd39b4b908f89f4bb96ccdd3f" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 33029 } }
I20260807 22:40:23.203984 24327 catalog_manager.cc:5495] T acc3b5d7790c4a3986a73137701dda83 P 590ff019678848e4ae09a7091c7eba38 reported cstate change: term changed from 0 to 1, leader changed from <none> to 590ff019678848e4ae09a7091c7eba38 (127.22.212.66). New cstate: current_term: 1 leader_uuid: "590ff019678848e4ae09a7091c7eba38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "646b55ff18ec459c97b230dd2e6dd26c" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 45881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "590ff019678848e4ae09a7091c7eba38" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 44411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "15251bffd39b4b908f89f4bb96ccdd3f" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 33029 } health_report { overall_health: UNKNOWN } } }
Aug 07 22:40:23 dist-test-slave-2d19 krb5kdc[24257](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142422, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.212.65@KRBTEST.COM
I20260807 22:40:23.244845 25086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:23.235303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34388 (local address 127.22.212.65:45881)
0807 22:40:23.235350 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:23.235352 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:23.236409 (+ 1057us) server_negotiation.cc:407] Connection header received
0807 22:40:23.236501 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:23.236502 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:23.236521 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:23.236615 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:23.237549 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:23.238342 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:23.239263 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:23.239520 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:23.239603 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:23.242072 (+ 2469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:23.242086 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:23.242087 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:23.242099 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:23.243550 (+ 1451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:23.243905 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:23.243909 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:23.243910 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:23.243986 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:23.244210 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:23.244211 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:23.244212 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:23.244404 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:23.244564 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:23.244642 (+ 78us) server_negotiation.cc:299] Negotiation successful
0807 22:40:23.244726 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
Aug 07 22:40:23 dist-test-slave-2d19 krb5kdc[24257](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142423, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 22:40:23 dist-test-slave-2d19 krb5kdc[24257](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142423, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.22.212.65@KRBTEST.COM
I20260807 22:40:23.269141 25086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:23.262035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34392 (local address 127.22.212.65:45881)
0807 22:40:23.262128 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:23.262131 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:23.262228 (+ 97us) server_negotiation.cc:407] Connection header received
0807 22:40:23.262328 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:23.262329 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:23.262340 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:23.262410 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:23.262994 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:23.263472 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:23.264205 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:23.264462 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:23.264535 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:23.266753 (+ 2218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:23.266755 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:23.266755 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:23.266762 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:23.267936 (+ 1174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:23.268325 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:23.268326 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:23.268327 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:23.268384 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:23.268632 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:23.268634 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:23.268634 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:23.268761 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:23.268845 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:23.268994 (+ 149us) server_negotiation.cc:299] Negotiation successful
0807 22:40:23.269074 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
W20260807 22:40:23.273465 25063 tablet.cc:2369] T acc3b5d7790c4a3986a73137701dda83 P 15251bffd39b4b908f89f4bb96ccdd3f: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 07 22:40:23 dist-test-slave-2d19 krb5kdc[24257](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142423, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 22:40:23 dist-test-slave-2d19 krb5kdc[24257](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142423, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.212.65@KRBTEST.COM
I20260807 22:40:23.292713 25086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:23.285730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34404 (local address 127.22.212.65:45881)
0807 22:40:23.285804 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:23.285805 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:23.285864 (+ 59us) server_negotiation.cc:407] Connection header received
0807 22:40:23.285912 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:23.285958 (+ 46us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:23.285968 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:23.286020 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:23.286559 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:23.287076 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:23.287758 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:23.287964 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:23.288016 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:23.290297 (+ 2281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:23.290298 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:23.290299 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:23.290305 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:23.291578 (+ 1273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:23.291893 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:23.291894 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:23.291894 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:23.291948 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:23.292122 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:23.292123 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:23.292123 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:23.292221 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:23.292389 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:23.292493 (+ 104us) server_negotiation.cc:299] Negotiation successful
0807 22:40:23.292574 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
W20260807 22:40:23.293258 24492 tablet_service.cc:2908] Rejecting scan request for tablet acc3b5d7790c4a3986a73137701dda83: Uninitialized: clean time has not yet been initialized
I20260807 22:40:23.294211 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 24429
I20260807 22:40:23.306989 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 24647
I20260807 22:40:23.314945 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 24860
I20260807 22:40:23.327265 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 24276
2026-08-07T22:40:23Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2372 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:40:23 dist-test-slave-2d19 krb5kdc[25129](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:40:23 dist-test-slave-2d19 krb5kdc[25129](info): set up 2 sockets
Aug 07 22:40:23 dist-test-slave-2d19 krb5kdc[25129](info): commencing operation
krb5kdc: starting...
W20260807 22:40:24.623019 23377 mini_kdc.cc:121] Time spent starting KDC: real 1.268s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Aug 07 22:40:24 dist-test-slave-2d19 krb5kdc[25129](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142424, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:40:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:40:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.212.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
I20260807 22:40:24.755611 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:36515
--webserver_interface=127.22.212.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:33481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:36515
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:24.838539 25148 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:24.838740 25148 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:24.838762 25148 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:24.839811 25148 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:40:24.839844 25148 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 22:40:24.839859 25148 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:24.839871 25148 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:24.839883 25148 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:40:24.839895 25148 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:40:24.841317 25148 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:33481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:36515
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:36515
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25148
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:24.841507 25148 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:24.841672 25148 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:24.846662 25165 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:24.846661 25162 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:24.846685 25163 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:24.846940 25148 server_base.cc:1034] running on GCE node
I20260807 22:40:24.847189 25148 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:24.847431 25148 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:24.848568 25148 hybrid_clock.cc:648] HybridClock initialized: now 1786142424848554 us; error 29 us; skew 500 ppm
Aug 07 22:40:24 dist-test-slave-2d19 krb5kdc[25129](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142424, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:24.851171 25148 init.cc:377] Logged in from keytab as kudu/127.22.212.126@KRBTEST.COM (short username kudu)
I20260807 22:40:24.851660 25148 webserver.cc:460] Webserver started at http://127.22.212.126:35415/ using document root <none> and password file <none>
I20260807 22:40:24.851929 25148 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:24.851976 25148 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:24.852140 25148 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:24.853308 25148 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "df88778dec9d42229715fd36cd58bf1f"
format_stamp: "Formatted at 2026-08-07 22:40:24 on dist-test-slave-2d19"
server_key: "fb3c6e63e96d77f98da13d90162819b6"
server_key_iv: "892039bcb6317fca9f7639ba1bdf9591"
server_key_version: "encryptionkey@0"
I20260807 22:40:24.853677 25148 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "df88778dec9d42229715fd36cd58bf1f"
format_stamp: "Formatted at 2026-08-07 22:40:24 on dist-test-slave-2d19"
server_key: "fb3c6e63e96d77f98da13d90162819b6"
server_key_iv: "892039bcb6317fca9f7639ba1bdf9591"
server_key_version: "encryptionkey@0"
I20260807 22:40:24.855104 25148 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 22:40:24.855888 25179 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:24.856086 25148 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 22:40:24.856180 25148 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "df88778dec9d42229715fd36cd58bf1f"
format_stamp: "Formatted at 2026-08-07 22:40:24 on dist-test-slave-2d19"
server_key: "fb3c6e63e96d77f98da13d90162819b6"
server_key_iv: "892039bcb6317fca9f7639ba1bdf9591"
server_key_version: "encryptionkey@0"
I20260807 22:40:24.856288 25148 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:24.880825 25148 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:24.883349 25148 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:24.883545 25148 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:24.889102 25148 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:36515
I20260807 22:40:24.889189 25277 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:36515 every 8 connection(s)
I20260807 22:40:24.889554 25148 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:40:24.890262 25278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:24.891291 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 25148
I20260807 22:40:24.891396 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:40:24.891572 23377 external_mini_cluster.cc:1428] Setting key d1164449c3475dd3a78b17ba3c02339c
I20260807 22:40:24.893561 25278 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df88778dec9d42229715fd36cd58bf1f: Bootstrap starting.
I20260807 22:40:24.894186 25278 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P df88778dec9d42229715fd36cd58bf1f: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:24.894505 25278 log.cc:824] T 00000000000000000000000000000000 P df88778dec9d42229715fd36cd58bf1f: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:24.895207 25278 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df88778dec9d42229715fd36cd58bf1f: No bootstrap required, opened a new log
I20260807 22:40:24.897153 25278 raft_consensus.cc:348] T 00000000000000000000000000000000 P df88778dec9d42229715fd36cd58bf1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df88778dec9d42229715fd36cd58bf1f" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36515 } }
I20260807 22:40:24.897313 25278 raft_consensus.cc:374] T 00000000000000000000000000000000 P df88778dec9d42229715fd36cd58bf1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:24.897382 25278 raft_consensus.cc:729] T 00000000000000000000000000000000 P df88778dec9d42229715fd36cd58bf1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df88778dec9d42229715fd36cd58bf1f, State: Initialized, Role: FOLLOWER
I20260807 22:40:24.897583 25278 consensus_queue.cc:260] T 00000000000000000000000000000000 P df88778dec9d42229715fd36cd58bf1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df88778dec9d42229715fd36cd58bf1f" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36515 } }
I20260807 22:40:24.897682 25278 raft_consensus.cc:388] T 00000000000000000000000000000000 P df88778dec9d42229715fd36cd58bf1f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:40:24.897715 25278 raft_consensus.cc:482] T 00000000000000000000000000000000 P df88778dec9d42229715fd36cd58bf1f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:40:24.897755 25278 raft_consensus.cc:3037] T 00000000000000000000000000000000 P df88778dec9d42229715fd36cd58bf1f [term 0 FOLLOWER]: Advancing to term 1
Aug 07 22:40:24 dist-test-slave-2d19 krb5kdc[25129](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142424, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:40:24.898494 25278 raft_consensus.cc:504] T 00000000000000000000000000000000 P df88778dec9d42229715fd36cd58bf1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df88778dec9d42229715fd36cd58bf1f" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36515 } }
I20260807 22:40:24.898622 25278 leader_election.cc:302] T 00000000000000000000000000000000 P df88778dec9d42229715fd36cd58bf1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: df88778dec9d42229715fd36cd58bf1f; no voters:
I20260807 22:40:24.898820 25278 leader_election.cc:288] T 00000000000000000000000000000000 P df88778dec9d42229715fd36cd58bf1f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:40:24.898888 25288 raft_consensus.cc:2781] T 00000000000000000000000000000000 P df88778dec9d42229715fd36cd58bf1f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:40:24.899056 25288 raft_consensus.cc:686] T 00000000000000000000000000000000 P df88778dec9d42229715fd36cd58bf1f [term 1 LEADER]: Becoming Leader. State: Replica: df88778dec9d42229715fd36cd58bf1f, State: Running, Role: LEADER
I20260807 22:40:24.899108 25278 sys_catalog.cc:564] T 00000000000000000000000000000000 P df88778dec9d42229715fd36cd58bf1f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:40:24.899231 25288 consensus_queue.cc:237] T 00000000000000000000000000000000 P df88778dec9d42229715fd36cd58bf1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df88778dec9d42229715fd36cd58bf1f" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36515 } }
I20260807 22:40:24.899667 25288 sys_catalog.cc:455] T 00000000000000000000000000000000 P df88778dec9d42229715fd36cd58bf1f [sys.catalog]: SysCatalogTable state changed. Reason: New leader df88778dec9d42229715fd36cd58bf1f. Latest consensus state: current_term: 1 leader_uuid: "df88778dec9d42229715fd36cd58bf1f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df88778dec9d42229715fd36cd58bf1f" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36515 } } }
I20260807 22:40:24.899749 25288 sys_catalog.cc:458] T 00000000000000000000000000000000 P df88778dec9d42229715fd36cd58bf1f [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:24.899788 25290 sys_catalog.cc:455] T 00000000000000000000000000000000 P df88778dec9d42229715fd36cd58bf1f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "df88778dec9d42229715fd36cd58bf1f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df88778dec9d42229715fd36cd58bf1f" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36515 } } }
I20260807 22:40:24.899874 25290 sys_catalog.cc:458] T 00000000000000000000000000000000 P df88778dec9d42229715fd36cd58bf1f [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:24.900192 25300 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:40:24.900767 25300 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:40:24.902468 25300 catalog_manager.cc:1347] Generated new cluster ID: 5963b2d9bfac46dc950af9b2e29f0371
I20260807 22:40:24.902518 25300 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:40:24.902810 25284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:24.892127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39918 (local address 127.22.212.126:36515)
0807 22:40:24.892367 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:24.892376 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:24.892403 (+ 27us) server_negotiation.cc:407] Connection header received
0807 22:40:24.892811 (+ 408us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:24.892818 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:24.892864 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:24.893025 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:24.893655 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:24.894683 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:24.895489 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:24.895903 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:24.896034 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:24.898705 (+ 2671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:24.898709 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:24.898709 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:24.898721 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:24.901114 (+ 2393us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:24.901515 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:24.901518 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:24.901519 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:24.901629 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:24.901865 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:24.901866 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:24.901867 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:24.902176 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:24.902354 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:24.902427 (+ 73us) server_negotiation.cc:299] Negotiation successful
0807 22:40:24.902582 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":129,"threads_started":1}
I20260807 22:40:24.919802 25300 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:40:24.920434 25300 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:40:24.929625 25300 catalog_manager.cc:5868] T 00000000000000000000000000000000 P df88778dec9d42229715fd36cd58bf1f: Generated new TSK 0
I20260807 22:40:24.929831 25300 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.212.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab.
Entry for principal kudu/127.22.212.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab.
I20260807 22:40:24.963527 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.65:0
--local_ip_for_outbound_sockets=127.22.212.65
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:36515
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:33481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:25.067792 25324 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:25.068004 25324 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:25.068030 25324 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:25.069232 25324 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:25.069278 25324 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:25.069299 25324 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 22:40:25.069316 25324 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.65
I20260807 22:40:25.070773 25324 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:33481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.212.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.22.212.126:36515
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25324
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.65
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:25.071025 25324 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:25.071277 25324 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:25.076467 25336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:25.076452 25330 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:25.076454 25331 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:25.076525 25324 server_base.cc:1034] running on GCE node
I20260807 22:40:25.076840 25324 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:25.077081 25324 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:25.078227 25324 hybrid_clock.cc:648] HybridClock initialized: now 1786142425078212 us; error 33 us; skew 500 ppm
Aug 07 22:40:25 dist-test-slave-2d19 krb5kdc[25129](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142425, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:25.080834 25324 init.cc:377] Logged in from keytab as kudu/127.22.212.65@KRBTEST.COM (short username kudu)
I20260807 22:40:25.081286 25324 webserver.cc:460] Webserver started at http://127.22.212.65:45509/ using document root <none> and password file <none>
I20260807 22:40:25.081513 25324 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:25.081557 25324 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:25.081647 25324 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:25.082717 25324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-0/data/instance:
uuid: "4d43fda9eb8345d48782cafe2fb787e4"
format_stamp: "Formatted at 2026-08-07 22:40:25 on dist-test-slave-2d19"
server_key: "bdb4d8eeecdaeee5377b15aee6128933"
server_key_iv: "ac1d1475f5c1026eaf19b0fb1e08ef1d"
server_key_version: "encryptionkey@0"
I20260807 22:40:25.083034 25324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance:
uuid: "4d43fda9eb8345d48782cafe2fb787e4"
format_stamp: "Formatted at 2026-08-07 22:40:25 on dist-test-slave-2d19"
server_key: "bdb4d8eeecdaeee5377b15aee6128933"
server_key_iv: "ac1d1475f5c1026eaf19b0fb1e08ef1d"
server_key_version: "encryptionkey@0"
I20260807 22:40:25.084368 25324 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260807 22:40:25.085165 25356 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:25.085357 25324 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:40:25.085474 25324 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-0/wal
uuid: "4d43fda9eb8345d48782cafe2fb787e4"
format_stamp: "Formatted at 2026-08-07 22:40:25 on dist-test-slave-2d19"
server_key: "bdb4d8eeecdaeee5377b15aee6128933"
server_key_iv: "ac1d1475f5c1026eaf19b0fb1e08ef1d"
server_key_version: "encryptionkey@0"
I20260807 22:40:25.085562 25324 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:25.106150 25324 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:25.108736 25324 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:25.108917 25324 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:25.109469 25324 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:25.109539 25324 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:25.109586 25324 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:25.109611 25324 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:25.116729 25324 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.65:46215
Aug 07 22:40:25 dist-test-slave-2d19 krb5kdc[25129](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142425, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:40:25.116806 25567 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.65:46215 every 8 connection(s)
I20260807 22:40:25.117157 25324 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
I20260807 22:40:25.120042 25284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.110202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:54129 (local address 127.22.212.126:36515)
0807 22:40:25.110288 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:25.110290 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:25.110516 (+ 226us) server_negotiation.cc:407] Connection header received
0807 22:40:25.111084 (+ 568us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:25.111085 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:25.111099 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:25.111181 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:25.112133 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.113033 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.114498 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.114838 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.114927 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.117425 (+ 2498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:25.117426 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:25.117427 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:25.117435 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:25.118811 (+ 1376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:25.119200 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:25.119201 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:25.119202 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:25.119255 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:25.119488 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:25.119488 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:25.119489 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:25.119594 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:25.119644 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:25.119829 (+ 185us) server_negotiation.cc:299] Negotiation successful
0807 22:40:25.119899 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 22:40:25.120152 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 25324
I20260807 22:40:25.120174 25370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.110183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:36515 (local address 127.22.212.65:54129)
0807 22:40:25.110370 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:25.110412 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:25.110956 (+ 544us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:25.111273 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:25.111279 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:25.111660 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:25.111963 (+ 303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:25.111970 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.113166 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.113167 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:25.114382 (+ 1215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:25.114386 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.114939 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.114939 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:25.115051 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.115612 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:25.115629 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:25.117307 (+ 1678us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:25.118895 (+ 1588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:25.118901 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:25.118903 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:25.119128 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:25.119337 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:25.119337 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:25.119337 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:25.119433 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:25.119635 (+ 202us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:25.119639 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:25.119745 (+ 106us) client_negotiation.cc:769] Sending connection context
0807 22:40:25.119821 (+ 76us) client_negotiation.cc:240] Negotiation successful
0807 22:40:25.119939 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":119,"threads_started":1}
I20260807 22:40:25.120234 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance
I20260807 22:40:25.120445 23377 external_mini_cluster.cc:1428] Setting key 979ef2c4c6f0c4cf1d513f84cc38a319
I20260807 22:40:25.120772 25568 heartbeater.cc:347] Connected to a master server at 127.22.212.126:36515
I20260807 22:40:25.120888 25568 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:25.121080 25568 heartbeater.cc:511] Master 127.22.212.126:36515 requested a full tablet report, sending...
I20260807 22:40:25.121713 25210 ts_manager.cc:194] Registered new tserver with Master: 4d43fda9eb8345d48782cafe2fb787e4 (127.22.212.65:46215)
I20260807 22:40:25.122323 25210 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.65@KRBTEST.COM'} at 127.22.212.65:54129
I20260807 22:40:25.129310 25579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.123271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:36515 (local address 127.22.212.65:35035)
0807 22:40:25.123407 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:25.123419 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:25.123479 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:25.123629 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:25.123630 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:25.123809 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:25.123858 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:25.123860 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.124738 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.124739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:25.125235 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:25.125237 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.125728 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.125729 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:25.125782 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.126258 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:25.126263 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:25.126558 (+ 295us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:25.128351 (+ 1793us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:25.128356 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:25.128357 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:25.128522 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:25.128739 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:25.128739 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:25.128740 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:25.128791 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:25.129086 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:25.129086 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:25.129123 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 22:40:25.129172 (+ 49us) client_negotiation.cc:240] Negotiation successful
0807 22:40:25.129245 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":77,"threads_started":1}
I20260807 22:40:25.129375 25284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.123350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:35035 (local address 127.22.212.126:36515)
0807 22:40:25.123397 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:25.123398 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:25.123462 (+ 64us) server_negotiation.cc:407] Connection header received
0807 22:40:25.123557 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:25.123558 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:25.123567 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:25.123622 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:25.123939 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.124628 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.125319 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.125649 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.125725 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.126652 (+ 927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:25.126654 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:25.126654 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:25.126662 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:25.128219 (+ 1557us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:25.128599 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:25.128601 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:25.128601 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:25.128668 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:25.128857 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:25.128858 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:25.128859 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:25.129013 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:25.129092 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:25.129200 (+ 108us) server_negotiation.cc:299] Negotiation successful
0807 22:40:25.129281 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
WARNING: no policy specified for kudu/127.22.212.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab.
Entry for principal kudu/127.22.212.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab.
I20260807 22:40:25.151968 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.66:0
--local_ip_for_outbound_sockets=127.22.212.66
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:36515
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:33481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:25.239552 25582 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:25.239794 25582 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:25.239838 25582 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:25.241103 25582 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:25.241171 25582 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:25.241205 25582 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 22:40:25.241247 25582 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.66
I20260807 22:40:25.242966 25582 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:33481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.212.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.22.212.126:36515
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25582
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.66
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:25.243472 25582 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:25.243774 25582 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:25.250689 25589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:25.250697 25592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:25.250730 25590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:25.250989 25582 server_base.cc:1034] running on GCE node
I20260807 22:40:25.256035 25582 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:25.256388 25582 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:25.257586 25582 hybrid_clock.cc:648] HybridClock initialized: now 1786142425257570 us; error 39 us; skew 500 ppm
Aug 07 22:40:25 dist-test-slave-2d19 krb5kdc[25129](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142425, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:25.260391 25582 init.cc:377] Logged in from keytab as kudu/127.22.212.66@KRBTEST.COM (short username kudu)
I20260807 22:40:25.260872 25582 webserver.cc:460] Webserver started at http://127.22.212.66:36949/ using document root <none> and password file <none>
I20260807 22:40:25.261068 25582 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:25.261108 25582 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:25.261200 25582 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:25.262270 25582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-1/data/instance:
uuid: "344558a882f741f48656fcb72f690987"
format_stamp: "Formatted at 2026-08-07 22:40:25 on dist-test-slave-2d19"
server_key: "b1e7717b13991b7da70cf3b0ae49bdc9"
server_key_iv: "84c474392c9be2e654556a9e803e4799"
server_key_version: "encryptionkey@0"
I20260807 22:40:25.262595 25582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance:
uuid: "344558a882f741f48656fcb72f690987"
format_stamp: "Formatted at 2026-08-07 22:40:25 on dist-test-slave-2d19"
server_key: "b1e7717b13991b7da70cf3b0ae49bdc9"
server_key_iv: "84c474392c9be2e654556a9e803e4799"
server_key_version: "encryptionkey@0"
I20260807 22:40:25.263878 25582 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 22:40:25.264643 25602 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:25.264853 25582 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260807 22:40:25.264987 25582 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-1/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-1/wal
uuid: "344558a882f741f48656fcb72f690987"
format_stamp: "Formatted at 2026-08-07 22:40:25 on dist-test-slave-2d19"
server_key: "b1e7717b13991b7da70cf3b0ae49bdc9"
server_key_iv: "84c474392c9be2e654556a9e803e4799"
server_key_version: "encryptionkey@0"
I20260807 22:40:25.265056 25582 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:25.286162 25582 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:25.288640 25582 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:25.288755 25582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:25.289263 25582 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:25.289342 25582 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:25.289388 25582 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:25.289409 25582 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 22:40:25 dist-test-slave-2d19 krb5kdc[25129](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142425, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:40:25.296487 25582 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.66:43029
I20260807 22:40:25.296583 25786 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.66:43029 every 8 connection(s)
I20260807 22:40:25.296881 25582 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
I20260807 22:40:25.297813 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 25582
I20260807 22:40:25.297905 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance
I20260807 22:40:25.298081 23377 external_mini_cluster.cc:1428] Setting key 9bcd5b5139b331578d26d99a846397e3
I20260807 22:40:25.300088 25284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.289922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:55041 (local address 127.22.212.126:36515)
0807 22:40:25.289999 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:25.290002 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:25.290157 (+ 155us) server_negotiation.cc:407] Connection header received
0807 22:40:25.290660 (+ 503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:25.290661 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:25.290677 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:25.290755 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:25.291645 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.292549 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.294131 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.294356 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.294439 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.296902 (+ 2463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:25.296903 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:25.296904 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:25.296913 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:25.298502 (+ 1589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:25.298970 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:25.298971 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:25.298971 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:25.299027 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:25.299311 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:25.299311 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:25.299311 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:25.299412 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:25.299548 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:25.299877 (+ 329us) server_negotiation.cc:299] Negotiation successful
0807 22:40:25.299997 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 22:40:25.300336 25614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.289839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:36515 (local address 127.22.212.66:55041)
0807 22:40:25.290025 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:25.290066 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:25.290561 (+ 495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:25.290845 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:25.290848 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:25.291225 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:25.291538 (+ 313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:25.291546 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.292682 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.292683 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:25.293998 (+ 1315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:25.294028 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.294452 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.294453 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:25.294592 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.295129 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:25.295150 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:25.296791 (+ 1641us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:25.298574 (+ 1783us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:25.298580 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:25.298582 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:25.298894 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:25.299099 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:25.299100 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:25.299100 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:25.299242 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:25.299546 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:25.299553 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:25.299727 (+ 174us) client_negotiation.cc:769] Sending connection context
0807 22:40:25.299843 (+ 116us) client_negotiation.cc:240] Negotiation successful
0807 22:40:25.300043 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":95,"threads_started":1}
I20260807 22:40:25.300845 25787 heartbeater.cc:347] Connected to a master server at 127.22.212.126:36515
I20260807 22:40:25.300941 25787 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:25.301139 25787 heartbeater.cc:511] Master 127.22.212.126:36515 requested a full tablet report, sending...
I20260807 22:40:25.301517 25210 ts_manager.cc:194] Registered new tserver with Master: 344558a882f741f48656fcb72f690987 (127.22.212.66:43029)
I20260807 22:40:25.301980 25210 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.66@KRBTEST.COM'} at 127.22.212.66:55041
WARNING: no policy specified for kudu/127.22.212.67@KRBTEST.COM; defaulting to no policy
I20260807 22:40:25.310129 25798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.301962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:36515 (local address 127.22.212.66:45899)
0807 22:40:25.303883 (+ 1921us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:25.303894 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:25.303957 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:25.304106 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:25.304107 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:25.304317 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:25.304378 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:25.304380 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.305365 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.305366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:25.305859 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:25.305861 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.306357 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.306357 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:25.306415 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.306876 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:25.306881 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:25.307190 (+ 309us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:25.308851 (+ 1661us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:25.308852 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:25.308852 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:25.309094 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:25.309340 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:25.309341 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:25.309342 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:25.309411 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:25.309753 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:25.309754 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:25.309805 (+ 51us) client_negotiation.cc:769] Sending connection context
0807 22:40:25.309897 (+ 92us) client_negotiation.cc:240] Negotiation successful
0807 22:40:25.310020 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1896,"thread_start_us":70,"threads_started":1}
I20260807 22:40:25.310124 25284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.301973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:45899 (local address 127.22.212.126:36515)
0807 22:40:25.302021 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:25.302023 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:25.303962 (+ 1939us) server_negotiation.cc:407] Connection header received
0807 22:40:25.304018 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:25.304019 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:25.304031 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:25.304090 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:25.304454 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.305258 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.305946 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.306271 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.306353 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.307284 (+ 931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:25.307285 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:25.307286 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:25.307293 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:25.308769 (+ 1476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:25.309189 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:25.309191 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:25.309191 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:25.309260 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:25.309488 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:25.309489 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:25.309489 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:25.309663 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:25.309749 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:25.309927 (+ 178us) server_negotiation.cc:299] Negotiation successful
0807 22:40:25.310019 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab.
Entry for principal kudu/127.22.212.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab.
I20260807 22:40:25.327646 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.67:0
--local_ip_for_outbound_sockets=127.22.212.67
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:36515
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:33481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:25.412065 25800 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:25.412349 25800 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:25.412400 25800 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:25.413602 25800 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:25.413645 25800 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:25.413666 25800 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 22:40:25.413719 25800 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.67
I20260807 22:40:25.415200 25800 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:33481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.212.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.22.212.126:36515
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25800
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.67
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:25.415442 25800 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:25.415685 25800 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:25.420827 25809 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:25.420858 25811 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:25.420814 25808 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:25.421160 25800 server_base.cc:1034] running on GCE node
I20260807 22:40:25.421402 25800 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:25.421705 25800 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:25.422948 25800 hybrid_clock.cc:648] HybridClock initialized: now 1786142425422933 us; error 51 us; skew 500 ppm
Aug 07 22:40:25 dist-test-slave-2d19 krb5kdc[25129](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142425, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:25.425724 25800 init.cc:377] Logged in from keytab as kudu/127.22.212.67@KRBTEST.COM (short username kudu)
I20260807 22:40:25.426231 25800 webserver.cc:460] Webserver started at http://127.22.212.67:36771/ using document root <none> and password file <none>
I20260807 22:40:25.426484 25800 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:25.426560 25800 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:25.426726 25800 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:25.427879 25800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-2/data/instance:
uuid: "9490a43b03674e01afb2b6c5da8a5718"
format_stamp: "Formatted at 2026-08-07 22:40:25 on dist-test-slave-2d19"
server_key: "87e757c32ce1b2c9a695d263e5351e49"
server_key_iv: "e88e0585a3a16aac45576967977d5a9e"
server_key_version: "encryptionkey@0"
I20260807 22:40:25.428357 25800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance:
uuid: "9490a43b03674e01afb2b6c5da8a5718"
format_stamp: "Formatted at 2026-08-07 22:40:25 on dist-test-slave-2d19"
server_key: "87e757c32ce1b2c9a695d263e5351e49"
server_key_iv: "e88e0585a3a16aac45576967977d5a9e"
server_key_version: "encryptionkey@0"
I20260807 22:40:25.429952 25800 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:40:25.430765 25823 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:25.430998 25800 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:40:25.431142 25800 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-2/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-2/wal
uuid: "9490a43b03674e01afb2b6c5da8a5718"
format_stamp: "Formatted at 2026-08-07 22:40:25 on dist-test-slave-2d19"
server_key: "87e757c32ce1b2c9a695d263e5351e49"
server_key_iv: "e88e0585a3a16aac45576967977d5a9e"
server_key_version: "encryptionkey@0"
I20260807 22:40:25.431233 25800 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:25.452235 25800 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:25.454402 25800 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:25.454582 25800 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:25.455143 25800 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:25.455215 25800 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:25.455267 25800 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:25.455303 25800 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 22:40:25 dist-test-slave-2d19 krb5kdc[25129](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142425, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:40:25.462900 25800 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.67:44413
I20260807 22:40:25.463276 26010 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.67:44413 every 8 connection(s)
I20260807 22:40:25.463357 25800 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
I20260807 22:40:25.465934 25284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.455685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:37393 (local address 127.22.212.126:36515)
0807 22:40:25.455760 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:25.455763 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:25.455923 (+ 160us) server_negotiation.cc:407] Connection header received
0807 22:40:25.456483 (+ 560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:25.456485 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:25.456501 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:25.456597 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:25.457457 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.458402 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.459974 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.460332 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.460433 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.463023 (+ 2590us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:25.463024 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:25.463024 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:25.463032 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:25.464637 (+ 1605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:25.465136 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:25.465137 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:25.465137 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:25.465189 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:25.465413 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:25.465414 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:25.465414 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:25.465517 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:25.465567 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:25.465810 (+ 243us) server_negotiation.cc:299] Negotiation successful
0807 22:40:25.465873 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 22:40:25.466204 25836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.455638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:36515 (local address 127.22.212.67:37393)
0807 22:40:25.455789 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:25.455831 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:25.456382 (+ 551us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:25.456658 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:25.456662 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:25.457055 (+ 393us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:25.457343 (+ 288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:25.457350 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.458507 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.458508 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:25.459878 (+ 1370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:25.459882 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.460461 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.460463 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:25.460607 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.461202 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:25.461210 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:25.462920 (+ 1710us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:25.464711 (+ 1791us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:25.464717 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:25.464719 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:25.465064 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:25.465252 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:25.465252 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:25.465253 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:25.465357 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:25.465576 (+ 219us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:25.465580 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:25.465694 (+ 114us) client_negotiation.cc:769] Sending connection context
0807 22:40:25.465783 (+ 89us) client_negotiation.cc:240] Negotiation successful
0807 22:40:25.465904 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":82,"threads_started":1}
I20260807 22:40:25.466741 26011 heartbeater.cc:347] Connected to a master server at 127.22.212.126:36515
I20260807 22:40:25.466848 26011 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:25.467036 26011 heartbeater.cc:511] Master 127.22.212.126:36515 requested a full tablet report, sending...
I20260807 22:40:25.467463 25210 ts_manager.cc:194] Registered new tserver with Master: 9490a43b03674e01afb2b6c5da8a5718 (127.22.212.67:44413)
I20260807 22:40:25.468053 25210 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.67@KRBTEST.COM'} at 127.22.212.67:37393
I20260807 22:40:25.473048 26024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.467823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:36515 (local address 127.22.212.67:41429)
0807 22:40:25.467966 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:25.467978 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:25.468044 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:25.468213 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:25.468214 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:25.468450 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:25.468499 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:25.468501 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.469256 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.469257 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:25.469802 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:25.469804 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.470091 (+ 287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.470092 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:25.470148 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.470624 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:25.470630 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:25.470922 (+ 292us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:25.472203 (+ 1281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:25.472204 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:25.472204 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:25.472441 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:25.472613 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:25.472614 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:25.472614 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:25.472663 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:25.472822 (+ 159us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:25.472823 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:25.472856 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 22:40:25.472909 (+ 53us) client_negotiation.cc:240] Negotiation successful
0807 22:40:25.472981 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":88,"threads_started":1}
I20260807 22:40:25.473083 25284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.467914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:41429 (local address 127.22.212.126:36515)
0807 22:40:25.467954 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:25.467956 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:25.468034 (+ 78us) server_negotiation.cc:407] Connection header received
0807 22:40:25.468104 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:25.468104 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:25.468112 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:25.468187 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:25.468581 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.469184 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.469873 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.470046 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.470094 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.470993 (+ 899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:25.470993 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:25.470993 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:25.470998 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:25.472130 (+ 1132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:25.472516 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:25.472517 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:25.472517 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:25.472568 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:25.472705 (+ 137us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:25.472705 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:25.472705 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:25.472786 (+ 81us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:25.472829 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:25.472925 (+ 96us) server_negotiation.cc:299] Negotiation successful
0807 22:40:25.472979 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 22:40:25.473548 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 25800
I20260807 22:40:25.473640 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance
I20260807 22:40:25.473819 23377 external_mini_cluster.cc:1428] Setting key adcd7de906cb98e38cbff849cf1f3463
I20260807 22:40:25.474784 23377 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 22:40:25 dist-test-slave-2d19 krb5kdc[25129](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142425, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 22:40:25 dist-test-slave-2d19 krb5kdc[25129](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142425, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:40:25.499202 25284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.492319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39924 (local address 127.22.212.126:36515)
0807 22:40:25.492380 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:25.492382 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:25.492393 (+ 11us) server_negotiation.cc:407] Connection header received
0807 22:40:25.492445 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:25.492447 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:25.492457 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:25.492539 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:25.493096 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.493586 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.494314 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.494513 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.494591 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.496837 (+ 2246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:25.496839 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:25.496840 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:25.496848 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:25.498064 (+ 1216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:25.498410 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:25.498412 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:25.498412 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:25.498473 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:25.498681 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:25.498682 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:25.498682 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:25.498792 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:25.498897 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:25.499022 (+ 125us) server_negotiation.cc:299] Negotiation successful
0807 22:40:25.499098 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260807 22:40:25.501052 25210 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39924:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:40:25.502744 25210 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:40:25.509553 26042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.505090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45840 (local address 127.22.212.67:44413)
0807 22:40:25.505601 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:25.505607 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:25.505617 (+ 10us) server_negotiation.cc:407] Connection header received
0807 22:40:25.505658 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:25.505660 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:25.505676 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:25.506000 (+ 324us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:25.506078 (+ 78us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.507190 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.508574 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.509114 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.509259 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.509333 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:25.509395 (+ 62us) server_negotiation.cc:299] Negotiation successful
0807 22:40:25.509440 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":470,"thread_start_us":93,"threads_started":1}
I20260807 22:40:25.509539 26040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.505066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:46215 (local address 127.0.0.1:49078)
0807 22:40:25.505428 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:25.505437 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:25.505476 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:25.505957 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:25.505958 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:25.505959 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:25.505998 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:25.506000 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.507337 (+ 1337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.507338 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:25.508301 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:25.508304 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.509194 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.509195 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:25.509293 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.509306 (+ 13us) client_negotiation.cc:769] Sending connection context
0807 22:40:25.509392 (+ 86us) client_negotiation.cc:240] Negotiation successful
0807 22:40:25.509439 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":87,"threads_started":1}
I20260807 22:40:25.509605 26039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.505045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.66:43029 (local address 127.0.0.1:57134)
0807 22:40:25.505309 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:25.505325 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:25.505373 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:25.505694 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:25.505697 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:25.505700 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:25.505766 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:25.505767 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.506818 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.506819 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:25.508114 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:25.508116 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.509200 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.509201 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:25.509291 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.509304 (+ 13us) client_negotiation.cc:769] Sending connection context
0807 22:40:25.509378 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 22:40:25.509447 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"mutex_wait_us":2,"thread_start_us":108,"threads_started":1}
I20260807 22:40:25.509675 26043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.505317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57134 (local address 127.22.212.66:43029)
0807 22:40:25.505505 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:25.505510 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:25.505527 (+ 17us) server_negotiation.cc:407] Connection header received
0807 22:40:25.505564 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:25.505565 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:25.505580 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:25.505678 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:25.505883 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.506720 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.508206 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.509020 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.509097 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.509160 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:25.509535 (+ 375us) server_negotiation.cc:299] Negotiation successful
0807 22:40:25.509575 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":90,"threads_started":1}
I20260807 22:40:25.509882 26045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.505541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49078 (local address 127.22.212.65:46215)
0807 22:40:25.505792 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:25.505796 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:25.505805 (+ 9us) server_negotiation.cc:407] Connection header received
0807 22:40:25.505842 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:25.505844 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:25.505859 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:25.506072 (+ 213us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:25.506136 (+ 64us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.507220 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.508397 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.509091 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.509157 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.509205 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:25.509696 (+ 491us) server_negotiation.cc:299] Negotiation successful
0807 22:40:25.509754 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220,"thread_start_us":100,"threads_started":1}
I20260807 22:40:25.509559 26041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.505011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.67:44413 (local address 127.0.0.1:45840)
0807 22:40:25.505206 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:25.505247 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:25.505318 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:25.505853 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:25.505854 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:25.505856 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:25.505917 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:25.505919 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.507297 (+ 1378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.507298 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:25.508480 (+ 1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:25.508482 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.509261 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.509261 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:25.509311 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.509314 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:40:25.509383 (+ 69us) client_negotiation.cc:240] Negotiation successful
0807 22:40:25.509447 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"mutex_wait_us":27,"thread_start_us":64,"threads_started":1}
I20260807 22:40:25.510360 25677 tablet_service.cc:1467] Processing CreateTablet for tablet 75299f2b68274fd9ad2fde0066a4762d (DEFAULT_TABLE table=test-table [id=9b036788c7d34be389fe8328edb1f7cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:25.510612 25444 tablet_service.cc:1467] Processing CreateTablet for tablet 75299f2b68274fd9ad2fde0066a4762d (DEFAULT_TABLE table=test-table [id=9b036788c7d34be389fe8328edb1f7cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:25.510782 25677 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75299f2b68274fd9ad2fde0066a4762d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:25.511030 25444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75299f2b68274fd9ad2fde0066a4762d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:25.511013 25908 tablet_service.cc:1467] Processing CreateTablet for tablet 75299f2b68274fd9ad2fde0066a4762d (DEFAULT_TABLE table=test-table [id=9b036788c7d34be389fe8328edb1f7cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:25.511334 25908 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75299f2b68274fd9ad2fde0066a4762d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:25.514241 26046 tablet_bootstrap.cc:492] T 75299f2b68274fd9ad2fde0066a4762d P 4d43fda9eb8345d48782cafe2fb787e4: Bootstrap starting.
I20260807 22:40:25.514675 26048 tablet_bootstrap.cc:492] T 75299f2b68274fd9ad2fde0066a4762d P 9490a43b03674e01afb2b6c5da8a5718: Bootstrap starting.
I20260807 22:40:25.515128 26046 tablet_bootstrap.cc:654] T 75299f2b68274fd9ad2fde0066a4762d P 4d43fda9eb8345d48782cafe2fb787e4: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:25.515540 26046 log.cc:824] T 75299f2b68274fd9ad2fde0066a4762d P 4d43fda9eb8345d48782cafe2fb787e4: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:25.515748 26048 tablet_bootstrap.cc:654] T 75299f2b68274fd9ad2fde0066a4762d P 9490a43b03674e01afb2b6c5da8a5718: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:25.515972 26047 tablet_bootstrap.cc:492] T 75299f2b68274fd9ad2fde0066a4762d P 344558a882f741f48656fcb72f690987: Bootstrap starting.
I20260807 22:40:25.516116 26048 log.cc:824] T 75299f2b68274fd9ad2fde0066a4762d P 9490a43b03674e01afb2b6c5da8a5718: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:25.516700 26047 tablet_bootstrap.cc:654] T 75299f2b68274fd9ad2fde0066a4762d P 344558a882f741f48656fcb72f690987: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:25.516937 26048 tablet_bootstrap.cc:492] T 75299f2b68274fd9ad2fde0066a4762d P 9490a43b03674e01afb2b6c5da8a5718: No bootstrap required, opened a new log
I20260807 22:40:25.517021 26048 ts_tablet_manager.cc:1397] T 75299f2b68274fd9ad2fde0066a4762d P 9490a43b03674e01afb2b6c5da8a5718: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 22:40:25.517520 26046 tablet_bootstrap.cc:492] T 75299f2b68274fd9ad2fde0066a4762d P 4d43fda9eb8345d48782cafe2fb787e4: No bootstrap required, opened a new log
I20260807 22:40:25.517602 26046 ts_tablet_manager.cc:1397] T 75299f2b68274fd9ad2fde0066a4762d P 4d43fda9eb8345d48782cafe2fb787e4: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 22:40:25.519250 26048 raft_consensus.cc:348] T 75299f2b68274fd9ad2fde0066a4762d P 9490a43b03674e01afb2b6c5da8a5718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9490a43b03674e01afb2b6c5da8a5718" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 44413 } } peers { permanent_uuid: "4d43fda9eb8345d48782cafe2fb787e4" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46215 } } peers { permanent_uuid: "344558a882f741f48656fcb72f690987" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 43029 } }
I20260807 22:40:25.519445 26048 raft_consensus.cc:374] T 75299f2b68274fd9ad2fde0066a4762d P 9490a43b03674e01afb2b6c5da8a5718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:25.519486 26048 raft_consensus.cc:729] T 75299f2b68274fd9ad2fde0066a4762d P 9490a43b03674e01afb2b6c5da8a5718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9490a43b03674e01afb2b6c5da8a5718, State: Initialized, Role: FOLLOWER
I20260807 22:40:25.519632 26048 consensus_queue.cc:260] T 75299f2b68274fd9ad2fde0066a4762d P 9490a43b03674e01afb2b6c5da8a5718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9490a43b03674e01afb2b6c5da8a5718" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 44413 } } peers { permanent_uuid: "4d43fda9eb8345d48782cafe2fb787e4" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46215 } } peers { permanent_uuid: "344558a882f741f48656fcb72f690987" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 43029 } }
I20260807 22:40:25.519739 26046 raft_consensus.cc:348] T 75299f2b68274fd9ad2fde0066a4762d P 4d43fda9eb8345d48782cafe2fb787e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9490a43b03674e01afb2b6c5da8a5718" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 44413 } } peers { permanent_uuid: "4d43fda9eb8345d48782cafe2fb787e4" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46215 } } peers { permanent_uuid: "344558a882f741f48656fcb72f690987" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 43029 } }
I20260807 22:40:25.519910 26046 raft_consensus.cc:374] T 75299f2b68274fd9ad2fde0066a4762d P 4d43fda9eb8345d48782cafe2fb787e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:25.519936 26048 ts_tablet_manager.cc:1428] T 75299f2b68274fd9ad2fde0066a4762d P 9490a43b03674e01afb2b6c5da8a5718: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 22:40:25.519960 26046 raft_consensus.cc:729] T 75299f2b68274fd9ad2fde0066a4762d P 4d43fda9eb8345d48782cafe2fb787e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43fda9eb8345d48782cafe2fb787e4, State: Initialized, Role: FOLLOWER
I20260807 22:40:25.519965 26011 heartbeater.cc:503] Master 127.22.212.126:36515 was elected leader, sending a full tablet report...
I20260807 22:40:25.520102 26046 consensus_queue.cc:260] T 75299f2b68274fd9ad2fde0066a4762d P 4d43fda9eb8345d48782cafe2fb787e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9490a43b03674e01afb2b6c5da8a5718" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 44413 } } peers { permanent_uuid: "4d43fda9eb8345d48782cafe2fb787e4" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46215 } } peers { permanent_uuid: "344558a882f741f48656fcb72f690987" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 43029 } }
I20260807 22:40:25.520444 26046 ts_tablet_manager.cc:1428] T 75299f2b68274fd9ad2fde0066a4762d P 4d43fda9eb8345d48782cafe2fb787e4: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260807 22:40:25.517069 26047 log.cc:824] T 75299f2b68274fd9ad2fde0066a4762d P 344558a882f741f48656fcb72f690987: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:25.520602 25568 heartbeater.cc:503] Master 127.22.212.126:36515 was elected leader, sending a full tablet report...
I20260807 22:40:25.521848 26047 tablet_bootstrap.cc:492] T 75299f2b68274fd9ad2fde0066a4762d P 344558a882f741f48656fcb72f690987: No bootstrap required, opened a new log
I20260807 22:40:25.521929 26047 ts_tablet_manager.cc:1397] T 75299f2b68274fd9ad2fde0066a4762d P 344558a882f741f48656fcb72f690987: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260807 22:40:25.523414 26047 raft_consensus.cc:348] T 75299f2b68274fd9ad2fde0066a4762d P 344558a882f741f48656fcb72f690987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9490a43b03674e01afb2b6c5da8a5718" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 44413 } } peers { permanent_uuid: "4d43fda9eb8345d48782cafe2fb787e4" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46215 } } peers { permanent_uuid: "344558a882f741f48656fcb72f690987" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 43029 } }
I20260807 22:40:25.523550 26047 raft_consensus.cc:374] T 75299f2b68274fd9ad2fde0066a4762d P 344558a882f741f48656fcb72f690987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:25.523576 26047 raft_consensus.cc:729] T 75299f2b68274fd9ad2fde0066a4762d P 344558a882f741f48656fcb72f690987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 344558a882f741f48656fcb72f690987, State: Initialized, Role: FOLLOWER
I20260807 22:40:25.523732 26047 consensus_queue.cc:260] T 75299f2b68274fd9ad2fde0066a4762d P 344558a882f741f48656fcb72f690987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9490a43b03674e01afb2b6c5da8a5718" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 44413 } } peers { permanent_uuid: "4d43fda9eb8345d48782cafe2fb787e4" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46215 } } peers { permanent_uuid: "344558a882f741f48656fcb72f690987" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 43029 } }
I20260807 22:40:25.524032 26047 ts_tablet_manager.cc:1428] T 75299f2b68274fd9ad2fde0066a4762d P 344558a882f741f48656fcb72f690987: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 22:40:25.524084 25787 heartbeater.cc:503] Master 127.22.212.126:36515 was elected leader, sending a full tablet report...
W20260807 22:40:25.547686 25789 tablet.cc:2369] T 75299f2b68274fd9ad2fde0066a4762d P 344558a882f741f48656fcb72f690987: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 22:40:25.617985 25570 tablet.cc:2369] T 75299f2b68274fd9ad2fde0066a4762d P 4d43fda9eb8345d48782cafe2fb787e4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:40:25.664613 26061 raft_consensus.cc:482] T 75299f2b68274fd9ad2fde0066a4762d P 344558a882f741f48656fcb72f690987 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:40:25.664749 26061 raft_consensus.cc:504] T 75299f2b68274fd9ad2fde0066a4762d P 344558a882f741f48656fcb72f690987 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9490a43b03674e01afb2b6c5da8a5718" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 44413 } } peers { permanent_uuid: "4d43fda9eb8345d48782cafe2fb787e4" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46215 } } peers { permanent_uuid: "344558a882f741f48656fcb72f690987" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 43029 } }
I20260807 22:40:25.665186 26061 leader_election.cc:288] T 75299f2b68274fd9ad2fde0066a4762d P 344558a882f741f48656fcb72f690987 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9490a43b03674e01afb2b6c5da8a5718 (127.22.212.67:44413), 4d43fda9eb8345d48782cafe2fb787e4 (127.22.212.65:46215)
I20260807 22:40:25.668536 26062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.665419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.67:44413 (local address 127.22.212.66:34155)
0807 22:40:25.665642 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:25.665649 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:25.665716 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:25.665866 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:25.665868 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:25.665882 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:25.665967 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:25.665969 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.666728 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.666729 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:25.667481 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:25.667483 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.668170 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.668171 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:25.668308 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.668313 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 22:40:25.668364 (+ 51us) client_negotiation.cc:240] Negotiation successful
0807 22:40:25.668411 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201,"mutex_wait_us":50,"thread_start_us":120,"threads_started":1}
I20260807 22:40:25.668731 26042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.665489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:34155 (local address 127.22.212.67:44413)
0807 22:40:25.665549 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:25.665551 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:25.665711 (+ 160us) server_negotiation.cc:407] Connection header received
0807 22:40:25.665780 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:25.665781 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:25.665791 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:25.665862 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:25.666095 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.666647 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.667601 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.668069 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.668170 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.668178 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:25.668595 (+ 417us) server_negotiation.cc:299] Negotiation successful
0807 22:40:25.668659 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260807 22:40:25.668817 25614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.665418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:46215 (local address 127.22.212.66:44717)
0807 22:40:25.665463 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:25.665475 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:25.665522 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:25.665746 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:25.665747 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:25.665749 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:25.665824 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:25.665826 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.666562 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.666563 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:25.667512 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:25.667514 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.668123 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.668125 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:25.668631 (+ 506us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.668635 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 22:40:25.668708 (+ 73us) client_negotiation.cc:240] Negotiation successful
0807 22:40:25.668755 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25,"mutex_wait_us":26}
I20260807 22:40:25.668843 26045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.665537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:44717 (local address 127.22.212.65:46215)
0807 22:40:25.665596 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:25.665597 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:25.665614 (+ 17us) server_negotiation.cc:407] Connection header received
0807 22:40:25.665642 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:25.665643 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:25.665650 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:25.665738 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:25.665905 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.666468 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.667608 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.668024 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.668136 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.668146 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:25.668724 (+ 578us) server_negotiation.cc:299] Negotiation successful
0807 22:40:25.668769 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 22:40:25.669265 25475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75299f2b68274fd9ad2fde0066a4762d" candidate_uuid: "344558a882f741f48656fcb72f690987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43fda9eb8345d48782cafe2fb787e4" is_pre_election: true
I20260807 22:40:25.669299 25912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75299f2b68274fd9ad2fde0066a4762d" candidate_uuid: "344558a882f741f48656fcb72f690987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9490a43b03674e01afb2b6c5da8a5718" is_pre_election: true
I20260807 22:40:25.669430 25475 raft_consensus.cc:2454] T 75299f2b68274fd9ad2fde0066a4762d P 4d43fda9eb8345d48782cafe2fb787e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 344558a882f741f48656fcb72f690987 in term 0.
I20260807 22:40:25.669445 25912 raft_consensus.cc:2454] T 75299f2b68274fd9ad2fde0066a4762d P 9490a43b03674e01afb2b6c5da8a5718 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 344558a882f741f48656fcb72f690987 in term 0.
I20260807 22:40:25.669689 25603 leader_election.cc:302] T 75299f2b68274fd9ad2fde0066a4762d P 344558a882f741f48656fcb72f690987 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 344558a882f741f48656fcb72f690987, 4d43fda9eb8345d48782cafe2fb787e4; no voters:
I20260807 22:40:25.669871 26061 raft_consensus.cc:2781] T 75299f2b68274fd9ad2fde0066a4762d P 344558a882f741f48656fcb72f690987 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:40:25.669914 26061 raft_consensus.cc:482] T 75299f2b68274fd9ad2fde0066a4762d P 344558a882f741f48656fcb72f690987 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:40:25.669929 26061 raft_consensus.cc:3037] T 75299f2b68274fd9ad2fde0066a4762d P 344558a882f741f48656fcb72f690987 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:25.670661 26061 raft_consensus.cc:504] T 75299f2b68274fd9ad2fde0066a4762d P 344558a882f741f48656fcb72f690987 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9490a43b03674e01afb2b6c5da8a5718" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 44413 } } peers { permanent_uuid: "4d43fda9eb8345d48782cafe2fb787e4" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46215 } } peers { permanent_uuid: "344558a882f741f48656fcb72f690987" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 43029 } }
I20260807 22:40:25.670804 26061 leader_election.cc:288] T 75299f2b68274fd9ad2fde0066a4762d P 344558a882f741f48656fcb72f690987 [CANDIDATE]: Term 1 election: Requested vote from peers 9490a43b03674e01afb2b6c5da8a5718 (127.22.212.67:44413), 4d43fda9eb8345d48782cafe2fb787e4 (127.22.212.65:46215)
I20260807 22:40:25.670951 25475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75299f2b68274fd9ad2fde0066a4762d" candidate_uuid: "344558a882f741f48656fcb72f690987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43fda9eb8345d48782cafe2fb787e4"
I20260807 22:40:25.671020 25912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75299f2b68274fd9ad2fde0066a4762d" candidate_uuid: "344558a882f741f48656fcb72f690987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9490a43b03674e01afb2b6c5da8a5718"
I20260807 22:40:25.671047 25475 raft_consensus.cc:3037] T 75299f2b68274fd9ad2fde0066a4762d P 4d43fda9eb8345d48782cafe2fb787e4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:25.671130 25912 raft_consensus.cc:3037] T 75299f2b68274fd9ad2fde0066a4762d P 9490a43b03674e01afb2b6c5da8a5718 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:25.671808 25475 raft_consensus.cc:2454] T 75299f2b68274fd9ad2fde0066a4762d P 4d43fda9eb8345d48782cafe2fb787e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 344558a882f741f48656fcb72f690987 in term 1.
I20260807 22:40:25.671857 25912 raft_consensus.cc:2454] T 75299f2b68274fd9ad2fde0066a4762d P 9490a43b03674e01afb2b6c5da8a5718 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 344558a882f741f48656fcb72f690987 in term 1.
I20260807 22:40:25.672024 25603 leader_election.cc:302] T 75299f2b68274fd9ad2fde0066a4762d P 344558a882f741f48656fcb72f690987 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 344558a882f741f48656fcb72f690987, 4d43fda9eb8345d48782cafe2fb787e4; no voters:
I20260807 22:40:25.672130 26061 raft_consensus.cc:2781] T 75299f2b68274fd9ad2fde0066a4762d P 344558a882f741f48656fcb72f690987 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:40:25.672307 26061 raft_consensus.cc:686] T 75299f2b68274fd9ad2fde0066a4762d P 344558a882f741f48656fcb72f690987 [term 1 LEADER]: Becoming Leader. State: Replica: 344558a882f741f48656fcb72f690987, State: Running, Role: LEADER
I20260807 22:40:25.672536 26061 consensus_queue.cc:237] T 75299f2b68274fd9ad2fde0066a4762d P 344558a882f741f48656fcb72f690987 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9490a43b03674e01afb2b6c5da8a5718" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 44413 } } peers { permanent_uuid: "4d43fda9eb8345d48782cafe2fb787e4" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46215 } } peers { permanent_uuid: "344558a882f741f48656fcb72f690987" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 43029 } }
I20260807 22:40:25.673448 25211 catalog_manager.cc:5495] T 75299f2b68274fd9ad2fde0066a4762d P 344558a882f741f48656fcb72f690987 reported cstate change: term changed from 0 to 1, leader changed from <none> to 344558a882f741f48656fcb72f690987 (127.22.212.66). New cstate: current_term: 1 leader_uuid: "344558a882f741f48656fcb72f690987" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9490a43b03674e01afb2b6c5da8a5718" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 44413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d43fda9eb8345d48782cafe2fb787e4" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "344558a882f741f48656fcb72f690987" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 43029 } health_report { overall_health: HEALTHY } } }
I20260807 22:40:25.694500 26043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.692098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57144 (local address 127.22.212.66:43029)
0807 22:40:25.692142 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:25.692144 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:25.692152 (+ 8us) server_negotiation.cc:407] Connection header received
0807 22:40:25.692243 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:25.692244 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:25.692306 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:25.692373 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:40:25.692520 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.692993 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.693748 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.693925 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.693973 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.694158 (+ 185us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:40:25.694252 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:40:25.694312 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:25.694356 (+ 44us) server_negotiation.cc:299] Negotiation successful
0807 22:40:25.694375 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 22:40:25.696447 25475 raft_consensus.cc:1261] T 75299f2b68274fd9ad2fde0066a4762d P 4d43fda9eb8345d48782cafe2fb787e4 [term 1 FOLLOWER]: Refusing update from remote peer 344558a882f741f48656fcb72f690987: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:40:25.696448 25912 raft_consensus.cc:1261] T 75299f2b68274fd9ad2fde0066a4762d P 9490a43b03674e01afb2b6c5da8a5718 [term 1 FOLLOWER]: Refusing update from remote peer 344558a882f741f48656fcb72f690987: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:40:25.696812 26061 consensus_queue.cc:1035] T 75299f2b68274fd9ad2fde0066a4762d P 344558a882f741f48656fcb72f690987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d43fda9eb8345d48782cafe2fb787e4" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:40:25.696952 26067 consensus_queue.cc:1035] T 75299f2b68274fd9ad2fde0066a4762d P 344558a882f741f48656fcb72f690987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9490a43b03674e01afb2b6c5da8a5718" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:40:25.699285 26074 mvcc.cc:205] Tried to move back new op lower bound from 7316039375649619968 to 7316039375555293184. Current Snapshot: MvccSnapshot[applied={T|T < 7316039375649619968}]
I20260807 22:40:25.703080 25211 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39924:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:40:25.703189 25211 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39924:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:40:25.703951 25211 catalog_manager.cc:5782] T 00000000000000000000000000000000 P df88778dec9d42229715fd36cd58bf1f: Sending DeleteTablet for 3 replicas of tablet 75299f2b68274fd9ad2fde0066a4762d
I20260807 22:40:25.704299 25908 tablet_service.cc:1514] Processing DeleteTablet for tablet 75299f2b68274fd9ad2fde0066a4762d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:25 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:45840
I20260807 22:40:25.704335 25444 tablet_service.cc:1514] Processing DeleteTablet for tablet 75299f2b68274fd9ad2fde0066a4762d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:25 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:49078
I20260807 22:40:25.704460 25677 tablet_service.cc:1514] Processing DeleteTablet for tablet 75299f2b68274fd9ad2fde0066a4762d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:25 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:57134
I20260807 22:40:25.704567 26088 tablet_replica.cc:330] T 75299f2b68274fd9ad2fde0066a4762d P 4d43fda9eb8345d48782cafe2fb787e4: stopping tablet replica
I20260807 22:40:25.704669 26088 raft_consensus.cc:2229] T 75299f2b68274fd9ad2fde0066a4762d P 4d43fda9eb8345d48782cafe2fb787e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:40:25.704677 26091 tablet_replica.cc:330] T 75299f2b68274fd9ad2fde0066a4762d P 344558a882f741f48656fcb72f690987: stopping tablet replica
I20260807 22:40:25.704759 26091 raft_consensus.cc:2229] T 75299f2b68274fd9ad2fde0066a4762d P 344558a882f741f48656fcb72f690987 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:40:25.704813 26088 raft_consensus.cc:2258] T 75299f2b68274fd9ad2fde0066a4762d P 4d43fda9eb8345d48782cafe2fb787e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:25.704897 26091 raft_consensus.cc:2258] T 75299f2b68274fd9ad2fde0066a4762d P 344558a882f741f48656fcb72f690987 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:25.705108 25211 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39924:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:40:25.705262 25211 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:40:25.705320 26088 ts_tablet_manager.cc:1905] T 75299f2b68274fd9ad2fde0066a4762d P 4d43fda9eb8345d48782cafe2fb787e4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:25.705463 26091 ts_tablet_manager.cc:1905] T 75299f2b68274fd9ad2fde0066a4762d P 344558a882f741f48656fcb72f690987: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:25.706892 25908 tablet_service.cc:1467] Processing CreateTablet for tablet aa61bf028c534694947ca9b339fbd25f (DEFAULT_TABLE table=test-table [id=d6d5bb4940d84c55a741f1e89ad83d0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:25.707033 25908 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa61bf028c534694947ca9b339fbd25f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:25.707166 26089 tablet_replica.cc:330] T 75299f2b68274fd9ad2fde0066a4762d P 9490a43b03674e01afb2b6c5da8a5718: stopping tablet replica
I20260807 22:40:25.707237 26091 ts_tablet_manager.cc:1918] T 75299f2b68274fd9ad2fde0066a4762d P 344558a882f741f48656fcb72f690987: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:40:25.707278 26089 raft_consensus.cc:2229] T 75299f2b68274fd9ad2fde0066a4762d P 9490a43b03674e01afb2b6c5da8a5718 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:40:25.707297 26091 log.cc:1196] T 75299f2b68274fd9ad2fde0066a4762d P 344558a882f741f48656fcb72f690987: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-1/wal/wals/75299f2b68274fd9ad2fde0066a4762d
I20260807 22:40:25.707391 26089 raft_consensus.cc:2258] T 75299f2b68274fd9ad2fde0066a4762d P 9490a43b03674e01afb2b6c5da8a5718 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:25.707583 26091 ts_tablet_manager.cc:1939] T 75299f2b68274fd9ad2fde0066a4762d P 344558a882f741f48656fcb72f690987: Deleting consensus metadata
I20260807 22:40:25.707890 26089 ts_tablet_manager.cc:1905] T 75299f2b68274fd9ad2fde0066a4762d P 9490a43b03674e01afb2b6c5da8a5718: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:25.708105 26088 ts_tablet_manager.cc:1918] T 75299f2b68274fd9ad2fde0066a4762d P 4d43fda9eb8345d48782cafe2fb787e4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:40:25.708169 26088 log.cc:1196] T 75299f2b68274fd9ad2fde0066a4762d P 4d43fda9eb8345d48782cafe2fb787e4: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-0/wal/wals/75299f2b68274fd9ad2fde0066a4762d
I20260807 22:40:25.708463 26088 ts_tablet_manager.cc:1939] T 75299f2b68274fd9ad2fde0066a4762d P 4d43fda9eb8345d48782cafe2fb787e4: Deleting consensus metadata
I20260807 22:40:25.709029 26048 tablet_bootstrap.cc:492] T aa61bf028c534694947ca9b339fbd25f P 9490a43b03674e01afb2b6c5da8a5718: Bootstrap starting.
I20260807 22:40:25.709307 25182 catalog_manager.cc:4841] TS 344558a882f741f48656fcb72f690987 (127.22.212.66:43029): tablet 75299f2b68274fd9ad2fde0066a4762d (table test-table [id=9b036788c7d34be389fe8328edb1f7cd]) successfully deleted
I20260807 22:40:25.709446 26089 ts_tablet_manager.cc:1918] T 75299f2b68274fd9ad2fde0066a4762d P 9490a43b03674e01afb2b6c5da8a5718: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:40:25.709476 25181 catalog_manager.cc:4841] TS 4d43fda9eb8345d48782cafe2fb787e4 (127.22.212.65:46215): tablet 75299f2b68274fd9ad2fde0066a4762d (table test-table [id=9b036788c7d34be389fe8328edb1f7cd]) successfully deleted
I20260807 22:40:25.709576 26089 log.cc:1196] T 75299f2b68274fd9ad2fde0066a4762d P 9490a43b03674e01afb2b6c5da8a5718: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-2/wal/wals/75299f2b68274fd9ad2fde0066a4762d
I20260807 22:40:25.709649 25677 tablet_service.cc:1467] Processing CreateTablet for tablet aa61bf028c534694947ca9b339fbd25f (DEFAULT_TABLE table=test-table [id=d6d5bb4940d84c55a741f1e89ad83d0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:25.709754 25677 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa61bf028c534694947ca9b339fbd25f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:25.709856 26089 ts_tablet_manager.cc:1939] T 75299f2b68274fd9ad2fde0066a4762d P 9490a43b03674e01afb2b6c5da8a5718: Deleting consensus metadata
I20260807 22:40:25.710255 25183 catalog_manager.cc:4841] TS 9490a43b03674e01afb2b6c5da8a5718 (127.22.212.67:44413): tablet 75299f2b68274fd9ad2fde0066a4762d (table test-table [id=9b036788c7d34be389fe8328edb1f7cd]) successfully deleted
I20260807 22:40:25.710829 26047 tablet_bootstrap.cc:492] T aa61bf028c534694947ca9b339fbd25f P 344558a882f741f48656fcb72f690987: Bootstrap starting.
I20260807 22:40:25.710930 25444 tablet_service.cc:1467] Processing CreateTablet for tablet aa61bf028c534694947ca9b339fbd25f (DEFAULT_TABLE table=test-table [id=d6d5bb4940d84c55a741f1e89ad83d0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:25.711036 25444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa61bf028c534694947ca9b339fbd25f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:25.711246 26047 tablet_bootstrap.cc:654] T aa61bf028c534694947ca9b339fbd25f P 344558a882f741f48656fcb72f690987: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:25.711947 26047 tablet_bootstrap.cc:492] T aa61bf028c534694947ca9b339fbd25f P 344558a882f741f48656fcb72f690987: No bootstrap required, opened a new log
I20260807 22:40:25.711992 26047 ts_tablet_manager.cc:1397] T aa61bf028c534694947ca9b339fbd25f P 344558a882f741f48656fcb72f690987: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 22:40:25.712172 26046 tablet_bootstrap.cc:492] T aa61bf028c534694947ca9b339fbd25f P 4d43fda9eb8345d48782cafe2fb787e4: Bootstrap starting.
I20260807 22:40:25.712163 26047 raft_consensus.cc:348] T aa61bf028c534694947ca9b339fbd25f P 344558a882f741f48656fcb72f690987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43fda9eb8345d48782cafe2fb787e4" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46215 } } peers { permanent_uuid: "344558a882f741f48656fcb72f690987" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 43029 } } peers { permanent_uuid: "9490a43b03674e01afb2b6c5da8a5718" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 44413 } }
I20260807 22:40:25.712275 26047 raft_consensus.cc:374] T aa61bf028c534694947ca9b339fbd25f P 344558a882f741f48656fcb72f690987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:25.712306 26047 raft_consensus.cc:729] T aa61bf028c534694947ca9b339fbd25f P 344558a882f741f48656fcb72f690987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 344558a882f741f48656fcb72f690987, State: Initialized, Role: FOLLOWER
I20260807 22:40:25.709481 26048 tablet_bootstrap.cc:654] T aa61bf028c534694947ca9b339fbd25f P 9490a43b03674e01afb2b6c5da8a5718: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:25.712345 26047 consensus_queue.cc:260] T aa61bf028c534694947ca9b339fbd25f P 344558a882f741f48656fcb72f690987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43fda9eb8345d48782cafe2fb787e4" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46215 } } peers { permanent_uuid: "344558a882f741f48656fcb72f690987" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 43029 } } peers { permanent_uuid: "9490a43b03674e01afb2b6c5da8a5718" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 44413 } }
I20260807 22:40:25.712435 26047 ts_tablet_manager.cc:1428] T aa61bf028c534694947ca9b339fbd25f P 344558a882f741f48656fcb72f690987: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260807 22:40:25.712596 26046 tablet_bootstrap.cc:654] T aa61bf028c534694947ca9b339fbd25f P 4d43fda9eb8345d48782cafe2fb787e4: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:25.713157 26048 tablet_bootstrap.cc:492] T aa61bf028c534694947ca9b339fbd25f P 9490a43b03674e01afb2b6c5da8a5718: No bootstrap required, opened a new log
I20260807 22:40:25.713167 26046 tablet_bootstrap.cc:492] T aa61bf028c534694947ca9b339fbd25f P 4d43fda9eb8345d48782cafe2fb787e4: No bootstrap required, opened a new log
I20260807 22:40:25.713223 26046 ts_tablet_manager.cc:1397] T aa61bf028c534694947ca9b339fbd25f P 4d43fda9eb8345d48782cafe2fb787e4: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 22:40:25.713227 26048 ts_tablet_manager.cc:1397] T aa61bf028c534694947ca9b339fbd25f P 9490a43b03674e01afb2b6c5da8a5718: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260807 22:40:25.713383 26048 raft_consensus.cc:348] T aa61bf028c534694947ca9b339fbd25f P 9490a43b03674e01afb2b6c5da8a5718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43fda9eb8345d48782cafe2fb787e4" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46215 } } peers { permanent_uuid: "344558a882f741f48656fcb72f690987" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 43029 } } peers { permanent_uuid: "9490a43b03674e01afb2b6c5da8a5718" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 44413 } }
I20260807 22:40:25.713397 26046 raft_consensus.cc:348] T aa61bf028c534694947ca9b339fbd25f P 4d43fda9eb8345d48782cafe2fb787e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43fda9eb8345d48782cafe2fb787e4" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46215 } } peers { permanent_uuid: "344558a882f741f48656fcb72f690987" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 43029 } } peers { permanent_uuid: "9490a43b03674e01afb2b6c5da8a5718" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 44413 } }
I20260807 22:40:25.713464 26048 raft_consensus.cc:374] T aa61bf028c534694947ca9b339fbd25f P 9490a43b03674e01afb2b6c5da8a5718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:25.713474 26046 raft_consensus.cc:374] T aa61bf028c534694947ca9b339fbd25f P 4d43fda9eb8345d48782cafe2fb787e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:25.713496 26048 raft_consensus.cc:729] T aa61bf028c534694947ca9b339fbd25f P 9490a43b03674e01afb2b6c5da8a5718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9490a43b03674e01afb2b6c5da8a5718, State: Initialized, Role: FOLLOWER
I20260807 22:40:25.713515 26046 raft_consensus.cc:729] T aa61bf028c534694947ca9b339fbd25f P 4d43fda9eb8345d48782cafe2fb787e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43fda9eb8345d48782cafe2fb787e4, State: Initialized, Role: FOLLOWER
I20260807 22:40:25.713548 26048 consensus_queue.cc:260] T aa61bf028c534694947ca9b339fbd25f P 9490a43b03674e01afb2b6c5da8a5718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43fda9eb8345d48782cafe2fb787e4" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46215 } } peers { permanent_uuid: "344558a882f741f48656fcb72f690987" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 43029 } } peers { permanent_uuid: "9490a43b03674e01afb2b6c5da8a5718" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 44413 } }
I20260807 22:40:25.713560 26046 consensus_queue.cc:260] T aa61bf028c534694947ca9b339fbd25f P 4d43fda9eb8345d48782cafe2fb787e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43fda9eb8345d48782cafe2fb787e4" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46215 } } peers { permanent_uuid: "344558a882f741f48656fcb72f690987" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 43029 } } peers { permanent_uuid: "9490a43b03674e01afb2b6c5da8a5718" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 44413 } }
I20260807 22:40:25.713650 26048 ts_tablet_manager.cc:1428] T aa61bf028c534694947ca9b339fbd25f P 9490a43b03674e01afb2b6c5da8a5718: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:25.713877 26046 ts_tablet_manager.cc:1428] T aa61bf028c534694947ca9b339fbd25f P 4d43fda9eb8345d48782cafe2fb787e4: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
W20260807 22:40:25.714143 26017 tablet.cc:2369] T aa61bf028c534694947ca9b339fbd25f P 9490a43b03674e01afb2b6c5da8a5718: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:40:25.870572 26086 raft_consensus.cc:482] T aa61bf028c534694947ca9b339fbd25f P 344558a882f741f48656fcb72f690987 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:40:25.870689 26086 raft_consensus.cc:504] T aa61bf028c534694947ca9b339fbd25f P 344558a882f741f48656fcb72f690987 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43fda9eb8345d48782cafe2fb787e4" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46215 } } peers { permanent_uuid: "344558a882f741f48656fcb72f690987" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 43029 } } peers { permanent_uuid: "9490a43b03674e01afb2b6c5da8a5718" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 44413 } }
I20260807 22:40:25.870903 26086 leader_election.cc:288] T aa61bf028c534694947ca9b339fbd25f P 344558a882f741f48656fcb72f690987 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d43fda9eb8345d48782cafe2fb787e4 (127.22.212.65:46215), 9490a43b03674e01afb2b6c5da8a5718 (127.22.212.67:44413)
I20260807 22:40:25.871170 25475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa61bf028c534694947ca9b339fbd25f" candidate_uuid: "344558a882f741f48656fcb72f690987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43fda9eb8345d48782cafe2fb787e4" is_pre_election: true
I20260807 22:40:25.871170 25912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa61bf028c534694947ca9b339fbd25f" candidate_uuid: "344558a882f741f48656fcb72f690987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9490a43b03674e01afb2b6c5da8a5718" is_pre_election: true
I20260807 22:40:25.871289 25912 raft_consensus.cc:2454] T aa61bf028c534694947ca9b339fbd25f P 9490a43b03674e01afb2b6c5da8a5718 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 344558a882f741f48656fcb72f690987 in term 0.
I20260807 22:40:25.871289 25475 raft_consensus.cc:2454] T aa61bf028c534694947ca9b339fbd25f P 4d43fda9eb8345d48782cafe2fb787e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 344558a882f741f48656fcb72f690987 in term 0.
I20260807 22:40:25.871462 25605 leader_election.cc:302] T aa61bf028c534694947ca9b339fbd25f P 344558a882f741f48656fcb72f690987 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 344558a882f741f48656fcb72f690987, 9490a43b03674e01afb2b6c5da8a5718; no voters:
I20260807 22:40:25.871604 26086 raft_consensus.cc:2781] T aa61bf028c534694947ca9b339fbd25f P 344558a882f741f48656fcb72f690987 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:40:25.871663 26086 raft_consensus.cc:482] T aa61bf028c534694947ca9b339fbd25f P 344558a882f741f48656fcb72f690987 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:40:25.871690 26086 raft_consensus.cc:3037] T aa61bf028c534694947ca9b339fbd25f P 344558a882f741f48656fcb72f690987 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:25.872493 26086 raft_consensus.cc:504] T aa61bf028c534694947ca9b339fbd25f P 344558a882f741f48656fcb72f690987 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43fda9eb8345d48782cafe2fb787e4" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46215 } } peers { permanent_uuid: "344558a882f741f48656fcb72f690987" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 43029 } } peers { permanent_uuid: "9490a43b03674e01afb2b6c5da8a5718" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 44413 } }
I20260807 22:40:25.872661 26086 leader_election.cc:288] T aa61bf028c534694947ca9b339fbd25f P 344558a882f741f48656fcb72f690987 [CANDIDATE]: Term 1 election: Requested vote from peers 4d43fda9eb8345d48782cafe2fb787e4 (127.22.212.65:46215), 9490a43b03674e01afb2b6c5da8a5718 (127.22.212.67:44413)
I20260807 22:40:25.872845 25912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa61bf028c534694947ca9b339fbd25f" candidate_uuid: "344558a882f741f48656fcb72f690987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9490a43b03674e01afb2b6c5da8a5718"
I20260807 22:40:25.872874 25475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa61bf028c534694947ca9b339fbd25f" candidate_uuid: "344558a882f741f48656fcb72f690987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43fda9eb8345d48782cafe2fb787e4"
I20260807 22:40:25.872941 25475 raft_consensus.cc:3037] T aa61bf028c534694947ca9b339fbd25f P 4d43fda9eb8345d48782cafe2fb787e4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:25.872943 25912 raft_consensus.cc:3037] T aa61bf028c534694947ca9b339fbd25f P 9490a43b03674e01afb2b6c5da8a5718 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:25.873603 25475 raft_consensus.cc:2454] T aa61bf028c534694947ca9b339fbd25f P 4d43fda9eb8345d48782cafe2fb787e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 344558a882f741f48656fcb72f690987 in term 1.
I20260807 22:40:25.873718 25912 raft_consensus.cc:2454] T aa61bf028c534694947ca9b339fbd25f P 9490a43b03674e01afb2b6c5da8a5718 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 344558a882f741f48656fcb72f690987 in term 1.
I20260807 22:40:25.873782 25603 leader_election.cc:302] T aa61bf028c534694947ca9b339fbd25f P 344558a882f741f48656fcb72f690987 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 344558a882f741f48656fcb72f690987, 4d43fda9eb8345d48782cafe2fb787e4; no voters:
I20260807 22:40:25.873875 26086 raft_consensus.cc:2781] T aa61bf028c534694947ca9b339fbd25f P 344558a882f741f48656fcb72f690987 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:40:25.873943 26086 raft_consensus.cc:686] T aa61bf028c534694947ca9b339fbd25f P 344558a882f741f48656fcb72f690987 [term 1 LEADER]: Becoming Leader. State: Replica: 344558a882f741f48656fcb72f690987, State: Running, Role: LEADER
I20260807 22:40:25.874023 26086 consensus_queue.cc:237] T aa61bf028c534694947ca9b339fbd25f P 344558a882f741f48656fcb72f690987 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43fda9eb8345d48782cafe2fb787e4" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46215 } } peers { permanent_uuid: "344558a882f741f48656fcb72f690987" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 43029 } } peers { permanent_uuid: "9490a43b03674e01afb2b6c5da8a5718" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 44413 } }
I20260807 22:40:25.874641 25206 catalog_manager.cc:5495] T aa61bf028c534694947ca9b339fbd25f P 344558a882f741f48656fcb72f690987 reported cstate change: term changed from 0 to 1, leader changed from <none> to 344558a882f741f48656fcb72f690987 (127.22.212.66). New cstate: current_term: 1 leader_uuid: "344558a882f741f48656fcb72f690987" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43fda9eb8345d48782cafe2fb787e4" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "344558a882f741f48656fcb72f690987" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 43029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9490a43b03674e01afb2b6c5da8a5718" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 44413 } health_report { overall_health: UNKNOWN } } }
Aug 07 22:40:25 dist-test-slave-2d19 krb5kdc[25129](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142424, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:40:25.928175 25284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.921171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39928 (local address 127.22.212.126:36515)
0807 22:40:25.921240 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:25.921242 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:25.921377 (+ 135us) server_negotiation.cc:407] Connection header received
0807 22:40:25.921456 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:25.921457 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:25.921468 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:25.921539 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:25.922057 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.922543 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.923243 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.923432 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.923516 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.925774 (+ 2258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:25.925775 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:25.925776 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:25.925782 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:25.926930 (+ 1148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:25.927312 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:25.927313 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:25.927313 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:25.927370 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:25.927575 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:25.927576 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:25.927577 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:25.927684 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:25.927755 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:25.927923 (+ 168us) server_negotiation.cc:299] Negotiation successful
0807 22:40:25.928093 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":92,"server-negotiator.queue_time_us":24}
I20260807 22:40:25.928175 26114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:25.921024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:36515 (local address 127.0.0.1:39928)
0807 22:40:25.921284 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:25.921295 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:25.921399 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:25.921547 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:25.921548 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:25.921888 (+ 340us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:25.921936 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:25.921939 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.922626 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.922628 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:25.923155 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:25.923157 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:25.923523 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:25.923525 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:25.923587 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:25.924139 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:25.924144 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:25.925679 (+ 1535us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:25.927023 (+ 1344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:25.927032 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:25.927036 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:25.927236 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:25.927444 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:25.927444 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:25.927445 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:25.927506 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:25.927760 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:25.927768 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:25.927812 (+ 44us) client_negotiation.cc:769] Sending connection context
0807 22:40:25.927888 (+ 76us) client_negotiation.cc:240] Negotiation successful
0807 22:40:25.928029 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"mutex_wait_us":5,"thread_start_us":178,"threads_started":1}
I20260807 22:40:25.930411 25206 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:39928:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 22:40:25.930698 25206 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:40:25.932354 25444 tablet_service.cc:1467] Processing CreateTablet for tablet 4602f481b5dc4c64a1643d3a4c1561c5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5864d60fdca6483ea34c5fa7f0f7f9b5]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 22:40:25.932343 25908 tablet_service.cc:1467] Processing CreateTablet for tablet 4602f481b5dc4c64a1643d3a4c1561c5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5864d60fdca6483ea34c5fa7f0f7f9b5]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 22:40:25.932385 25677 tablet_service.cc:1467] Processing CreateTablet for tablet 4602f481b5dc4c64a1643d3a4c1561c5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5864d60fdca6483ea34c5fa7f0f7f9b5]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 22:40:25.932538 25677 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4602f481b5dc4c64a1643d3a4c1561c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:25.932538 25908 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4602f481b5dc4c64a1643d3a4c1561c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:25.932544 25444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4602f481b5dc4c64a1643d3a4c1561c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:25.933833 26046 tablet_bootstrap.cc:492] T 4602f481b5dc4c64a1643d3a4c1561c5 P 4d43fda9eb8345d48782cafe2fb787e4: Bootstrap starting.
I20260807 22:40:25.934037 26047 tablet_bootstrap.cc:492] T 4602f481b5dc4c64a1643d3a4c1561c5 P 344558a882f741f48656fcb72f690987: Bootstrap starting.
I20260807 22:40:25.934052 26048 tablet_bootstrap.cc:492] T 4602f481b5dc4c64a1643d3a4c1561c5 P 9490a43b03674e01afb2b6c5da8a5718: Bootstrap starting.
I20260807 22:40:25.934346 26046 tablet_bootstrap.cc:654] T 4602f481b5dc4c64a1643d3a4c1561c5 P 4d43fda9eb8345d48782cafe2fb787e4: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:25.934358 26047 tablet_bootstrap.cc:654] T 4602f481b5dc4c64a1643d3a4c1561c5 P 344558a882f741f48656fcb72f690987: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:25.934541 26048 tablet_bootstrap.cc:654] T 4602f481b5dc4c64a1643d3a4c1561c5 P 9490a43b03674e01afb2b6c5da8a5718: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:25.935019 26047 tablet_bootstrap.cc:492] T 4602f481b5dc4c64a1643d3a4c1561c5 P 344558a882f741f48656fcb72f690987: No bootstrap required, opened a new log
I20260807 22:40:25.935038 26046 tablet_bootstrap.cc:492] T 4602f481b5dc4c64a1643d3a4c1561c5 P 4d43fda9eb8345d48782cafe2fb787e4: No bootstrap required, opened a new log
I20260807 22:40:25.935062 26047 ts_tablet_manager.cc:1397] T 4602f481b5dc4c64a1643d3a4c1561c5 P 344558a882f741f48656fcb72f690987: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 22:40:25.935087 26046 ts_tablet_manager.cc:1397] T 4602f481b5dc4c64a1643d3a4c1561c5 P 4d43fda9eb8345d48782cafe2fb787e4: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 22:40:25.935210 26047 raft_consensus.cc:348] T 4602f481b5dc4c64a1643d3a4c1561c5 P 344558a882f741f48656fcb72f690987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43fda9eb8345d48782cafe2fb787e4" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46215 } } peers { permanent_uuid: "344558a882f741f48656fcb72f690987" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 43029 } } peers { permanent_uuid: "9490a43b03674e01afb2b6c5da8a5718" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 44413 } }
I20260807 22:40:25.935277 26047 raft_consensus.cc:374] T 4602f481b5dc4c64a1643d3a4c1561c5 P 344558a882f741f48656fcb72f690987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:25.935292 26047 raft_consensus.cc:729] T 4602f481b5dc4c64a1643d3a4c1561c5 P 344558a882f741f48656fcb72f690987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 344558a882f741f48656fcb72f690987, State: Initialized, Role: FOLLOWER
I20260807 22:40:25.935230 26046 raft_consensus.cc:348] T 4602f481b5dc4c64a1643d3a4c1561c5 P 4d43fda9eb8345d48782cafe2fb787e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43fda9eb8345d48782cafe2fb787e4" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46215 } } peers { permanent_uuid: "344558a882f741f48656fcb72f690987" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 43029 } } peers { permanent_uuid: "9490a43b03674e01afb2b6c5da8a5718" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 44413 } }
I20260807 22:40:25.935324 26046 raft_consensus.cc:374] T 4602f481b5dc4c64a1643d3a4c1561c5 P 4d43fda9eb8345d48782cafe2fb787e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:25.935357 26046 raft_consensus.cc:729] T 4602f481b5dc4c64a1643d3a4c1561c5 P 4d43fda9eb8345d48782cafe2fb787e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d43fda9eb8345d48782cafe2fb787e4, State: Initialized, Role: FOLLOWER
I20260807 22:40:25.935345 26047 consensus_queue.cc:260] T 4602f481b5dc4c64a1643d3a4c1561c5 P 344558a882f741f48656fcb72f690987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43fda9eb8345d48782cafe2fb787e4" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46215 } } peers { permanent_uuid: "344558a882f741f48656fcb72f690987" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 43029 } } peers { permanent_uuid: "9490a43b03674e01afb2b6c5da8a5718" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 44413 } }
I20260807 22:40:25.935410 26046 consensus_queue.cc:260] T 4602f481b5dc4c64a1643d3a4c1561c5 P 4d43fda9eb8345d48782cafe2fb787e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43fda9eb8345d48782cafe2fb787e4" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46215 } } peers { permanent_uuid: "344558a882f741f48656fcb72f690987" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 43029 } } peers { permanent_uuid: "9490a43b03674e01afb2b6c5da8a5718" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 44413 } }
I20260807 22:40:25.935431 26047 ts_tablet_manager.cc:1428] T 4602f481b5dc4c64a1643d3a4c1561c5 P 344558a882f741f48656fcb72f690987: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260807 22:40:25.935500 26046 ts_tablet_manager.cc:1428] T 4602f481b5dc4c64a1643d3a4c1561c5 P 4d43fda9eb8345d48782cafe2fb787e4: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:25.935539 26086 tablet_replica.cc:439] T 4602f481b5dc4c64a1643d3a4c1561c5 P 344558a882f741f48656fcb72f690987: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43fda9eb8345d48782cafe2fb787e4" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46215 } } peers { permanent_uuid: "344558a882f741f48656fcb72f690987" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 43029 } } peers { permanent_uuid: "9490a43b03674e01afb2b6c5da8a5718" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 44413 } } }
I20260807 22:40:25.935613 26086 tablet_replica.cc:442] T 4602f481b5dc4c64a1643d3a4c1561c5 P 344558a882f741f48656fcb72f690987: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:40:25.935752 26048 tablet_bootstrap.cc:492] T 4602f481b5dc4c64a1643d3a4c1561c5 P 9490a43b03674e01afb2b6c5da8a5718: No bootstrap required, opened a new log
I20260807 22:40:25.935814 26048 ts_tablet_manager.cc:1397] T 4602f481b5dc4c64a1643d3a4c1561c5 P 9490a43b03674e01afb2b6c5da8a5718: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 22:40:25.935757 26058 tablet_replica.cc:439] T 4602f481b5dc4c64a1643d3a4c1561c5 P 4d43fda9eb8345d48782cafe2fb787e4: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43fda9eb8345d48782cafe2fb787e4" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46215 } } peers { permanent_uuid: "344558a882f741f48656fcb72f690987" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 43029 } } peers { permanent_uuid: "9490a43b03674e01afb2b6c5da8a5718" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 44413 } } }
I20260807 22:40:25.935854 26058 tablet_replica.cc:442] T 4602f481b5dc4c64a1643d3a4c1561c5 P 4d43fda9eb8345d48782cafe2fb787e4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:40:25.935986 26048 raft_consensus.cc:348] T 4602f481b5dc4c64a1643d3a4c1561c5 P 9490a43b03674e01afb2b6c5da8a5718 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43fda9eb8345d48782cafe2fb787e4" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46215 } } peers { permanent_uuid: "344558a882f741f48656fcb72f690987" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 43029 } } peers { permanent_uuid: "9490a43b03674e01afb2b6c5da8a5718" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 44413 } }
I20260807 22:40:25.936077 26048 raft_consensus.cc:374] T 4602f481b5dc4c64a1643d3a4c1561c5 P 9490a43b03674e01afb2b6c5da8a5718 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:25.936105 26048 raft_consensus.cc:729] T 4602f481b5dc4c64a1643d3a4c1561c5 P 9490a43b03674e01afb2b6c5da8a5718 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9490a43b03674e01afb2b6c5da8a5718, State: Initialized, Role: FOLLOWER
I20260807 22:40:25.936144 26048 consensus_queue.cc:260] T 4602f481b5dc4c64a1643d3a4c1561c5 P 9490a43b03674e01afb2b6c5da8a5718 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43fda9eb8345d48782cafe2fb787e4" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46215 } } peers { permanent_uuid: "344558a882f741f48656fcb72f690987" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 43029 } } peers { permanent_uuid: "9490a43b03674e01afb2b6c5da8a5718" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 44413 } }
I20260807 22:40:25.936240 26048 ts_tablet_manager.cc:1428] T 4602f481b5dc4c64a1643d3a4c1561c5 P 9490a43b03674e01afb2b6c5da8a5718: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260807 22:40:25.936345 26057 tablet_replica.cc:439] T 4602f481b5dc4c64a1643d3a4c1561c5 P 9490a43b03674e01afb2b6c5da8a5718: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43fda9eb8345d48782cafe2fb787e4" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46215 } } peers { permanent_uuid: "344558a882f741f48656fcb72f690987" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 43029 } } peers { permanent_uuid: "9490a43b03674e01afb2b6c5da8a5718" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 44413 } } }
I20260807 22:40:25.936431 26057 tablet_replica.cc:442] T 4602f481b5dc4c64a1643d3a4c1561c5 P 9490a43b03674e01afb2b6c5da8a5718: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:40:26.195379 26086 raft_consensus.cc:482] T 4602f481b5dc4c64a1643d3a4c1561c5 P 344558a882f741f48656fcb72f690987 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:40:26.195525 26086 raft_consensus.cc:504] T 4602f481b5dc4c64a1643d3a4c1561c5 P 344558a882f741f48656fcb72f690987 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43fda9eb8345d48782cafe2fb787e4" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46215 } } peers { permanent_uuid: "344558a882f741f48656fcb72f690987" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 43029 } } peers { permanent_uuid: "9490a43b03674e01afb2b6c5da8a5718" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 44413 } }
I20260807 22:40:26.195741 26086 leader_election.cc:288] T 4602f481b5dc4c64a1643d3a4c1561c5 P 344558a882f741f48656fcb72f690987 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d43fda9eb8345d48782cafe2fb787e4 (127.22.212.65:46215), 9490a43b03674e01afb2b6c5da8a5718 (127.22.212.67:44413)
I20260807 22:40:26.196012 25912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4602f481b5dc4c64a1643d3a4c1561c5" candidate_uuid: "344558a882f741f48656fcb72f690987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9490a43b03674e01afb2b6c5da8a5718" is_pre_election: true
I20260807 22:40:26.196074 25475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4602f481b5dc4c64a1643d3a4c1561c5" candidate_uuid: "344558a882f741f48656fcb72f690987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43fda9eb8345d48782cafe2fb787e4" is_pre_election: true
I20260807 22:40:26.196149 25912 raft_consensus.cc:2454] T 4602f481b5dc4c64a1643d3a4c1561c5 P 9490a43b03674e01afb2b6c5da8a5718 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 344558a882f741f48656fcb72f690987 in term 0.
I20260807 22:40:26.196189 25475 raft_consensus.cc:2454] T 4602f481b5dc4c64a1643d3a4c1561c5 P 4d43fda9eb8345d48782cafe2fb787e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 344558a882f741f48656fcb72f690987 in term 0.
I20260807 22:40:26.196377 25605 leader_election.cc:302] T 4602f481b5dc4c64a1643d3a4c1561c5 P 344558a882f741f48656fcb72f690987 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 344558a882f741f48656fcb72f690987, 4d43fda9eb8345d48782cafe2fb787e4, 9490a43b03674e01afb2b6c5da8a5718; no voters:
I20260807 22:40:26.196494 26086 raft_consensus.cc:2781] T 4602f481b5dc4c64a1643d3a4c1561c5 P 344558a882f741f48656fcb72f690987 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:40:26.196569 26086 raft_consensus.cc:482] T 4602f481b5dc4c64a1643d3a4c1561c5 P 344558a882f741f48656fcb72f690987 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:40:26.196602 26086 raft_consensus.cc:3037] T 4602f481b5dc4c64a1643d3a4c1561c5 P 344558a882f741f48656fcb72f690987 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:26.197301 26086 raft_consensus.cc:504] T 4602f481b5dc4c64a1643d3a4c1561c5 P 344558a882f741f48656fcb72f690987 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43fda9eb8345d48782cafe2fb787e4" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46215 } } peers { permanent_uuid: "344558a882f741f48656fcb72f690987" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 43029 } } peers { permanent_uuid: "9490a43b03674e01afb2b6c5da8a5718" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 44413 } }
I20260807 22:40:26.197476 26086 leader_election.cc:288] T 4602f481b5dc4c64a1643d3a4c1561c5 P 344558a882f741f48656fcb72f690987 [CANDIDATE]: Term 1 election: Requested vote from peers 4d43fda9eb8345d48782cafe2fb787e4 (127.22.212.65:46215), 9490a43b03674e01afb2b6c5da8a5718 (127.22.212.67:44413)
I20260807 22:40:26.197630 25912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4602f481b5dc4c64a1643d3a4c1561c5" candidate_uuid: "344558a882f741f48656fcb72f690987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9490a43b03674e01afb2b6c5da8a5718"
I20260807 22:40:26.197646 25475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4602f481b5dc4c64a1643d3a4c1561c5" candidate_uuid: "344558a882f741f48656fcb72f690987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d43fda9eb8345d48782cafe2fb787e4"
I20260807 22:40:26.197728 25475 raft_consensus.cc:3037] T 4602f481b5dc4c64a1643d3a4c1561c5 P 4d43fda9eb8345d48782cafe2fb787e4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:26.197731 25912 raft_consensus.cc:3037] T 4602f481b5dc4c64a1643d3a4c1561c5 P 9490a43b03674e01afb2b6c5da8a5718 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:26.198365 25475 raft_consensus.cc:2454] T 4602f481b5dc4c64a1643d3a4c1561c5 P 4d43fda9eb8345d48782cafe2fb787e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 344558a882f741f48656fcb72f690987 in term 1.
I20260807 22:40:26.198374 25912 raft_consensus.cc:2454] T 4602f481b5dc4c64a1643d3a4c1561c5 P 9490a43b03674e01afb2b6c5da8a5718 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 344558a882f741f48656fcb72f690987 in term 1.
I20260807 22:40:26.198570 25603 leader_election.cc:302] T 4602f481b5dc4c64a1643d3a4c1561c5 P 344558a882f741f48656fcb72f690987 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 344558a882f741f48656fcb72f690987, 4d43fda9eb8345d48782cafe2fb787e4; no voters:
I20260807 22:40:26.198724 26086 raft_consensus.cc:2781] T 4602f481b5dc4c64a1643d3a4c1561c5 P 344558a882f741f48656fcb72f690987 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:40:26.198778 26086 raft_consensus.cc:686] T 4602f481b5dc4c64a1643d3a4c1561c5 P 344558a882f741f48656fcb72f690987 [term 1 LEADER]: Becoming Leader. State: Replica: 344558a882f741f48656fcb72f690987, State: Running, Role: LEADER
I20260807 22:40:26.198849 26086 consensus_queue.cc:237] T 4602f481b5dc4c64a1643d3a4c1561c5 P 344558a882f741f48656fcb72f690987 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43fda9eb8345d48782cafe2fb787e4" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46215 } } peers { permanent_uuid: "344558a882f741f48656fcb72f690987" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 43029 } } peers { permanent_uuid: "9490a43b03674e01afb2b6c5da8a5718" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 44413 } }
I20260807 22:40:26.199175 26061 tablet_replica.cc:439] T 4602f481b5dc4c64a1643d3a4c1561c5 P 344558a882f741f48656fcb72f690987: TxnStatusTablet state changed. Reason: New leader 344558a882f741f48656fcb72f690987. Latest consensus state: current_term: 1 leader_uuid: "344558a882f741f48656fcb72f690987" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43fda9eb8345d48782cafe2fb787e4" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46215 } } peers { permanent_uuid: "344558a882f741f48656fcb72f690987" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 43029 } } peers { permanent_uuid: "9490a43b03674e01afb2b6c5da8a5718" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 44413 } } }
I20260807 22:40:26.199255 26061 tablet_replica.cc:442] T 4602f481b5dc4c64a1643d3a4c1561c5 P 344558a882f741f48656fcb72f690987: This TxnStatusTablet replica's current role is: LEADER
I20260807 22:40:26.199498 26120 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 22:40:26.199644 26120 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 22:40:26.199806 25206 catalog_manager.cc:5495] T 4602f481b5dc4c64a1643d3a4c1561c5 P 344558a882f741f48656fcb72f690987 reported cstate change: term changed from 0 to 1, leader changed from <none> to 344558a882f741f48656fcb72f690987 (127.22.212.66). New cstate: current_term: 1 leader_uuid: "344558a882f741f48656fcb72f690987" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43fda9eb8345d48782cafe2fb787e4" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "344558a882f741f48656fcb72f690987" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 43029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9490a43b03674e01afb2b6c5da8a5718" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260807 22:40:26.220135 26128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:26.217741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57160 (local address 127.22.212.66:43029)
0807 22:40:26.217864 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:26.217867 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:26.217875 (+ 8us) server_negotiation.cc:407] Connection header received
0807 22:40:26.217917 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:26.217917 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:26.217933 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:26.218003 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:40:26.218149 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:26.218627 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:26.219395 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:26.219599 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:26.219678 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:26.219847 (+ 169us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:40:26.219892 (+ 45us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:40:26.219956 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:26.220024 (+ 68us) server_negotiation.cc:299] Negotiation successful
0807 22:40:26.220048 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":57,"threads_started":1}
I20260807 22:40:26.220136 26114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:26.217564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.66:43029 (local address 127.0.0.1:57160)
0807 22:40:26.217750 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:26.217767 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:26.217835 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:26.218014 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:26.218015 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:26.218017 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 22:40:26.218075 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:26.218077 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:26.218715 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:26.218716 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:26.219302 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:26.219304 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:26.219677 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:26.219678 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:26.219736 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:26.219762 (+ 26us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 22:40:26.219958 (+ 196us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 22:40:26.219968 (+ 10us) client_negotiation.cc:769] Sending connection context
0807 22:40:26.220015 (+ 47us) client_negotiation.cc:240] Negotiation successful
0807 22:40:26.220068 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139}
I20260807 22:40:26.221455 25475 raft_consensus.cc:1261] T 4602f481b5dc4c64a1643d3a4c1561c5 P 4d43fda9eb8345d48782cafe2fb787e4 [term 1 FOLLOWER]: Refusing update from remote peer 344558a882f741f48656fcb72f690987: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:40:26.221654 25912 raft_consensus.cc:1261] T 4602f481b5dc4c64a1643d3a4c1561c5 P 9490a43b03674e01afb2b6c5da8a5718 [term 1 FOLLOWER]: Refusing update from remote peer 344558a882f741f48656fcb72f690987: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:40:26.221693 26086 consensus_queue.cc:1035] T 4602f481b5dc4c64a1643d3a4c1561c5 P 344558a882f741f48656fcb72f690987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d43fda9eb8345d48782cafe2fb787e4" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:40:26.221894 26086 consensus_queue.cc:1035] T 4602f481b5dc4c64a1643d3a4c1561c5 P 344558a882f741f48656fcb72f690987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9490a43b03674e01afb2b6c5da8a5718" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:40:26.222344 26058 tablet_replica.cc:439] T 4602f481b5dc4c64a1643d3a4c1561c5 P 4d43fda9eb8345d48782cafe2fb787e4: TxnStatusTablet state changed. Reason: New leader 344558a882f741f48656fcb72f690987. Latest consensus state: current_term: 1 leader_uuid: "344558a882f741f48656fcb72f690987" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43fda9eb8345d48782cafe2fb787e4" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46215 } } peers { permanent_uuid: "344558a882f741f48656fcb72f690987" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 43029 } } peers { permanent_uuid: "9490a43b03674e01afb2b6c5da8a5718" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 44413 } } }
I20260807 22:40:26.222361 26057 tablet_replica.cc:439] T 4602f481b5dc4c64a1643d3a4c1561c5 P 9490a43b03674e01afb2b6c5da8a5718: TxnStatusTablet state changed. Reason: New leader 344558a882f741f48656fcb72f690987. Latest consensus state: current_term: 1 leader_uuid: "344558a882f741f48656fcb72f690987" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43fda9eb8345d48782cafe2fb787e4" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46215 } } peers { permanent_uuid: "344558a882f741f48656fcb72f690987" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 43029 } } peers { permanent_uuid: "9490a43b03674e01afb2b6c5da8a5718" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 44413 } } }
I20260807 22:40:26.222453 26058 tablet_replica.cc:442] T 4602f481b5dc4c64a1643d3a4c1561c5 P 4d43fda9eb8345d48782cafe2fb787e4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:40:26.222461 26057 tablet_replica.cc:442] T 4602f481b5dc4c64a1643d3a4c1561c5 P 9490a43b03674e01afb2b6c5da8a5718: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:40:26.223397 26061 tablet_replica.cc:439] T 4602f481b5dc4c64a1643d3a4c1561c5 P 344558a882f741f48656fcb72f690987: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "344558a882f741f48656fcb72f690987" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43fda9eb8345d48782cafe2fb787e4" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46215 } } peers { permanent_uuid: "344558a882f741f48656fcb72f690987" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 43029 } } peers { permanent_uuid: "9490a43b03674e01afb2b6c5da8a5718" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 44413 } } }
I20260807 22:40:26.223484 26061 tablet_replica.cc:442] T 4602f481b5dc4c64a1643d3a4c1561c5 P 344558a882f741f48656fcb72f690987: This TxnStatusTablet replica's current role is: LEADER
I20260807 22:40:26.223547 26061 tablet_replica.cc:439] T 4602f481b5dc4c64a1643d3a4c1561c5 P 344558a882f741f48656fcb72f690987: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "344558a882f741f48656fcb72f690987" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43fda9eb8345d48782cafe2fb787e4" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46215 } } peers { permanent_uuid: "344558a882f741f48656fcb72f690987" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 43029 } } peers { permanent_uuid: "9490a43b03674e01afb2b6c5da8a5718" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 44413 } } }
I20260807 22:40:26.223594 26061 tablet_replica.cc:442] T 4602f481b5dc4c64a1643d3a4c1561c5 P 344558a882f741f48656fcb72f690987: This TxnStatusTablet replica's current role is: LEADER
I20260807 22:40:26.223552 26058 tablet_replica.cc:439] T 4602f481b5dc4c64a1643d3a4c1561c5 P 4d43fda9eb8345d48782cafe2fb787e4: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "344558a882f741f48656fcb72f690987" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43fda9eb8345d48782cafe2fb787e4" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46215 } } peers { permanent_uuid: "344558a882f741f48656fcb72f690987" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 43029 } } peers { permanent_uuid: "9490a43b03674e01afb2b6c5da8a5718" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 44413 } } }
I20260807 22:40:26.223635 26058 tablet_replica.cc:442] T 4602f481b5dc4c64a1643d3a4c1561c5 P 4d43fda9eb8345d48782cafe2fb787e4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:40:26.223838 26057 tablet_replica.cc:439] T 4602f481b5dc4c64a1643d3a4c1561c5 P 9490a43b03674e01afb2b6c5da8a5718: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "344558a882f741f48656fcb72f690987" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d43fda9eb8345d48782cafe2fb787e4" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46215 } } peers { permanent_uuid: "344558a882f741f48656fcb72f690987" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 43029 } } peers { permanent_uuid: "9490a43b03674e01afb2b6c5da8a5718" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 44413 } } }
I20260807 22:40:26.223919 26057 tablet_replica.cc:442] T 4602f481b5dc4c64a1643d3a4c1561c5 P 9490a43b03674e01afb2b6c5da8a5718: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:40:26.224049 26129 mvcc.cc:205] Tried to move back new op lower bound from 7316039377801043968 to 7316039377710661632. Current Snapshot: MvccSnapshot[applied={T|T < 7316039377801043968}]
I20260807 22:40:26.228464 26131 mvcc.cc:205] Tried to move back new op lower bound from 7316039377801043968 to 7316039377710661632. Current Snapshot: MvccSnapshot[applied={T|T < 7316039377801043968}]
I20260807 22:40:26.231402 26128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:26.228674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:36505 (local address 127.22.212.66:43029)
0807 22:40:26.228713 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:26.228715 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:26.228893 (+ 178us) server_negotiation.cc:407] Connection header received
0807 22:40:26.228954 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:26.228954 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:26.228962 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:26.229008 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:40:26.229119 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:26.229581 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:26.230695 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:26.230881 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:26.230931 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:26.231142 (+ 211us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:40:26.231168 (+ 26us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:40:26.231210 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:26.231291 (+ 81us) server_negotiation.cc:299] Negotiation successful
0807 22:40:26.231329 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":20}
I20260807 22:40:26.231510 26144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:26.228480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.66:43029 (local address 127.22.212.66:36505)
0807 22:40:26.228813 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:26.228825 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:26.228894 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:26.229013 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:26.229014 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:26.229015 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 22:40:26.229065 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:26.229066 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:26.229654 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:26.229655 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:26.230590 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:26.230594 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:26.230972 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:26.230973 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:26.231033 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:26.231053 (+ 20us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 22:40:26.231230 (+ 177us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 22:40:26.231232 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 22:40:26.231287 (+ 55us) client_negotiation.cc:240] Negotiation successful
0807 22:40:26.231361 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"mutex_wait_us":20,"thread_start_us":106,"threads_started":1}
I20260807 22:40:26.234205 25912 raft_consensus.cc:1261] T aa61bf028c534694947ca9b339fbd25f P 9490a43b03674e01afb2b6c5da8a5718 [term 1 FOLLOWER]: Refusing update from remote peer 344558a882f741f48656fcb72f690987: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:40:26.234249 25475 raft_consensus.cc:1261] T aa61bf028c534694947ca9b339fbd25f P 4d43fda9eb8345d48782cafe2fb787e4 [term 1 FOLLOWER]: Refusing update from remote peer 344558a882f741f48656fcb72f690987: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:40:26.234441 26061 consensus_queue.cc:1035] T aa61bf028c534694947ca9b339fbd25f P 344558a882f741f48656fcb72f690987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9490a43b03674e01afb2b6c5da8a5718" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:40:26.234578 26061 consensus_queue.cc:1035] T aa61bf028c534694947ca9b339fbd25f P 344558a882f741f48656fcb72f690987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d43fda9eb8345d48782cafe2fb787e4" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:40:26.247082 25210 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39924:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:40:26.247189 25210 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39924:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:40:26.247839 25210 catalog_manager.cc:5782] T 00000000000000000000000000000000 P df88778dec9d42229715fd36cd58bf1f: Sending DeleteTablet for 3 replicas of tablet aa61bf028c534694947ca9b339fbd25f
I20260807 22:40:26.248083 25444 tablet_service.cc:1514] Processing DeleteTablet for tablet aa61bf028c534694947ca9b339fbd25f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:26 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:49078
I20260807 22:40:26.248143 25908 tablet_service.cc:1514] Processing DeleteTablet for tablet aa61bf028c534694947ca9b339fbd25f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:26 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:45840
I20260807 22:40:26.248201 25677 tablet_service.cc:1514] Processing DeleteTablet for tablet aa61bf028c534694947ca9b339fbd25f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:26 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:57134
I20260807 22:40:26.248389 26166 tablet_replica.cc:330] T aa61bf028c534694947ca9b339fbd25f P 9490a43b03674e01afb2b6c5da8a5718: stopping tablet replica
I20260807 22:40:26.248451 26166 raft_consensus.cc:2229] T aa61bf028c534694947ca9b339fbd25f P 9490a43b03674e01afb2b6c5da8a5718 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:40:26.248482 26166 raft_consensus.cc:2258] T aa61bf028c534694947ca9b339fbd25f P 9490a43b03674e01afb2b6c5da8a5718 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:26.248745 26166 ts_tablet_manager.cc:1905] T aa61bf028c534694947ca9b339fbd25f P 9490a43b03674e01afb2b6c5da8a5718: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:26.249096 26167 tablet_replica.cc:330] T aa61bf028c534694947ca9b339fbd25f P 344558a882f741f48656fcb72f690987: stopping tablet replica
I20260807 22:40:26.249198 26167 raft_consensus.cc:2229] T aa61bf028c534694947ca9b339fbd25f P 344558a882f741f48656fcb72f690987 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:40:26.249310 26167 raft_consensus.cc:2258] T aa61bf028c534694947ca9b339fbd25f P 344558a882f741f48656fcb72f690987 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:26.249614 26167 ts_tablet_manager.cc:1905] T aa61bf028c534694947ca9b339fbd25f P 344558a882f741f48656fcb72f690987: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:26.250854 26166 ts_tablet_manager.cc:1918] T aa61bf028c534694947ca9b339fbd25f P 9490a43b03674e01afb2b6c5da8a5718: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 22:40:26.250921 26166 log.cc:1196] T aa61bf028c534694947ca9b339fbd25f P 9490a43b03674e01afb2b6c5da8a5718: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-2/wal/wals/aa61bf028c534694947ca9b339fbd25f
I20260807 22:40:26.251150 26166 ts_tablet_manager.cc:1939] T aa61bf028c534694947ca9b339fbd25f P 9490a43b03674e01afb2b6c5da8a5718: Deleting consensus metadata
I20260807 22:40:26.251482 25183 catalog_manager.cc:4841] TS 9490a43b03674e01afb2b6c5da8a5718 (127.22.212.67:44413): tablet aa61bf028c534694947ca9b339fbd25f (table test-table [id=d6d5bb4940d84c55a741f1e89ad83d0f]) successfully deleted
I20260807 22:40:26.251541 26167 ts_tablet_manager.cc:1918] T aa61bf028c534694947ca9b339fbd25f P 344558a882f741f48656fcb72f690987: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 22:40:26.251684 26167 log.cc:1196] T aa61bf028c534694947ca9b339fbd25f P 344558a882f741f48656fcb72f690987: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-1/wal/wals/aa61bf028c534694947ca9b339fbd25f
I20260807 22:40:26.251953 26167 ts_tablet_manager.cc:1939] T aa61bf028c534694947ca9b339fbd25f P 344558a882f741f48656fcb72f690987: Deleting consensus metadata
I20260807 22:40:26.252311 25182 catalog_manager.cc:4841] TS 344558a882f741f48656fcb72f690987 (127.22.212.66:43029): tablet aa61bf028c534694947ca9b339fbd25f (table test-table [id=d6d5bb4940d84c55a741f1e89ad83d0f]) successfully deleted
Aug 07 22:40:26 dist-test-slave-2d19 krb5kdc[25129](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142425, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.22.212.65@KRBTEST.COM
I20260807 22:40:26.256405 26161 tablet_replica.cc:330] T aa61bf028c534694947ca9b339fbd25f P 4d43fda9eb8345d48782cafe2fb787e4: stopping tablet replica
I20260807 22:40:26.256500 26161 raft_consensus.cc:2229] T aa61bf028c534694947ca9b339fbd25f P 4d43fda9eb8345d48782cafe2fb787e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:40:26.256546 26161 raft_consensus.cc:2258] T aa61bf028c534694947ca9b339fbd25f P 4d43fda9eb8345d48782cafe2fb787e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:26.256832 26161 ts_tablet_manager.cc:1905] T aa61bf028c534694947ca9b339fbd25f P 4d43fda9eb8345d48782cafe2fb787e4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:26.258366 26161 ts_tablet_manager.cc:1918] T aa61bf028c534694947ca9b339fbd25f P 4d43fda9eb8345d48782cafe2fb787e4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 22:40:26.258481 26161 log.cc:1196] T aa61bf028c534694947ca9b339fbd25f P 4d43fda9eb8345d48782cafe2fb787e4: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786142418640232-23377-0/minicluster-data/ts-0/wal/wals/aa61bf028c534694947ca9b339fbd25f
I20260807 22:40:26.258800 26161 ts_tablet_manager.cc:1939] T aa61bf028c534694947ca9b339fbd25f P 4d43fda9eb8345d48782cafe2fb787e4: Deleting consensus metadata
I20260807 22:40:26.259169 25181 catalog_manager.cc:4841] TS 4d43fda9eb8345d48782cafe2fb787e4 (127.22.212.65:46215): tablet aa61bf028c534694947ca9b339fbd25f (table test-table [id=d6d5bb4940d84c55a741f1e89ad83d0f]) successfully deleted
I20260807 22:40:26.260679 26173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:26.249128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49094 (local address 127.22.212.65:46215)
0807 22:40:26.249415 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:26.249418 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:26.249576 (+ 158us) server_negotiation.cc:407] Connection header received
0807 22:40:26.249602 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:26.249602 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:26.249615 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:26.249673 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:26.250434 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:26.251285 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:26.252297 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:26.252630 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:26.252709 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:26.255503 (+ 2794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:26.255517 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:26.255517 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:26.255525 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:26.259133 (+ 3608us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:26.259620 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:26.259624 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:26.259625 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:26.259714 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:26.260019 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:26.260020 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:26.260021 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:26.260203 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:26.260390 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:26.260469 (+ 79us) server_negotiation.cc:299] Negotiation successful
0807 22:40:26.260558 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":259,"thread_start_us":77,"threads_started":1}
W20260807 22:40:26.261055 25560 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49094
I20260807 22:40:26.269004 25284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:26.262082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56582 (local address 127.22.212.126:36515)
0807 22:40:26.262135 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:26.262137 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:26.262263 (+ 126us) server_negotiation.cc:407] Connection header received
0807 22:40:26.262363 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:26.262364 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:26.262375 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:26.262423 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:26.263055 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:26.263540 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:26.264633 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:26.264820 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:26.264876 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:26.266265 (+ 1389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:26.266266 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:26.266266 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:26.266273 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:26.267885 (+ 1612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:26.268291 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:26.268292 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:26.268292 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:26.268351 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:26.268574 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:26.268576 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:26.268576 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:26.268691 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:26.268764 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:26.268884 (+ 120us) server_negotiation.cc:299] Negotiation successful
0807 22:40:26.268940 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
W20260807 22:40:26.269376 25210 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56582
I20260807 22:40:26.269958 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 25324
I20260807 22:40:26.284552 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 25582
I20260807 22:40:26.292971 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 25800
I20260807 22:40:26.303138 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 25148
2026-08-07T22:40:26Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2974 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:40:26 dist-test-slave-2d19 krb5kdc[26184](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:40:26 dist-test-slave-2d19 krb5kdc[26184](info): set up 2 sockets
Aug 07 22:40:26 dist-test-slave-2d19 krb5kdc[26184](info): commencing operation
krb5kdc: starting...
W20260807 22:40:27.560359 23377 mini_kdc.cc:121] Time spent starting KDC: real 1.230s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Aug 07 22:40:27 dist-test-slave-2d19 krb5kdc[26184](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142427, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:40:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:40:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.212.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
I20260807 22:40:27.687428 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:39363
--webserver_interface=127.22.212.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:43489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:39363
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:27.770762 26211 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:27.771013 26211 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:27.771047 26211 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:27.772698 26211 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:40:27.772770 26211 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 22:40:27.772799 26211 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:27.772833 26211 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:27.772861 26211 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:40:27.772893 26211 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:40:27.774501 26211 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:43489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:39363
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:39363
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26211
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:27.774791 26211 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:27.775081 26211 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 22:40:27.780288 26211 server_base.cc:1034] running on GCE node
W20260807 22:40:27.780242 26224 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:27.780270 26226 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:27.780270 26222 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:27.780719 26211 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:27.781018 26211 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:27.782183 26211 hybrid_clock.cc:648] HybridClock initialized: now 1786142427782170 us; error 43 us; skew 500 ppm
Aug 07 22:40:27 dist-test-slave-2d19 krb5kdc[26184](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142427, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:27.784653 26211 init.cc:377] Logged in from keytab as kudu/127.22.212.126@KRBTEST.COM (short username kudu)
I20260807 22:40:27.785115 26211 webserver.cc:460] Webserver started at http://127.22.212.126:41707/ using document root <none> and password file <none>
I20260807 22:40:27.785362 26211 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:27.785409 26211 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:27.785584 26211 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:27.786648 26211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "024906e65af04e2cbec41a8143b2af24"
format_stamp: "Formatted at 2026-08-07 22:40:27 on dist-test-slave-2d19"
server_key: "cc79ca78eb78ac1229b7a45bdaffadb8"
server_key_iv: "e63a694cd61bcad98e45e1cb903b4ce5"
server_key_version: "encryptionkey@0"
I20260807 22:40:27.787034 26211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "024906e65af04e2cbec41a8143b2af24"
format_stamp: "Formatted at 2026-08-07 22:40:27 on dist-test-slave-2d19"
server_key: "cc79ca78eb78ac1229b7a45bdaffadb8"
server_key_iv: "e63a694cd61bcad98e45e1cb903b4ce5"
server_key_version: "encryptionkey@0"
I20260807 22:40:27.788427 26211 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 22:40:27.789183 26239 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:27.789371 26211 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 22:40:27.789461 26211 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "024906e65af04e2cbec41a8143b2af24"
format_stamp: "Formatted at 2026-08-07 22:40:27 on dist-test-slave-2d19"
server_key: "cc79ca78eb78ac1229b7a45bdaffadb8"
server_key_iv: "e63a694cd61bcad98e45e1cb903b4ce5"
server_key_version: "encryptionkey@0"
I20260807 22:40:27.789522 26211 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:27.801903 26211 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:27.804107 26211 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:27.804219 26211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:27.808821 26211 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:39363
I20260807 22:40:27.808986 26348 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:39363 every 8 connection(s)
I20260807 22:40:27.809266 26211 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:40:27.810009 26350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:27.812398 26350 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 024906e65af04e2cbec41a8143b2af24: Bootstrap starting.
I20260807 22:40:27.812872 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 26211
I20260807 22:40:27.812973 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:40:27.813122 26350 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 024906e65af04e2cbec41a8143b2af24: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:27.813153 23377 external_mini_cluster.cc:1428] Setting key e653e052c1528638039d8e71f0d58792
I20260807 22:40:27.813472 26350 log.cc:824] T 00000000000000000000000000000000 P 024906e65af04e2cbec41a8143b2af24: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:27.814239 26350 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 024906e65af04e2cbec41a8143b2af24: No bootstrap required, opened a new log
I20260807 22:40:27.816036 26350 raft_consensus.cc:348] T 00000000000000000000000000000000 P 024906e65af04e2cbec41a8143b2af24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "024906e65af04e2cbec41a8143b2af24" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 39363 } }
I20260807 22:40:27.816197 26350 raft_consensus.cc:374] T 00000000000000000000000000000000 P 024906e65af04e2cbec41a8143b2af24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:27.816282 26350 raft_consensus.cc:729] T 00000000000000000000000000000000 P 024906e65af04e2cbec41a8143b2af24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 024906e65af04e2cbec41a8143b2af24, State: Initialized, Role: FOLLOWER
I20260807 22:40:27.816430 26350 consensus_queue.cc:260] T 00000000000000000000000000000000 P 024906e65af04e2cbec41a8143b2af24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "024906e65af04e2cbec41a8143b2af24" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 39363 } }
I20260807 22:40:27.816512 26350 raft_consensus.cc:388] T 00000000000000000000000000000000 P 024906e65af04e2cbec41a8143b2af24 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:40:27.816557 26350 raft_consensus.cc:482] T 00000000000000000000000000000000 P 024906e65af04e2cbec41a8143b2af24 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:40:27.816606 26350 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 024906e65af04e2cbec41a8143b2af24 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:27.817212 26350 raft_consensus.cc:504] T 00000000000000000000000000000000 P 024906e65af04e2cbec41a8143b2af24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "024906e65af04e2cbec41a8143b2af24" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 39363 } }
I20260807 22:40:27.817328 26350 leader_election.cc:302] T 00000000000000000000000000000000 P 024906e65af04e2cbec41a8143b2af24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 024906e65af04e2cbec41a8143b2af24; no voters:
I20260807 22:40:27.817493 26350 leader_election.cc:288] T 00000000000000000000000000000000 P 024906e65af04e2cbec41a8143b2af24 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:40:27.817564 26367 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 024906e65af04e2cbec41a8143b2af24 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:40:27.817749 26350 sys_catalog.cc:564] T 00000000000000000000000000000000 P 024906e65af04e2cbec41a8143b2af24 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:40:27.817760 26367 raft_consensus.cc:686] T 00000000000000000000000000000000 P 024906e65af04e2cbec41a8143b2af24 [term 1 LEADER]: Becoming Leader. State: Replica: 024906e65af04e2cbec41a8143b2af24, State: Running, Role: LEADER
I20260807 22:40:27.817998 26367 consensus_queue.cc:237] T 00000000000000000000000000000000 P 024906e65af04e2cbec41a8143b2af24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "024906e65af04e2cbec41a8143b2af24" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 39363 } }
I20260807 22:40:27.818431 26368 sys_catalog.cc:455] T 00000000000000000000000000000000 P 024906e65af04e2cbec41a8143b2af24 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "024906e65af04e2cbec41a8143b2af24" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "024906e65af04e2cbec41a8143b2af24" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 39363 } } }
I20260807 22:40:27.818655 26368 sys_catalog.cc:458] T 00000000000000000000000000000000 P 024906e65af04e2cbec41a8143b2af24 [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:27.818591 26369 sys_catalog.cc:455] T 00000000000000000000000000000000 P 024906e65af04e2cbec41a8143b2af24 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 024906e65af04e2cbec41a8143b2af24. Latest consensus state: current_term: 1 leader_uuid: "024906e65af04e2cbec41a8143b2af24" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "024906e65af04e2cbec41a8143b2af24" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 39363 } } }
I20260807 22:40:27.819128 26369 sys_catalog.cc:458] T 00000000000000000000000000000000 P 024906e65af04e2cbec41a8143b2af24 [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:27.819134 26393 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:40:27.819725 26393 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 07 22:40:27 dist-test-slave-2d19 krb5kdc[26184](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142427, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:40:27.821693 26393 catalog_manager.cc:1347] Generated new cluster ID: c1bd1d01088e42008957eb6933561c8e
I20260807 22:40:27.821743 26393 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:40:27.825778 26393 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:40:27.825856 26364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:27.813709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58708 (local address 127.22.212.126:39363)
0807 22:40:27.813903 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:27.813913 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:27.813962 (+ 49us) server_negotiation.cc:407] Connection header received
0807 22:40:27.814464 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:27.814471 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:27.814520 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:27.814641 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:27.815415 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:27.816915 (+ 1500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:27.818030 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:27.818664 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:27.818779 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:27.821874 (+ 3095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:27.821878 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:27.821879 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:27.821891 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:27.823658 (+ 1767us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:27.824047 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:27.824051 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:27.824051 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:27.824144 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:27.824370 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:27.824371 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:27.824372 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:27.824621 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:27.825391 (+ 770us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:27.825479 (+ 88us) server_negotiation.cc:299] Negotiation successful
0807 22:40:27.825622 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":87,"threads_started":1}
I20260807 22:40:27.826426 26393 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:40:27.828701 26393 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 024906e65af04e2cbec41a8143b2af24: Generated new TSK 0
I20260807 22:40:27.828860 26393 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.212.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab.
Entry for principal kudu/127.22.212.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab.
I20260807 22:40:27.865171 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.65:0
--local_ip_for_outbound_sockets=127.22.212.65
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:39363
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:43489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:27.948760 26408 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:27.948971 26408 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:27.948995 26408 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:27.950232 26408 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:27.950285 26408 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:27.950307 26408 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 22:40:27.950320 26408 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 22:40:27.950371 26408 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.65
I20260807 22:40:27.951849 26408 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:43489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.212.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.22.212.126:39363
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26408
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.65
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:27.952127 26408 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:27.952396 26408 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:27.957471 26417 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:27.957471 26421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:27.957492 26416 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:27.957774 26408 server_base.cc:1034] running on GCE node
I20260807 22:40:27.957962 26408 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:27.958173 26408 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:27.959340 26408 hybrid_clock.cc:648] HybridClock initialized: now 1786142427959329 us; error 29 us; skew 500 ppm
Aug 07 22:40:27 dist-test-slave-2d19 krb5kdc[26184](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142427, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:27.961920 26408 init.cc:377] Logged in from keytab as kudu/127.22.212.65@KRBTEST.COM (short username kudu)
I20260807 22:40:27.962339 26408 webserver.cc:460] Webserver started at http://127.22.212.65:41681/ using document root <none> and password file <none>
I20260807 22:40:27.962579 26408 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:27.962627 26408 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:27.962780 26408 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:27.963853 26408 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-0/data/instance:
uuid: "357bd21dd5404914a28864e0f0599b4a"
format_stamp: "Formatted at 2026-08-07 22:40:27 on dist-test-slave-2d19"
server_key: "bce41c70e18dddd3a4207d6a5c03a816"
server_key_iv: "b6d4a6e574f8241f1164f49fe77cfef0"
server_key_version: "encryptionkey@0"
I20260807 22:40:27.964236 26408 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance:
uuid: "357bd21dd5404914a28864e0f0599b4a"
format_stamp: "Formatted at 2026-08-07 22:40:27 on dist-test-slave-2d19"
server_key: "bce41c70e18dddd3a4207d6a5c03a816"
server_key_iv: "b6d4a6e574f8241f1164f49fe77cfef0"
server_key_version: "encryptionkey@0"
I20260807 22:40:27.965654 26408 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:40:27.966420 26430 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:27.966604 26408 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 22:40:27.966709 26408 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-0/wal
uuid: "357bd21dd5404914a28864e0f0599b4a"
format_stamp: "Formatted at 2026-08-07 22:40:27 on dist-test-slave-2d19"
server_key: "bce41c70e18dddd3a4207d6a5c03a816"
server_key_iv: "b6d4a6e574f8241f1164f49fe77cfef0"
server_key_version: "encryptionkey@0"
I20260807 22:40:27.966794 26408 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:27.984898 26408 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:27.986935 26408 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:27.987124 26408 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:27.987695 26408 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:27.987761 26408 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:27.987802 26408 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:27.987830 26408 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:27.995136 26408 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.65:38139
I20260807 22:40:27.995208 26625 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.65:38139 every 8 connection(s)
Aug 07 22:40:27 dist-test-slave-2d19 krb5kdc[26184](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142427, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:40:27.995579 26408 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
I20260807 22:40:27.998474 26364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:27.988297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:34705 (local address 127.22.212.126:39363)
0807 22:40:27.988342 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:27.988344 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:27.988571 (+ 227us) server_negotiation.cc:407] Connection header received
0807 22:40:27.989141 (+ 570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:27.989142 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:27.989156 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:27.989208 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:27.990114 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:27.990997 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:27.992689 (+ 1692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:27.993099 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:27.993170 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:27.996142 (+ 2972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:27.996144 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:27.996144 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:27.996154 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:27.997369 (+ 1215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:27.997745 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:27.997746 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:27.997746 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:27.997804 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:27.998003 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:27.998003 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:27.998004 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:27.998106 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:27.998155 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:27.998344 (+ 189us) server_negotiation.cc:299] Negotiation successful
0807 22:40:27.998412 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 22:40:27.998716 26448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:27.988290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:39363 (local address 127.22.212.65:34705)
0807 22:40:27.988447 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:27.988484 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:27.989002 (+ 518us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:27.989281 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:27.989284 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:27.989681 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:27.989972 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:27.989980 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:27.991112 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:27.991113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:27.992573 (+ 1460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:27.992577 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:27.993220 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:27.993221 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:27.993357 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:27.993930 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:27.993940 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:27.996033 (+ 2093us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:27.997441 (+ 1408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:27.997448 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:27.997450 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:27.997676 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:27.997858 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:27.997859 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:27.997859 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:27.997949 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:27.998147 (+ 198us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:27.998149 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:27.998255 (+ 106us) client_negotiation.cc:769] Sending connection context
0807 22:40:27.998334 (+ 79us) client_negotiation.cc:240] Negotiation successful
0807 22:40:27.998452 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":92,"threads_started":1}
I20260807 22:40:27.999284 26626 heartbeater.cc:347] Connected to a master server at 127.22.212.126:39363
I20260807 22:40:27.999370 26626 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:27.999564 26626 heartbeater.cc:511] Master 127.22.212.126:39363 requested a full tablet report, sending...
I20260807 22:40:28.000168 26273 ts_manager.cc:194] Registered new tserver with Master: 357bd21dd5404914a28864e0f0599b4a (127.22.212.65:38139)
I20260807 22:40:28.000976 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 26408
I20260807 22:40:28.001063 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance
I20260807 22:40:28.001165 26273 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.65@KRBTEST.COM'} at 127.22.212.65:34705
I20260807 22:40:28.001247 23377 external_mini_cluster.cc:1428] Setting key 96ce365acba7f7f98e0a57407629823c
I20260807 22:40:28.006537 26635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:28.000350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:39363 (local address 127.22.212.65:59513)
0807 22:40:28.000472 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:28.000482 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:28.000545 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:28.000684 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:28.000685 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:28.000837 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:28.000885 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:28.000886 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.001666 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.001667 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:28.002562 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:28.002566 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.002914 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.002915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:28.002995 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:28.003428 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:28.003434 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:28.003865 (+ 431us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:28.005599 (+ 1734us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:28.005600 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:28.005600 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:28.005767 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:28.005972 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:28.005972 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:28.005973 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:28.006026 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:28.006296 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:28.006296 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:28.006335 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 22:40:28.006382 (+ 47us) client_negotiation.cc:240] Negotiation successful
0807 22:40:28.006462 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96,"mutex_wait_us":38,"thread_start_us":71,"threads_started":1}
I20260807 22:40:28.006646 26364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:28.000392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:59513 (local address 127.22.212.126:39363)
0807 22:40:28.000432 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:28.000434 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:28.000545 (+ 111us) server_negotiation.cc:407] Connection header received
0807 22:40:28.000602 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:28.000602 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:28.000612 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:28.000663 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:28.000966 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.001594 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.002657 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.002836 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.002895 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:28.003979 (+ 1084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:28.003980 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:28.003981 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:28.003989 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:28.005507 (+ 1518us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:28.005838 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:28.005840 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:28.005840 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:28.005906 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:28.006089 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:28.006090 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:28.006090 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:28.006233 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:28.006303 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:28.006428 (+ 125us) server_negotiation.cc:299] Negotiation successful
0807 22:40:28.006512 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
WARNING: no policy specified for kudu/127.22.212.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab.
Entry for principal kudu/127.22.212.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab.
I20260807 22:40:28.031577 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.66:0
--local_ip_for_outbound_sockets=127.22.212.66
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:39363
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:43489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:28.116765 26640 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:28.116984 26640 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:28.117012 26640 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:28.118245 26640 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:28.118292 26640 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:28.118314 26640 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 22:40:28.118326 26640 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 22:40:28.118381 26640 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.66
I20260807 22:40:28.119958 26640 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:43489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.212.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.22.212.126:39363
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26640
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.66
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:28.120220 26640 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:28.120496 26640 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:28.125954 26650 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:28.125942 26652 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:28.125988 26649 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:28.126052 26640 server_base.cc:1034] running on GCE node
I20260807 22:40:28.126382 26640 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:28.126629 26640 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:28.127779 26640 hybrid_clock.cc:648] HybridClock initialized: now 1786142428127764 us; error 31 us; skew 500 ppm
Aug 07 22:40:28 dist-test-slave-2d19 krb5kdc[26184](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142428, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:28.130357 26640 init.cc:377] Logged in from keytab as kudu/127.22.212.66@KRBTEST.COM (short username kudu)
I20260807 22:40:28.130860 26640 webserver.cc:460] Webserver started at http://127.22.212.66:35115/ using document root <none> and password file <none>
I20260807 22:40:28.131124 26640 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:28.131173 26640 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:28.131341 26640 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:28.132537 26640 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-1/data/instance:
uuid: "1df00320c8644126a1779e84089ef0e9"
format_stamp: "Formatted at 2026-08-07 22:40:28 on dist-test-slave-2d19"
server_key: "30bba42db910454a58e73d7d21cdbebf"
server_key_iv: "584398ec30aa7d9a3b2bc14d657d6ac2"
server_key_version: "encryptionkey@0"
I20260807 22:40:28.132911 26640 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance:
uuid: "1df00320c8644126a1779e84089ef0e9"
format_stamp: "Formatted at 2026-08-07 22:40:28 on dist-test-slave-2d19"
server_key: "30bba42db910454a58e73d7d21cdbebf"
server_key_iv: "584398ec30aa7d9a3b2bc14d657d6ac2"
server_key_version: "encryptionkey@0"
I20260807 22:40:28.134308 26640 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:40:28.135164 26660 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:28.135371 26640 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:40:28.135485 26640 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-1/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-1/wal
uuid: "1df00320c8644126a1779e84089ef0e9"
format_stamp: "Formatted at 2026-08-07 22:40:28 on dist-test-slave-2d19"
server_key: "30bba42db910454a58e73d7d21cdbebf"
server_key_iv: "584398ec30aa7d9a3b2bc14d657d6ac2"
server_key_version: "encryptionkey@0"
I20260807 22:40:28.135579 26640 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:28.153223 26640 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:28.155701 26640 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:28.155875 26640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:28.156775 26640 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:28.156844 26640 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:28.156894 26640 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:28.156919 26640 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 22:40:28 dist-test-slave-2d19 krb5kdc[26184](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142428, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:40:28.165518 26640 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.66:34649
I20260807 22:40:28.165863 26848 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.66:34649 every 8 connection(s)
I20260807 22:40:28.166033 26640 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
I20260807 22:40:28.167853 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 26640
I20260807 22:40:28.167968 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance
I20260807 22:40:28.168084 26364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:28.157223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:50243 (local address 127.22.212.126:39363)
0807 22:40:28.157303 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:28.157306 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:28.157510 (+ 204us) server_negotiation.cc:407] Connection header received
0807 22:40:28.158015 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:28.158017 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:28.158032 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:28.158122 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:28.158800 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.159659 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.160809 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.161165 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.161244 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:28.164975 (+ 3731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:28.164977 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:28.164978 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:28.164986 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:28.166678 (+ 1692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:28.167091 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:28.167093 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:28.167093 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:28.167153 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:28.167419 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:28.167421 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:28.167421 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:28.167553 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:28.167625 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:28.167907 (+ 282us) server_negotiation.cc:299] Negotiation successful
0807 22:40:28.167991 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 22:40:28.168190 23377 external_mini_cluster.cc:1428] Setting key 1a918e07933a6f6072cd17570be79495
I20260807 22:40:28.168301 26677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:28.157204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:39363 (local address 127.22.212.66:50243)
0807 22:40:28.157364 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:28.157406 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:28.157907 (+ 501us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:28.158174 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:28.158178 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:28.158409 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:28.158692 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:28.158697 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.159765 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.159767 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:28.160698 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:28.160701 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.161275 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.161277 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:28.161411 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:28.162810 (+ 1399us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:28.162821 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:28.164867 (+ 2046us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:28.166773 (+ 1906us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:28.166780 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:28.166782 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:28.167005 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:28.167229 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:28.167230 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:28.167231 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:28.167343 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:28.167629 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:28.167636 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:28.167773 (+ 137us) client_negotiation.cc:769] Sending connection context
0807 22:40:28.167876 (+ 103us) client_negotiation.cc:240] Negotiation successful
0807 22:40:28.168051 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":89,"threads_started":1}
I20260807 22:40:28.168910 26849 heartbeater.cc:347] Connected to a master server at 127.22.212.126:39363
I20260807 22:40:28.169025 26849 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:28.169250 26849 heartbeater.cc:511] Master 127.22.212.126:39363 requested a full tablet report, sending...
I20260807 22:40:28.171089 26273 ts_manager.cc:194] Registered new tserver with Master: 1df00320c8644126a1779e84089ef0e9 (127.22.212.66:34649)
I20260807 22:40:28.171494 26273 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.66@KRBTEST.COM'} at 127.22.212.66:50243
I20260807 22:40:28.176496 26860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:28.169972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:39363 (local address 127.22.212.66:36525)
0807 22:40:28.170113 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:28.170124 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:28.170204 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:28.170323 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:28.170324 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:28.170498 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:28.170580 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:28.170582 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.171333 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.171334 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:28.172236 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:28.172239 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.172637 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.172638 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:28.172715 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:28.173196 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:28.173200 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:28.173473 (+ 273us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:28.175348 (+ 1875us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:28.175349 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:28.175349 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:28.175533 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:28.175756 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:28.175756 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:28.175757 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:28.175809 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:28.176184 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:28.176185 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:28.176222 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 22:40:28.176337 (+ 115us) client_negotiation.cc:240] Negotiation successful
0807 22:40:28.176426 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":89,"threads_started":1}
I20260807 22:40:28.176573 26364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:28.170019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:36525 (local address 127.22.212.126:39363)
0807 22:40:28.170054 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:28.170056 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:28.170188 (+ 132us) server_negotiation.cc:407] Connection header received
0807 22:40:28.170252 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:28.170253 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:28.170264 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:28.170319 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:28.170642 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.171227 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.172343 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.172546 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.172633 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:28.173599 (+ 966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:28.173601 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:28.173601 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:28.173608 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:28.175247 (+ 1639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:28.175611 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:28.175612 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:28.175613 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:28.175681 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:28.175878 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:28.175879 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:28.175880 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:28.176113 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:28.176192 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:28.176371 (+ 179us) server_negotiation.cc:299] Negotiation successful
0807 22:40:28.176467 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
WARNING: no policy specified for kudu/127.22.212.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab.
Entry for principal kudu/127.22.212.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab.
I20260807 22:40:28.199518 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.67:0
--local_ip_for_outbound_sockets=127.22.212.67
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:39363
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:43489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:28.285144 26863 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:28.285346 26863 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:28.285370 26863 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:28.286523 26863 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:28.286566 26863 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:28.286586 26863 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 22:40:28.286598 26863 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 22:40:28.286616 26863 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.67
I20260807 22:40:28.288089 26863 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:43489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.212.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.22.212.126:39363
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26863
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.67
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:28.288357 26863 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:28.288612 26863 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:28.293880 26880 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:28.293901 26876 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:28.293918 26874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:28.293972 26863 server_base.cc:1034] running on GCE node
I20260807 22:40:28.294270 26863 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:28.294541 26863 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:28.295710 26863 hybrid_clock.cc:648] HybridClock initialized: now 1786142428295698 us; error 40 us; skew 500 ppm
Aug 07 22:40:28 dist-test-slave-2d19 krb5kdc[26184](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142428, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:28.298295 26863 init.cc:377] Logged in from keytab as kudu/127.22.212.67@KRBTEST.COM (short username kudu)
I20260807 22:40:28.298671 26863 webserver.cc:460] Webserver started at http://127.22.212.67:39777/ using document root <none> and password file <none>
I20260807 22:40:28.298873 26863 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:28.298913 26863 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:28.299069 26863 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:28.300194 26863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-2/data/instance:
uuid: "a10640a6ff9041f3adb4b5825db85735"
format_stamp: "Formatted at 2026-08-07 22:40:28 on dist-test-slave-2d19"
server_key: "ac7f93caffd3e02558984749bccb0bbe"
server_key_iv: "001b7743692892d54b212f1e80f58192"
server_key_version: "encryptionkey@0"
I20260807 22:40:28.300621 26863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance:
uuid: "a10640a6ff9041f3adb4b5825db85735"
format_stamp: "Formatted at 2026-08-07 22:40:28 on dist-test-slave-2d19"
server_key: "ac7f93caffd3e02558984749bccb0bbe"
server_key_iv: "001b7743692892d54b212f1e80f58192"
server_key_version: "encryptionkey@0"
I20260807 22:40:28.301923 26863 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:40:28.302619 26887 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:28.302771 26863 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 22:40:28.302865 26863 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-2/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-2/wal
uuid: "a10640a6ff9041f3adb4b5825db85735"
format_stamp: "Formatted at 2026-08-07 22:40:28 on dist-test-slave-2d19"
server_key: "ac7f93caffd3e02558984749bccb0bbe"
server_key_iv: "001b7743692892d54b212f1e80f58192"
server_key_version: "encryptionkey@0"
I20260807 22:40:28.302918 26863 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:28.324688 26863 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:28.326956 26863 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:28.327082 26863 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:28.327606 26863 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:28.327647 26863 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:28.327670 26863 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:28.327683 26863 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:28.334671 26863 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.67:37069
I20260807 22:40:28.334744 27078 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.67:37069 every 8 connection(s)
I20260807 22:40:28.335402 26863 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
Aug 07 22:40:28 dist-test-slave-2d19 krb5kdc[26184](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142428, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:40:28.340375 26364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:28.328123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:60549 (local address 127.22.212.126:39363)
0807 22:40:28.328189 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:28.328192 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:28.328496 (+ 304us) server_negotiation.cc:407] Connection header received
0807 22:40:28.329181 (+ 685us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:28.329183 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:28.329198 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:28.329301 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:28.330170 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.331039 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.332618 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.332927 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.333021 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:28.336521 (+ 3500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:28.336522 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:28.336523 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:28.336536 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:28.338497 (+ 1961us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:28.339069 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:28.339070 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:28.339071 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:28.339149 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:28.339488 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:28.339489 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:28.339489 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:28.339676 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:28.339752 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:28.340103 (+ 351us) server_negotiation.cc:299] Negotiation successful
0807 22:40:28.340191 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260807 22:40:28.340720 26910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:28.328111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:39363 (local address 127.22.212.67:60549)
0807 22:40:28.328359 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:28.328401 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:28.329057 (+ 656us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:28.329376 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:28.329381 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:28.329754 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:28.330065 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:28.330072 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.331129 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.331130 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:28.332524 (+ 1394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:28.332527 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.333023 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.333024 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:28.333128 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:28.333736 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:28.333747 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:28.336395 (+ 2648us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:28.338600 (+ 2205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:28.338618 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:28.338620 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:28.338952 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:28.339224 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:28.339224 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:28.339225 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:28.339373 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:28.339746 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:28.339750 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:28.339918 (+ 168us) client_negotiation.cc:769] Sending connection context
0807 22:40:28.340070 (+ 152us) client_negotiation.cc:240] Negotiation successful
0807 22:40:28.340241 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":176,"threads_started":1}
I20260807 22:40:28.341547 27079 heartbeater.cc:347] Connected to a master server at 127.22.212.126:39363
I20260807 22:40:28.341707 27079 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:28.342059 27079 heartbeater.cc:511] Master 127.22.212.126:39363 requested a full tablet report, sending...
I20260807 22:40:28.342849 26272 ts_manager.cc:194] Registered new tserver with Master: a10640a6ff9041f3adb4b5825db85735 (127.22.212.67:37069)
I20260807 22:40:28.343528 26272 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.67@KRBTEST.COM'} at 127.22.212.67:60549
I20260807 22:40:28.345328 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 26863
I20260807 22:40:28.345497 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance
I20260807 22:40:28.345824 23377 external_mini_cluster.cc:1428] Setting key 8655b9e0d5f9ca0f72b26d6396e12194
I20260807 22:40:28.347191 23377 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:40:28.355360 27091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:28.343287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:39363 (local address 127.22.212.67:34539)
0807 22:40:28.343751 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:28.343780 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:28.343871 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:28.344103 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:28.344104 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:28.344482 (+ 378us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:28.344584 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:28.344586 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.345490 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.345492 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:28.346587 (+ 1095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:28.346590 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.347159 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.347161 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:28.347281 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:28.347983 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:28.347988 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:28.348737 (+ 749us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:28.351771 (+ 3034us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:28.351779 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:28.351780 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:28.352481 (+ 701us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:28.353183 (+ 702us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:28.353191 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:28.353191 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:28.353362 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:28.354217 (+ 855us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:28.354219 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:28.354344 (+ 125us) client_negotiation.cc:769] Sending connection context
0807 22:40:28.354576 (+ 232us) client_negotiation.cc:240] Negotiation successful
0807 22:40:28.354984 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":106,"threads_started":1}
I20260807 22:40:28.355320 26364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:28.343367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:34539 (local address 127.22.212.126:39363)
0807 22:40:28.343425 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:28.343427 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:28.343877 (+ 450us) server_negotiation.cc:407] Connection header received
0807 22:40:28.343940 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:28.343941 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:28.343955 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:28.344079 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:28.344689 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.345331 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.346718 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.346955 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.347140 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:28.348937 (+ 1797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:28.348938 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:28.348938 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:28.348952 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:28.351433 (+ 2481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:28.352715 (+ 1282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:28.352731 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:28.352733 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:28.352946 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:28.353651 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:28.353652 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:28.353652 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:28.353957 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:28.354263 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:28.354729 (+ 466us) server_negotiation.cc:299] Negotiation successful
0807 22:40:28.354986 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
Aug 07 22:40:28 dist-test-slave-2d19 krb5kdc[26184](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142428, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 22:40:28 dist-test-slave-2d19 krb5kdc[26184](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142428, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:40:28.400010 26364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:28.388375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58722 (local address 127.22.212.126:39363)
0807 22:40:28.388477 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:28.388479 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:28.388491 (+ 12us) server_negotiation.cc:407] Connection header received
0807 22:40:28.388546 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:28.388547 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:28.388570 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:28.388688 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:28.389702 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.390391 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.391593 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.391979 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.392116 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:28.395872 (+ 3756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:28.395874 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:28.395874 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:28.395910 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:28.397964 (+ 2054us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:28.398579 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:28.398581 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:28.398581 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:28.398683 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:28.399064 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:28.399066 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:28.399066 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:28.399239 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:28.399433 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:28.399650 (+ 217us) server_negotiation.cc:299] Negotiation successful
0807 22:40:28.399790 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 22:40:28.402544 26272 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58722:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:40:28.405192 26272 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:40:28.420202 27104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:28.408775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.66:34649 (local address 127.0.0.1:42402)
0807 22:40:28.409490 (+ 715us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:28.409519 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:28.409609 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:28.410153 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:28.410165 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:28.410168 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:28.410278 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:28.410288 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.413558 (+ 3270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.413559 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:28.416176 (+ 2617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:28.416184 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.419096 (+ 2912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.419106 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:28.419534 (+ 428us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:28.419641 (+ 107us) client_negotiation.cc:769] Sending connection context
0807 22:40:28.419876 (+ 235us) client_negotiation.cc:240] Negotiation successful
0807 22:40:28.419985 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":682,"mutex_wait_us":3,"thread_start_us":171,"threads_started":1}
I20260807 22:40:28.421597 27108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:28.408918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42402 (local address 127.22.212.66:34649)
0807 22:40:28.409582 (+ 664us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:28.409588 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:28.409611 (+ 23us) server_negotiation.cc:407] Connection header received
0807 22:40:28.409762 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:28.409788 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:28.409808 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:28.409991 (+ 183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:28.410481 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.413182 (+ 2701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.416436 (+ 3254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.418576 (+ 2140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.418751 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:28.421182 (+ 2431us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:28.421245 (+ 63us) server_negotiation.cc:299] Negotiation successful
0807 22:40:28.421344 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":580,"thread_start_us":161,"threads_started":1}
I20260807 22:40:28.421937 27107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:28.408796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.67:37069 (local address 127.0.0.1:58542)
0807 22:40:28.409803 (+ 1007us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:28.409814 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:28.409917 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:28.410312 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:28.410314 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:28.410316 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:28.410428 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:28.410431 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.412578 (+ 2147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.412586 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:28.416642 (+ 4056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:28.416645 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.421116 (+ 4471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.421117 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:28.421239 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:28.421244 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 22:40:28.421350 (+ 106us) client_negotiation.cc:240] Negotiation successful
0807 22:40:28.421599 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":977,"mutex_wait_us":78,"thread_start_us":152,"threads_started":1}
I20260807 22:40:28.423306 27103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:28.408773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:38139 (local address 127.0.0.1:50100)
0807 22:40:28.409297 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:28.409395 (+ 98us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:28.409539 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:28.410242 (+ 703us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:28.410242 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:28.410244 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:28.410356 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:28.410358 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.415337 (+ 4979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.415339 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:28.418650 (+ 3311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:28.418653 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.422579 (+ 3926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.422580 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:28.422770 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:28.422777 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 22:40:28.422880 (+ 103us) client_negotiation.cc:240] Negotiation successful
0807 22:40:28.422976 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":470,"mutex_wait_us":4,"thread_start_us":81,"threads_started":1}
I20260807 22:40:28.424320 27110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:28.409187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50100 (local address 127.22.212.65:38139)
0807 22:40:28.409899 (+ 712us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:28.409903 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:28.409925 (+ 22us) server_negotiation.cc:407] Connection header received
0807 22:40:28.410023 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:28.410027 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:28.410055 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:28.410492 (+ 437us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:28.410603 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.414821 (+ 4218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.419068 (+ 4247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.421981 (+ 2913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.423679 (+ 1698us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:28.423877 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:28.423944 (+ 67us) server_negotiation.cc:299] Negotiation successful
0807 22:40:28.424051 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":627,"thread_start_us":167,"threads_started":1}
I20260807 22:40:28.424155 26750 tablet_service.cc:1467] Processing CreateTablet for tablet ffa296f9adbe49c0b94bc82d468d7506 (DEFAULT_TABLE table=test-table [id=4991d3cb55024a498b16204377a02050]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:28.424589 27109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:28.409168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58542 (local address 127.22.212.67:37069)
0807 22:40:28.409945 (+ 777us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:28.409950 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:28.409979 (+ 29us) server_negotiation.cc:407] Connection header received
0807 22:40:28.410133 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:28.410135 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:28.410150 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:28.410316 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:28.410529 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.411950 (+ 1421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.417100 (+ 5150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.420468 (+ 3368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.420617 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:28.420882 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:28.422609 (+ 1727us) server_negotiation.cc:299] Negotiation successful
0807 22:40:28.424391 (+ 1782us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":707,"thread_start_us":185,"threads_started":1}
I20260807 22:40:28.424962 26750 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffa296f9adbe49c0b94bc82d468d7506. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:28.425559 26967 tablet_service.cc:1467] Processing CreateTablet for tablet ffa296f9adbe49c0b94bc82d468d7506 (DEFAULT_TABLE table=test-table [id=4991d3cb55024a498b16204377a02050]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:28.425544 26510 tablet_service.cc:1467] Processing CreateTablet for tablet ffa296f9adbe49c0b94bc82d468d7506 (DEFAULT_TABLE table=test-table [id=4991d3cb55024a498b16204377a02050]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:28.426175 26510 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffa296f9adbe49c0b94bc82d468d7506. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:28.426175 26967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffa296f9adbe49c0b94bc82d468d7506. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:28.430133 27111 tablet_bootstrap.cc:492] T ffa296f9adbe49c0b94bc82d468d7506 P 1df00320c8644126a1779e84089ef0e9: Bootstrap starting.
I20260807 22:40:28.431234 27111 tablet_bootstrap.cc:654] T ffa296f9adbe49c0b94bc82d468d7506 P 1df00320c8644126a1779e84089ef0e9: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:28.431751 27111 log.cc:824] T ffa296f9adbe49c0b94bc82d468d7506 P 1df00320c8644126a1779e84089ef0e9: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:28.432272 27112 tablet_bootstrap.cc:492] T ffa296f9adbe49c0b94bc82d468d7506 P a10640a6ff9041f3adb4b5825db85735: Bootstrap starting.
I20260807 22:40:28.433203 27111 tablet_bootstrap.cc:492] T ffa296f9adbe49c0b94bc82d468d7506 P 1df00320c8644126a1779e84089ef0e9: No bootstrap required, opened a new log
I20260807 22:40:28.433291 27111 ts_tablet_manager.cc:1397] T ffa296f9adbe49c0b94bc82d468d7506 P 1df00320c8644126a1779e84089ef0e9: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 22:40:28.433790 27112 tablet_bootstrap.cc:654] T ffa296f9adbe49c0b94bc82d468d7506 P a10640a6ff9041f3adb4b5825db85735: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:28.434303 27112 log.cc:824] T ffa296f9adbe49c0b94bc82d468d7506 P a10640a6ff9041f3adb4b5825db85735: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:28.434890 27115 tablet_bootstrap.cc:492] T ffa296f9adbe49c0b94bc82d468d7506 P 357bd21dd5404914a28864e0f0599b4a: Bootstrap starting.
I20260807 22:40:28.435406 27112 tablet_bootstrap.cc:492] T ffa296f9adbe49c0b94bc82d468d7506 P a10640a6ff9041f3adb4b5825db85735: No bootstrap required, opened a new log
I20260807 22:40:28.435480 27112 ts_tablet_manager.cc:1397] T ffa296f9adbe49c0b94bc82d468d7506 P a10640a6ff9041f3adb4b5825db85735: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20260807 22:40:28.436107 27111 raft_consensus.cc:348] T ffa296f9adbe49c0b94bc82d468d7506 P 1df00320c8644126a1779e84089ef0e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } }
I20260807 22:40:28.436414 27111 raft_consensus.cc:374] T ffa296f9adbe49c0b94bc82d468d7506 P 1df00320c8644126a1779e84089ef0e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:28.436529 27111 raft_consensus.cc:729] T ffa296f9adbe49c0b94bc82d468d7506 P 1df00320c8644126a1779e84089ef0e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1df00320c8644126a1779e84089ef0e9, State: Initialized, Role: FOLLOWER
I20260807 22:40:28.436780 27111 consensus_queue.cc:260] T ffa296f9adbe49c0b94bc82d468d7506 P 1df00320c8644126a1779e84089ef0e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } }
I20260807 22:40:28.437211 27111 ts_tablet_manager.cc:1428] T ffa296f9adbe49c0b94bc82d468d7506 P 1df00320c8644126a1779e84089ef0e9: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260807 22:40:28.437322 26849 heartbeater.cc:503] Master 127.22.212.126:39363 was elected leader, sending a full tablet report...
I20260807 22:40:28.438050 27112 raft_consensus.cc:348] T ffa296f9adbe49c0b94bc82d468d7506 P a10640a6ff9041f3adb4b5825db85735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } }
I20260807 22:40:28.438282 27112 raft_consensus.cc:374] T ffa296f9adbe49c0b94bc82d468d7506 P a10640a6ff9041f3adb4b5825db85735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:28.438325 27112 raft_consensus.cc:729] T ffa296f9adbe49c0b94bc82d468d7506 P a10640a6ff9041f3adb4b5825db85735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a10640a6ff9041f3adb4b5825db85735, State: Initialized, Role: FOLLOWER
I20260807 22:40:28.438575 27112 consensus_queue.cc:260] T ffa296f9adbe49c0b94bc82d468d7506 P a10640a6ff9041f3adb4b5825db85735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } }
I20260807 22:40:28.439100 27112 ts_tablet_manager.cc:1428] T ffa296f9adbe49c0b94bc82d468d7506 P a10640a6ff9041f3adb4b5825db85735: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260807 22:40:28.439307 27079 heartbeater.cc:503] Master 127.22.212.126:39363 was elected leader, sending a full tablet report...
I20260807 22:40:28.440443 27115 tablet_bootstrap.cc:654] T ffa296f9adbe49c0b94bc82d468d7506 P 357bd21dd5404914a28864e0f0599b4a: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:28.441026 27115 log.cc:824] T ffa296f9adbe49c0b94bc82d468d7506 P 357bd21dd5404914a28864e0f0599b4a: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:28.442278 27115 tablet_bootstrap.cc:492] T ffa296f9adbe49c0b94bc82d468d7506 P 357bd21dd5404914a28864e0f0599b4a: No bootstrap required, opened a new log
I20260807 22:40:28.442366 27115 ts_tablet_manager.cc:1397] T ffa296f9adbe49c0b94bc82d468d7506 P 357bd21dd5404914a28864e0f0599b4a: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.002s
I20260807 22:40:28.444782 27115 raft_consensus.cc:348] T ffa296f9adbe49c0b94bc82d468d7506 P 357bd21dd5404914a28864e0f0599b4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } }
I20260807 22:40:28.445000 27115 raft_consensus.cc:374] T ffa296f9adbe49c0b94bc82d468d7506 P 357bd21dd5404914a28864e0f0599b4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:28.445048 27115 raft_consensus.cc:729] T ffa296f9adbe49c0b94bc82d468d7506 P 357bd21dd5404914a28864e0f0599b4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 357bd21dd5404914a28864e0f0599b4a, State: Initialized, Role: FOLLOWER
I20260807 22:40:28.445225 27115 consensus_queue.cc:260] T ffa296f9adbe49c0b94bc82d468d7506 P 357bd21dd5404914a28864e0f0599b4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } }
I20260807 22:40:28.445612 27115 ts_tablet_manager.cc:1428] T ffa296f9adbe49c0b94bc82d468d7506 P 357bd21dd5404914a28864e0f0599b4a: Time spent starting tablet: real 0.003s user 0.003s sys 0.001s
I20260807 22:40:28.445660 26626 heartbeater.cc:503] Master 127.22.212.126:39363 was elected leader, sending a full tablet report...
I20260807 22:40:28.466593 27124 raft_consensus.cc:482] T ffa296f9adbe49c0b94bc82d468d7506 P 357bd21dd5404914a28864e0f0599b4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:40:28.466776 27124 raft_consensus.cc:504] T ffa296f9adbe49c0b94bc82d468d7506 P 357bd21dd5404914a28864e0f0599b4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } }
I20260807 22:40:28.467453 27124 leader_election.cc:288] T ffa296f9adbe49c0b94bc82d468d7506 P 357bd21dd5404914a28864e0f0599b4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1df00320c8644126a1779e84089ef0e9 (127.22.212.66:34649), a10640a6ff9041f3adb4b5825db85735 (127.22.212.67:37069)
I20260807 22:40:28.472159 27108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:28.467881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:57713 (local address 127.22.212.66:34649)
0807 22:40:28.467949 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:28.467951 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:28.467971 (+ 20us) server_negotiation.cc:407] Connection header received
0807 22:40:28.468019 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:28.468020 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:28.468053 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:28.468161 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:28.468535 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.469283 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.470843 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.471566 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.471710 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:28.471726 (+ 16us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:28.471993 (+ 267us) server_negotiation.cc:299] Negotiation successful
0807 22:40:28.472057 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260807 22:40:28.472158 26448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:28.467706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.66:34649 (local address 127.22.212.65:57713)
0807 22:40:28.467819 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:28.467833 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:28.467911 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:28.468168 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:28.468169 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:28.468171 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:28.468385 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:28.468388 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.469498 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.469499 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:28.470622 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:28.470625 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.471710 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.471712 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:28.471838 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:28.471841 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:40:28.471982 (+ 141us) client_negotiation.cc:240] Negotiation successful
0807 22:40:28.472040 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74}
I20260807 22:40:28.472373 27109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:28.467861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:44165 (local address 127.22.212.67:37069)
0807 22:40:28.467936 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:28.467947 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:28.468101 (+ 154us) server_negotiation.cc:407] Connection header received
0807 22:40:28.468282 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:28.468283 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:28.468303 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:28.468445 (+ 142us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:28.468711 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.469552 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.471299 (+ 1747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.471757 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.471913 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:28.471923 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:28.472195 (+ 272us) server_negotiation.cc:299] Negotiation successful
0807 22:40:28.472276 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 22:40:28.472401 27125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:28.467774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.67:37069 (local address 127.22.212.65:44165)
0807 22:40:28.467981 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:28.468000 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:28.468120 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:28.468448 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:28.468449 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:28.468450 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:28.468583 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:28.468585 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.469719 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.469720 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:28.471047 (+ 1327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:28.471050 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.471914 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.471916 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:28.472048 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:28.472053 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 22:40:28.472185 (+ 132us) client_negotiation.cc:240] Negotiation successful
0807 22:40:28.472244 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":99,"threads_started":1}
I20260807 22:40:28.472892 26778 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffa296f9adbe49c0b94bc82d468d7506" candidate_uuid: "357bd21dd5404914a28864e0f0599b4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1df00320c8644126a1779e84089ef0e9" is_pre_election: true
I20260807 22:40:28.472913 27012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffa296f9adbe49c0b94bc82d468d7506" candidate_uuid: "357bd21dd5404914a28864e0f0599b4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10640a6ff9041f3adb4b5825db85735" is_pre_election: true
I20260807 22:40:28.473196 26778 raft_consensus.cc:2454] T ffa296f9adbe49c0b94bc82d468d7506 P 1df00320c8644126a1779e84089ef0e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 357bd21dd5404914a28864e0f0599b4a in term 0.
I20260807 22:40:28.473207 27012 raft_consensus.cc:2454] T ffa296f9adbe49c0b94bc82d468d7506 P a10640a6ff9041f3adb4b5825db85735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 357bd21dd5404914a28864e0f0599b4a in term 0.
I20260807 22:40:28.473634 26434 leader_election.cc:302] T ffa296f9adbe49c0b94bc82d468d7506 P 357bd21dd5404914a28864e0f0599b4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 357bd21dd5404914a28864e0f0599b4a, a10640a6ff9041f3adb4b5825db85735; no voters:
I20260807 22:40:28.473814 27124 raft_consensus.cc:2781] T ffa296f9adbe49c0b94bc82d468d7506 P 357bd21dd5404914a28864e0f0599b4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:40:28.473917 27124 raft_consensus.cc:482] T ffa296f9adbe49c0b94bc82d468d7506 P 357bd21dd5404914a28864e0f0599b4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:40:28.473968 27124 raft_consensus.cc:3037] T ffa296f9adbe49c0b94bc82d468d7506 P 357bd21dd5404914a28864e0f0599b4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:28.475083 27124 raft_consensus.cc:504] T ffa296f9adbe49c0b94bc82d468d7506 P 357bd21dd5404914a28864e0f0599b4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } }
I20260807 22:40:28.475315 27124 leader_election.cc:288] T ffa296f9adbe49c0b94bc82d468d7506 P 357bd21dd5404914a28864e0f0599b4a [CANDIDATE]: Term 1 election: Requested vote from peers 1df00320c8644126a1779e84089ef0e9 (127.22.212.66:34649), a10640a6ff9041f3adb4b5825db85735 (127.22.212.67:37069)
I20260807 22:40:28.475582 27012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffa296f9adbe49c0b94bc82d468d7506" candidate_uuid: "357bd21dd5404914a28864e0f0599b4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10640a6ff9041f3adb4b5825db85735"
I20260807 22:40:28.475582 26778 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffa296f9adbe49c0b94bc82d468d7506" candidate_uuid: "357bd21dd5404914a28864e0f0599b4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1df00320c8644126a1779e84089ef0e9"
I20260807 22:40:28.475719 27012 raft_consensus.cc:3037] T ffa296f9adbe49c0b94bc82d468d7506 P a10640a6ff9041f3adb4b5825db85735 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:28.475719 26778 raft_consensus.cc:3037] T ffa296f9adbe49c0b94bc82d468d7506 P 1df00320c8644126a1779e84089ef0e9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:28.477267 27012 raft_consensus.cc:2454] T ffa296f9adbe49c0b94bc82d468d7506 P a10640a6ff9041f3adb4b5825db85735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 357bd21dd5404914a28864e0f0599b4a in term 1.
I20260807 22:40:28.477267 26778 raft_consensus.cc:2454] T ffa296f9adbe49c0b94bc82d468d7506 P 1df00320c8644126a1779e84089ef0e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 357bd21dd5404914a28864e0f0599b4a in term 1.
I20260807 22:40:28.477531 26434 leader_election.cc:302] T ffa296f9adbe49c0b94bc82d468d7506 P 357bd21dd5404914a28864e0f0599b4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 357bd21dd5404914a28864e0f0599b4a, a10640a6ff9041f3adb4b5825db85735; no voters:
I20260807 22:40:28.477734 27124 raft_consensus.cc:2781] T ffa296f9adbe49c0b94bc82d468d7506 P 357bd21dd5404914a28864e0f0599b4a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:40:28.477944 27124 raft_consensus.cc:686] T ffa296f9adbe49c0b94bc82d468d7506 P 357bd21dd5404914a28864e0f0599b4a [term 1 LEADER]: Becoming Leader. State: Replica: 357bd21dd5404914a28864e0f0599b4a, State: Running, Role: LEADER
I20260807 22:40:28.478127 27124 consensus_queue.cc:237] T ffa296f9adbe49c0b94bc82d468d7506 P 357bd21dd5404914a28864e0f0599b4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } }
I20260807 22:40:28.481647 26273 catalog_manager.cc:5495] T ffa296f9adbe49c0b94bc82d468d7506 P 357bd21dd5404914a28864e0f0599b4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 357bd21dd5404914a28864e0f0599b4a (127.22.212.65). New cstate: current_term: 1 leader_uuid: "357bd21dd5404914a28864e0f0599b4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } health_report { overall_health: UNKNOWN } } }
W20260807 22:40:28.496400 26627 tablet.cc:2369] T ffa296f9adbe49c0b94bc82d468d7506 P 357bd21dd5404914a28864e0f0599b4a: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 07 22:40:28 dist-test-slave-2d19 krb5kdc[26184](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142427, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:40:28.515887 26364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:28.509039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58736 (local address 127.22.212.126:39363)
0807 22:40:28.509104 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:28.509106 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:28.509264 (+ 158us) server_negotiation.cc:407] Connection header received
0807 22:40:28.509310 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:28.509311 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:28.509320 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:28.509372 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:28.509804 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.510284 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.510938 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.511140 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.511192 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:28.513347 (+ 2155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:28.513349 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:28.513349 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:28.513357 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:28.514674 (+ 1317us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:28.515068 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:28.515069 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:28.515070 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:28.515125 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:28.515329 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:28.515330 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:28.515330 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:28.515439 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:28.515519 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:28.515672 (+ 153us) server_negotiation.cc:299] Negotiation successful
0807 22:40:28.515778 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 22:40:28.515962 27136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:28.508999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:39363 (local address 127.0.0.1:58736)
0807 22:40:28.509189 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:28.509199 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:28.509266 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:28.509388 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:28.509389 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:28.509692 (+ 303us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:28.509741 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:28.509743 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.510353 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.510354 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:28.510873 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:28.510875 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.511207 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.511208 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:28.511248 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:28.511798 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:28.511802 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:28.513253 (+ 1451us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:28.514770 (+ 1517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:28.514777 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:28.514780 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:28.514977 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:28.515192 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:28.515192 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:28.515193 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:28.515254 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:28.515504 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:28.515512 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:28.515560 (+ 48us) client_negotiation.cc:769] Sending connection context
0807 22:40:28.515648 (+ 88us) client_negotiation.cc:240] Negotiation successful
0807 22:40:28.515839 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"mutex_wait_us":87,"thread_start_us":112,"threads_started":1}
I20260807 22:40:28.518074 26273 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:58736:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 22:40:28.518356 26273 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:40:28.519829 26510 tablet_service.cc:1467] Processing CreateTablet for tablet 6f0d97d7f85c4cd08d5b40fa343714fd (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=377a7971dedb4911a147bd363d89903c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 22:40:28.519847 26750 tablet_service.cc:1467] Processing CreateTablet for tablet 6f0d97d7f85c4cd08d5b40fa343714fd (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=377a7971dedb4911a147bd363d89903c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 22:40:28.520020 26510 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f0d97d7f85c4cd08d5b40fa343714fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:28.520047 26750 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f0d97d7f85c4cd08d5b40fa343714fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:28.521266 27111 tablet_bootstrap.cc:492] T 6f0d97d7f85c4cd08d5b40fa343714fd P 1df00320c8644126a1779e84089ef0e9: Bootstrap starting.
I20260807 22:40:28.521296 27115 tablet_bootstrap.cc:492] T 6f0d97d7f85c4cd08d5b40fa343714fd P 357bd21dd5404914a28864e0f0599b4a: Bootstrap starting.
I20260807 22:40:28.521498 26967 tablet_service.cc:1467] Processing CreateTablet for tablet 6f0d97d7f85c4cd08d5b40fa343714fd (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=377a7971dedb4911a147bd363d89903c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 22:40:28.521648 26967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f0d97d7f85c4cd08d5b40fa343714fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:28.521718 27115 tablet_bootstrap.cc:654] T 6f0d97d7f85c4cd08d5b40fa343714fd P 357bd21dd5404914a28864e0f0599b4a: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:28.521865 27111 tablet_bootstrap.cc:654] T 6f0d97d7f85c4cd08d5b40fa343714fd P 1df00320c8644126a1779e84089ef0e9: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:28.522492 27111 tablet_bootstrap.cc:492] T 6f0d97d7f85c4cd08d5b40fa343714fd P 1df00320c8644126a1779e84089ef0e9: No bootstrap required, opened a new log
I20260807 22:40:28.522542 27111 ts_tablet_manager.cc:1397] T 6f0d97d7f85c4cd08d5b40fa343714fd P 1df00320c8644126a1779e84089ef0e9: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 22:40:28.522714 27111 raft_consensus.cc:348] T 6f0d97d7f85c4cd08d5b40fa343714fd P 1df00320c8644126a1779e84089ef0e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } }
I20260807 22:40:28.522782 27111 raft_consensus.cc:374] T 6f0d97d7f85c4cd08d5b40fa343714fd P 1df00320c8644126a1779e84089ef0e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:28.522795 27111 raft_consensus.cc:729] T 6f0d97d7f85c4cd08d5b40fa343714fd P 1df00320c8644126a1779e84089ef0e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1df00320c8644126a1779e84089ef0e9, State: Initialized, Role: FOLLOWER
I20260807 22:40:28.522866 27111 consensus_queue.cc:260] T 6f0d97d7f85c4cd08d5b40fa343714fd P 1df00320c8644126a1779e84089ef0e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } }
I20260807 22:40:28.522964 27111 ts_tablet_manager.cc:1428] T 6f0d97d7f85c4cd08d5b40fa343714fd P 1df00320c8644126a1779e84089ef0e9: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:28.523030 27117 tablet_replica.cc:439] T 6f0d97d7f85c4cd08d5b40fa343714fd P 1df00320c8644126a1779e84089ef0e9: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } } }
I20260807 22:40:28.523121 27117 tablet_replica.cc:442] T 6f0d97d7f85c4cd08d5b40fa343714fd P 1df00320c8644126a1779e84089ef0e9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:40:28.523236 27112 tablet_bootstrap.cc:492] T 6f0d97d7f85c4cd08d5b40fa343714fd P a10640a6ff9041f3adb4b5825db85735: Bootstrap starting.
I20260807 22:40:28.523801 27112 tablet_bootstrap.cc:654] T 6f0d97d7f85c4cd08d5b40fa343714fd P a10640a6ff9041f3adb4b5825db85735: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:28.524240 27115 tablet_bootstrap.cc:492] T 6f0d97d7f85c4cd08d5b40fa343714fd P 357bd21dd5404914a28864e0f0599b4a: No bootstrap required, opened a new log
I20260807 22:40:28.524328 27115 ts_tablet_manager.cc:1397] T 6f0d97d7f85c4cd08d5b40fa343714fd P 357bd21dd5404914a28864e0f0599b4a: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260807 22:40:28.524492 27112 tablet_bootstrap.cc:492] T 6f0d97d7f85c4cd08d5b40fa343714fd P a10640a6ff9041f3adb4b5825db85735: No bootstrap required, opened a new log
I20260807 22:40:28.524488 27115 raft_consensus.cc:348] T 6f0d97d7f85c4cd08d5b40fa343714fd P 357bd21dd5404914a28864e0f0599b4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } }
I20260807 22:40:28.524547 27112 ts_tablet_manager.cc:1397] T 6f0d97d7f85c4cd08d5b40fa343714fd P a10640a6ff9041f3adb4b5825db85735: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 22:40:28.524566 27115 raft_consensus.cc:374] T 6f0d97d7f85c4cd08d5b40fa343714fd P 357bd21dd5404914a28864e0f0599b4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:28.524590 27115 raft_consensus.cc:729] T 6f0d97d7f85c4cd08d5b40fa343714fd P 357bd21dd5404914a28864e0f0599b4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 357bd21dd5404914a28864e0f0599b4a, State: Initialized, Role: FOLLOWER
I20260807 22:40:28.524649 27115 consensus_queue.cc:260] T 6f0d97d7f85c4cd08d5b40fa343714fd P 357bd21dd5404914a28864e0f0599b4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } }
I20260807 22:40:28.524688 27112 raft_consensus.cc:348] T 6f0d97d7f85c4cd08d5b40fa343714fd P a10640a6ff9041f3adb4b5825db85735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } }
I20260807 22:40:28.524739 27115 ts_tablet_manager.cc:1428] T 6f0d97d7f85c4cd08d5b40fa343714fd P 357bd21dd5404914a28864e0f0599b4a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:28.524772 27112 raft_consensus.cc:374] T 6f0d97d7f85c4cd08d5b40fa343714fd P a10640a6ff9041f3adb4b5825db85735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:28.524803 27112 raft_consensus.cc:729] T 6f0d97d7f85c4cd08d5b40fa343714fd P a10640a6ff9041f3adb4b5825db85735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a10640a6ff9041f3adb4b5825db85735, State: Initialized, Role: FOLLOWER
I20260807 22:40:28.524856 27112 consensus_queue.cc:260] T 6f0d97d7f85c4cd08d5b40fa343714fd P a10640a6ff9041f3adb4b5825db85735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } }
I20260807 22:40:28.524875 27124 tablet_replica.cc:439] T 6f0d97d7f85c4cd08d5b40fa343714fd P 357bd21dd5404914a28864e0f0599b4a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } } }
I20260807 22:40:28.524940 27124 tablet_replica.cc:442] T 6f0d97d7f85c4cd08d5b40fa343714fd P 357bd21dd5404914a28864e0f0599b4a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:40:28.524951 27112 ts_tablet_manager.cc:1428] T 6f0d97d7f85c4cd08d5b40fa343714fd P a10640a6ff9041f3adb4b5825db85735: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260807 22:40:28.525169 27119 tablet_replica.cc:439] T 6f0d97d7f85c4cd08d5b40fa343714fd P a10640a6ff9041f3adb4b5825db85735: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } } }
I20260807 22:40:28.525260 27119 tablet_replica.cc:442] T 6f0d97d7f85c4cd08d5b40fa343714fd P a10640a6ff9041f3adb4b5825db85735: This TxnStatusTablet replica's current role is: FOLLOWER
W20260807 22:40:28.586457 27081 tablet.cc:2369] T 6f0d97d7f85c4cd08d5b40fa343714fd P a10640a6ff9041f3adb4b5825db85735: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:40:28.611337 27117 raft_consensus.cc:482] T 6f0d97d7f85c4cd08d5b40fa343714fd P 1df00320c8644126a1779e84089ef0e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:40:28.611446 27117 raft_consensus.cc:504] T 6f0d97d7f85c4cd08d5b40fa343714fd P 1df00320c8644126a1779e84089ef0e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } }
I20260807 22:40:28.611796 27117 leader_election.cc:288] T 6f0d97d7f85c4cd08d5b40fa343714fd P 1df00320c8644126a1779e84089ef0e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 357bd21dd5404914a28864e0f0599b4a (127.22.212.65:38139), a10640a6ff9041f3adb4b5825db85735 (127.22.212.67:37069)
I20260807 22:40:28.614955 27110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:28.612076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:59359 (local address 127.22.212.65:38139)
0807 22:40:28.612127 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:28.612130 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:28.612142 (+ 12us) server_negotiation.cc:407] Connection header received
0807 22:40:28.612222 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:28.612223 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:28.612236 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:28.612320 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:28.612515 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.613069 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.614228 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.614585 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.614670 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:28.614679 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:28.614840 (+ 161us) server_negotiation.cc:299] Negotiation successful
0807 22:40:28.614884 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260807 22:40:28.614955 27109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:28.612137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:38455 (local address 127.22.212.67:37069)
0807 22:40:28.612187 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:28.612189 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:28.612348 (+ 159us) server_negotiation.cc:407] Connection header received
0807 22:40:28.612381 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:28.612382 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:28.612391 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:28.612460 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:28.612658 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.613123 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.614225 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.614587 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.614664 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:28.614673 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:28.614865 (+ 192us) server_negotiation.cc:299] Negotiation successful
0807 22:40:28.614899 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 22:40:28.614950 26677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:28.611991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:38139 (local address 127.22.212.66:59359)
0807 22:40:28.612074 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:28.612088 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:28.612136 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:28.612346 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:28.612347 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:28.612350 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:28.612433 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:28.612435 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.613155 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.613156 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:28.614137 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:28.614139 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.614680 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.614681 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:28.614766 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:28.614768 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 22:40:28.614808 (+ 40us) client_negotiation.cc:240] Negotiation successful
0807 22:40:28.614869 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260807 22:40:28.614984 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:28.612040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.67:37069 (local address 127.22.212.66:38455)
0807 22:40:28.612257 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:28.612286 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:28.612336 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:28.612490 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:28.612491 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:28.612494 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:28.612586 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:28.612588 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.613218 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.613219 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:28.614140 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:28.614142 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.614707 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.614708 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:28.614773 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:28.614775 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 22:40:28.614847 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 22:40:28.614884 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"mutex_wait_us":1,"thread_start_us":140,"threads_started":1}
I20260807 22:40:28.615330 27012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f0d97d7f85c4cd08d5b40fa343714fd" candidate_uuid: "1df00320c8644126a1779e84089ef0e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10640a6ff9041f3adb4b5825db85735" is_pre_election: true
I20260807 22:40:28.615427 27012 raft_consensus.cc:2454] T 6f0d97d7f85c4cd08d5b40fa343714fd P a10640a6ff9041f3adb4b5825db85735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1df00320c8644126a1779e84089ef0e9 in term 0.
I20260807 22:40:28.615377 26551 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f0d97d7f85c4cd08d5b40fa343714fd" candidate_uuid: "1df00320c8644126a1779e84089ef0e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "357bd21dd5404914a28864e0f0599b4a" is_pre_election: true
I20260807 22:40:28.615547 26551 raft_consensus.cc:2454] T 6f0d97d7f85c4cd08d5b40fa343714fd P 357bd21dd5404914a28864e0f0599b4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1df00320c8644126a1779e84089ef0e9 in term 0.
I20260807 22:40:28.615628 26663 leader_election.cc:302] T 6f0d97d7f85c4cd08d5b40fa343714fd P 1df00320c8644126a1779e84089ef0e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1df00320c8644126a1779e84089ef0e9, a10640a6ff9041f3adb4b5825db85735; no voters:
I20260807 22:40:28.615788 27117 raft_consensus.cc:2781] T 6f0d97d7f85c4cd08d5b40fa343714fd P 1df00320c8644126a1779e84089ef0e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:40:28.615836 27117 raft_consensus.cc:482] T 6f0d97d7f85c4cd08d5b40fa343714fd P 1df00320c8644126a1779e84089ef0e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:40:28.615864 27117 raft_consensus.cc:3037] T 6f0d97d7f85c4cd08d5b40fa343714fd P 1df00320c8644126a1779e84089ef0e9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:28.616580 27117 raft_consensus.cc:504] T 6f0d97d7f85c4cd08d5b40fa343714fd P 1df00320c8644126a1779e84089ef0e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } }
I20260807 22:40:28.616722 27117 leader_election.cc:288] T 6f0d97d7f85c4cd08d5b40fa343714fd P 1df00320c8644126a1779e84089ef0e9 [CANDIDATE]: Term 1 election: Requested vote from peers 357bd21dd5404914a28864e0f0599b4a (127.22.212.65:38139), a10640a6ff9041f3adb4b5825db85735 (127.22.212.67:37069)
I20260807 22:40:28.616875 26551 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f0d97d7f85c4cd08d5b40fa343714fd" candidate_uuid: "1df00320c8644126a1779e84089ef0e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "357bd21dd5404914a28864e0f0599b4a"
I20260807 22:40:28.616916 27012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f0d97d7f85c4cd08d5b40fa343714fd" candidate_uuid: "1df00320c8644126a1779e84089ef0e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10640a6ff9041f3adb4b5825db85735"
I20260807 22:40:28.616961 26551 raft_consensus.cc:3037] T 6f0d97d7f85c4cd08d5b40fa343714fd P 357bd21dd5404914a28864e0f0599b4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:28.616974 27012 raft_consensus.cc:3037] T 6f0d97d7f85c4cd08d5b40fa343714fd P a10640a6ff9041f3adb4b5825db85735 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:28.617731 27012 raft_consensus.cc:2454] T 6f0d97d7f85c4cd08d5b40fa343714fd P a10640a6ff9041f3adb4b5825db85735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1df00320c8644126a1779e84089ef0e9 in term 1.
I20260807 22:40:28.617872 26551 raft_consensus.cc:2454] T 6f0d97d7f85c4cd08d5b40fa343714fd P 357bd21dd5404914a28864e0f0599b4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1df00320c8644126a1779e84089ef0e9 in term 1.
I20260807 22:40:28.617940 26663 leader_election.cc:302] T 6f0d97d7f85c4cd08d5b40fa343714fd P 1df00320c8644126a1779e84089ef0e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1df00320c8644126a1779e84089ef0e9, a10640a6ff9041f3adb4b5825db85735; no voters:
I20260807 22:40:28.618098 27117 raft_consensus.cc:2781] T 6f0d97d7f85c4cd08d5b40fa343714fd P 1df00320c8644126a1779e84089ef0e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:40:28.618290 27117 raft_consensus.cc:686] T 6f0d97d7f85c4cd08d5b40fa343714fd P 1df00320c8644126a1779e84089ef0e9 [term 1 LEADER]: Becoming Leader. State: Replica: 1df00320c8644126a1779e84089ef0e9, State: Running, Role: LEADER
I20260807 22:40:28.618399 27117 consensus_queue.cc:237] T 6f0d97d7f85c4cd08d5b40fa343714fd P 1df00320c8644126a1779e84089ef0e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } }
I20260807 22:40:28.618841 27144 tablet_replica.cc:439] T 6f0d97d7f85c4cd08d5b40fa343714fd P 1df00320c8644126a1779e84089ef0e9: TxnStatusTablet state changed. Reason: New leader 1df00320c8644126a1779e84089ef0e9. Latest consensus state: current_term: 1 leader_uuid: "1df00320c8644126a1779e84089ef0e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } } }
I20260807 22:40:28.618924 27144 tablet_replica.cc:442] T 6f0d97d7f85c4cd08d5b40fa343714fd P 1df00320c8644126a1779e84089ef0e9: This TxnStatusTablet replica's current role is: LEADER
I20260807 22:40:28.619102 27148 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 22:40:28.619228 27148 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 22:40:28.619235 26273 catalog_manager.cc:5495] T 6f0d97d7f85c4cd08d5b40fa343714fd P 1df00320c8644126a1779e84089ef0e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1df00320c8644126a1779e84089ef0e9 (127.22.212.66). New cstate: current_term: 1 leader_uuid: "1df00320c8644126a1779e84089ef0e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } health_report { overall_health: UNKNOWN } } }
I20260807 22:40:28.642297 27136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:28.639533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.66:34649 (local address 127.0.0.1:42410)
0807 22:40:28.639611 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:28.639625 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:28.639681 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:28.639857 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:28.639858 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:28.639859 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 22:40:28.639912 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:28.639915 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.640690 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.640691 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:28.641271 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:28.641273 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.641702 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.641704 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:28.641774 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:28.641829 (+ 55us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 22:40:28.642111 (+ 282us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 22:40:28.642122 (+ 11us) client_negotiation.cc:769] Sending connection context
0807 22:40:28.642168 (+ 46us) client_negotiation.cc:240] Negotiation successful
0807 22:40:28.642220 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260807 22:40:28.642297 27108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:28.639591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42410 (local address 127.22.212.66:34649)
0807 22:40:28.639649 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:28.639651 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:28.639661 (+ 10us) server_negotiation.cc:407] Connection header received
0807 22:40:28.639759 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:28.639760 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:28.639780 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:28.639843 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:40:28.639988 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.640602 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.641359 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.641624 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.641703 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:28.641915 (+ 212us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:40:28.642034 (+ 119us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:40:28.642122 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:28.642171 (+ 49us) server_negotiation.cc:299] Negotiation successful
0807 22:40:28.642193 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260807 22:40:28.644353 26551 raft_consensus.cc:1261] T 6f0d97d7f85c4cd08d5b40fa343714fd P 357bd21dd5404914a28864e0f0599b4a [term 1 FOLLOWER]: Refusing update from remote peer 1df00320c8644126a1779e84089ef0e9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:40:28.644707 27012 raft_consensus.cc:1261] T 6f0d97d7f85c4cd08d5b40fa343714fd P a10640a6ff9041f3adb4b5825db85735 [term 1 FOLLOWER]: Refusing update from remote peer 1df00320c8644126a1779e84089ef0e9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:40:28.645117 27144 consensus_queue.cc:1035] T 6f0d97d7f85c4cd08d5b40fa343714fd P 1df00320c8644126a1779e84089ef0e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:40:28.645246 27117 consensus_queue.cc:1035] T 6f0d97d7f85c4cd08d5b40fa343714fd P 1df00320c8644126a1779e84089ef0e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:40:28.646369 27124 tablet_replica.cc:439] T 6f0d97d7f85c4cd08d5b40fa343714fd P 357bd21dd5404914a28864e0f0599b4a: TxnStatusTablet state changed. Reason: New leader 1df00320c8644126a1779e84089ef0e9. Latest consensus state: current_term: 1 leader_uuid: "1df00320c8644126a1779e84089ef0e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } } }
I20260807 22:40:28.646474 27124 tablet_replica.cc:442] T 6f0d97d7f85c4cd08d5b40fa343714fd P 357bd21dd5404914a28864e0f0599b4a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:40:28.646425 27119 tablet_replica.cc:439] T 6f0d97d7f85c4cd08d5b40fa343714fd P a10640a6ff9041f3adb4b5825db85735: TxnStatusTablet state changed. Reason: New leader 1df00320c8644126a1779e84089ef0e9. Latest consensus state: current_term: 1 leader_uuid: "1df00320c8644126a1779e84089ef0e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } } }
I20260807 22:40:28.646502 27119 tablet_replica.cc:442] T 6f0d97d7f85c4cd08d5b40fa343714fd P a10640a6ff9041f3adb4b5825db85735: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:40:28.647531 27117 tablet_replica.cc:439] T 6f0d97d7f85c4cd08d5b40fa343714fd P 1df00320c8644126a1779e84089ef0e9: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1df00320c8644126a1779e84089ef0e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } } }
I20260807 22:40:28.647619 27117 tablet_replica.cc:442] T 6f0d97d7f85c4cd08d5b40fa343714fd P 1df00320c8644126a1779e84089ef0e9: This TxnStatusTablet replica's current role is: LEADER
I20260807 22:40:28.647799 27144 tablet_replica.cc:439] T 6f0d97d7f85c4cd08d5b40fa343714fd P 1df00320c8644126a1779e84089ef0e9: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1df00320c8644126a1779e84089ef0e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } } }
I20260807 22:40:28.647859 27144 tablet_replica.cc:442] T 6f0d97d7f85c4cd08d5b40fa343714fd P 1df00320c8644126a1779e84089ef0e9: This TxnStatusTablet replica's current role is: LEADER
I20260807 22:40:28.647857 27119 tablet_replica.cc:439] T 6f0d97d7f85c4cd08d5b40fa343714fd P a10640a6ff9041f3adb4b5825db85735: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1df00320c8644126a1779e84089ef0e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } } }
I20260807 22:40:28.647950 27119 tablet_replica.cc:442] T 6f0d97d7f85c4cd08d5b40fa343714fd P a10640a6ff9041f3adb4b5825db85735: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:40:28.648414 27124 tablet_replica.cc:439] T 6f0d97d7f85c4cd08d5b40fa343714fd P 357bd21dd5404914a28864e0f0599b4a: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1df00320c8644126a1779e84089ef0e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } } }
I20260807 22:40:28.648506 27124 tablet_replica.cc:442] T 6f0d97d7f85c4cd08d5b40fa343714fd P 357bd21dd5404914a28864e0f0599b4a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:40:28.648803 27153 mvcc.cc:205] Tried to move back new op lower bound from 7316039387724251136 to 7316039387621482496. Current Snapshot: MvccSnapshot[applied={T|T < 7316039387724251136 or (T in {7316039387724251136})}]
I20260807 22:40:28.649137 27154 mvcc.cc:205] Tried to move back new op lower bound from 7316039387724251136 to 7316039387621482496. Current Snapshot: MvccSnapshot[applied={T|T < 7316039387724251136}]
I20260807 22:40:28.649413 27155 mvcc.cc:205] Tried to move back new op lower bound from 7316039387724251136 to 7316039387621482496. Current Snapshot: MvccSnapshot[applied={T|T < 7316039387724251136 or (T in {7316039387724251136})}]
I20260807 22:40:28.652583 27110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:28.649870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50116 (local address 127.22.212.65:38139)
0807 22:40:28.649911 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:28.649913 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:28.649920 (+ 7us) server_negotiation.cc:407] Connection header received
0807 22:40:28.649946 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:28.649947 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:28.649966 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:28.650022 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:40:28.650205 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.650676 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.651785 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.651974 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.652030 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:28.652209 (+ 179us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:40:28.652365 (+ 156us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:40:28.652426 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:28.652496 (+ 70us) server_negotiation.cc:299] Negotiation successful
0807 22:40:28.652519 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260807 22:40:28.657500 27108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:28.655023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:47375 (local address 127.22.212.66:34649)
0807 22:40:28.655065 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:28.655067 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:28.655210 (+ 143us) server_negotiation.cc:407] Connection header received
0807 22:40:28.655284 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:28.655285 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:28.655296 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:28.655351 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:40:28.655494 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.655943 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.656786 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.656987 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.657062 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:28.657255 (+ 193us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:40:28.657291 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:40:28.657350 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:28.657411 (+ 61us) server_negotiation.cc:299] Negotiation successful
0807 22:40:28.657431 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 22:40:28.657541 27177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:28.654959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.66:34649 (local address 127.22.212.65:47375)
0807 22:40:28.655140 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:28.655149 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:28.655225 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:28.655354 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:28.655355 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:28.655357 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 22:40:28.655419 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:28.655420 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.656030 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.656031 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:28.656699 (+ 668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:28.656702 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.657063 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.657064 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:28.657134 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:28.657147 (+ 13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 22:40:28.657352 (+ 205us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 22:40:28.657354 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 22:40:28.657407 (+ 53us) client_negotiation.cc:240] Negotiation successful
0807 22:40:28.657449 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":84,"threads_started":1}
I20260807 22:40:28.659996 27012 raft_consensus.cc:1261] T ffa296f9adbe49c0b94bc82d468d7506 P a10640a6ff9041f3adb4b5825db85735 [term 1 FOLLOWER]: Refusing update from remote peer 357bd21dd5404914a28864e0f0599b4a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:40:28.660111 26778 raft_consensus.cc:1261] T ffa296f9adbe49c0b94bc82d468d7506 P 1df00320c8644126a1779e84089ef0e9 [term 1 FOLLOWER]: Refusing update from remote peer 357bd21dd5404914a28864e0f0599b4a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:40:28.660274 27126 consensus_queue.cc:1035] T ffa296f9adbe49c0b94bc82d468d7506 P 357bd21dd5404914a28864e0f0599b4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:40:28.660385 27124 consensus_queue.cc:1035] T ffa296f9adbe49c0b94bc82d468d7506 P 357bd21dd5404914a28864e0f0599b4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:40:28.669526 26860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:28.666535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:38139 (local address 127.22.212.66:45003)
0807 22:40:28.666608 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:28.666619 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:28.666667 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:28.666793 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:28.666793 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:28.666794 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 22:40:28.666871 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:28.666895 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.667665 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.667666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:28.668566 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:28.668569 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.669075 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.669076 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:28.669146 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:28.669167 (+ 21us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 22:40:28.669361 (+ 194us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 22:40:28.669364 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:40:28.669418 (+ 54us) client_negotiation.cc:240] Negotiation successful
0807 22:40:28.669461 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260807 22:40:28.669519 27110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:28.666576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:45003 (local address 127.22.212.65:38139)
0807 22:40:28.666613 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:28.666615 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:28.666650 (+ 35us) server_negotiation.cc:407] Connection header received
0807 22:40:28.666723 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:28.666724 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:28.666735 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:28.666789 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:40:28.666966 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.667533 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.668700 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.668979 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.669071 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:28.669263 (+ 192us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:40:28.669297 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:40:28.669360 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:28.669423 (+ 63us) server_negotiation.cc:299] Negotiation successful
0807 22:40:28.669444 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 22:40:28.679473 26272 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58722:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:40:28.679615 26272 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58722:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:40:28.680428 26272 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 024906e65af04e2cbec41a8143b2af24: Sending DeleteTablet for 3 replicas of tablet ffa296f9adbe49c0b94bc82d468d7506
I20260807 22:40:28.680845 26750 tablet_service.cc:1514] Processing DeleteTablet for tablet ffa296f9adbe49c0b94bc82d468d7506 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:28 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:42402
I20260807 22:40:28.681111 26510 tablet_service.cc:1514] Processing DeleteTablet for tablet ffa296f9adbe49c0b94bc82d468d7506 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:28 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:50100
I20260807 22:40:28.681187 26272 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58722:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:40:28.681331 26272 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:40:28.681313 26967 tablet_service.cc:1514] Processing DeleteTablet for tablet ffa296f9adbe49c0b94bc82d468d7506 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:28 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:58542
I20260807 22:40:28.681524 27188 tablet_replica.cc:330] T ffa296f9adbe49c0b94bc82d468d7506 P 1df00320c8644126a1779e84089ef0e9: stopping tablet replica
I20260807 22:40:28.681646 27188 raft_consensus.cc:2229] T ffa296f9adbe49c0b94bc82d468d7506 P 1df00320c8644126a1779e84089ef0e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:40:28.681708 27188 raft_consensus.cc:2258] T ffa296f9adbe49c0b94bc82d468d7506 P 1df00320c8644126a1779e84089ef0e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:28.682185 27188 ts_tablet_manager.cc:1905] T ffa296f9adbe49c0b94bc82d468d7506 P 1df00320c8644126a1779e84089ef0e9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:28.682996 26750 tablet_service.cc:1467] Processing CreateTablet for tablet 7d8d3e645ee649f18ace96f1ac5b9a05 (DEFAULT_TABLE table=test-table [id=387052db0dbd4739aff29144ba6d5f97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:28.683063 26967 tablet_service.cc:1467] Processing CreateTablet for tablet 7d8d3e645ee649f18ace96f1ac5b9a05 (DEFAULT_TABLE table=test-table [id=387052db0dbd4739aff29144ba6d5f97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:28.683130 26750 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d8d3e645ee649f18ace96f1ac5b9a05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:28.683168 26967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d8d3e645ee649f18ace96f1ac5b9a05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:28.684396 26510 tablet_service.cc:1467] Processing CreateTablet for tablet 7d8d3e645ee649f18ace96f1ac5b9a05 (DEFAULT_TABLE table=test-table [id=387052db0dbd4739aff29144ba6d5f97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:28.684526 26510 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d8d3e645ee649f18ace96f1ac5b9a05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:28.684505 27111 tablet_bootstrap.cc:492] T 7d8d3e645ee649f18ace96f1ac5b9a05 P 1df00320c8644126a1779e84089ef0e9: Bootstrap starting.
I20260807 22:40:28.684952 27111 tablet_bootstrap.cc:654] T 7d8d3e645ee649f18ace96f1ac5b9a05 P 1df00320c8644126a1779e84089ef0e9: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:28.685870 27188 ts_tablet_manager.cc:1918] T ffa296f9adbe49c0b94bc82d468d7506 P 1df00320c8644126a1779e84089ef0e9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 22:40:28.685963 27115 tablet_bootstrap.cc:492] T 7d8d3e645ee649f18ace96f1ac5b9a05 P 357bd21dd5404914a28864e0f0599b4a: Bootstrap starting.
I20260807 22:40:28.686414 27115 tablet_bootstrap.cc:654] T 7d8d3e645ee649f18ace96f1ac5b9a05 P 357bd21dd5404914a28864e0f0599b4a: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:28.686771 27188 log.cc:1196] T ffa296f9adbe49c0b94bc82d468d7506 P 1df00320c8644126a1779e84089ef0e9: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-1/wal/wals/ffa296f9adbe49c0b94bc82d468d7506
I20260807 22:40:28.687129 27188 ts_tablet_manager.cc:1939] T ffa296f9adbe49c0b94bc82d468d7506 P 1df00320c8644126a1779e84089ef0e9: Deleting consensus metadata
I20260807 22:40:28.687255 27112 tablet_bootstrap.cc:492] T 7d8d3e645ee649f18ace96f1ac5b9a05 P a10640a6ff9041f3adb4b5825db85735: Bootstrap starting.
I20260807 22:40:28.687566 26248 catalog_manager.cc:4841] TS 1df00320c8644126a1779e84089ef0e9 (127.22.212.66:34649): tablet ffa296f9adbe49c0b94bc82d468d7506 (table test-table [id=4991d3cb55024a498b16204377a02050]) successfully deleted
I20260807 22:40:28.687656 27112 tablet_bootstrap.cc:654] T 7d8d3e645ee649f18ace96f1ac5b9a05 P a10640a6ff9041f3adb4b5825db85735: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:28.688069 27115 tablet_bootstrap.cc:492] T 7d8d3e645ee649f18ace96f1ac5b9a05 P 357bd21dd5404914a28864e0f0599b4a: No bootstrap required, opened a new log
I20260807 22:40:28.688120 27115 ts_tablet_manager.cc:1397] T 7d8d3e645ee649f18ace96f1ac5b9a05 P 357bd21dd5404914a28864e0f0599b4a: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260807 22:40:28.688341 27115 raft_consensus.cc:348] T 7d8d3e645ee649f18ace96f1ac5b9a05 P 357bd21dd5404914a28864e0f0599b4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } }
I20260807 22:40:28.688434 27115 raft_consensus.cc:374] T 7d8d3e645ee649f18ace96f1ac5b9a05 P 357bd21dd5404914a28864e0f0599b4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:28.688462 27115 raft_consensus.cc:729] T 7d8d3e645ee649f18ace96f1ac5b9a05 P 357bd21dd5404914a28864e0f0599b4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 357bd21dd5404914a28864e0f0599b4a, State: Initialized, Role: FOLLOWER
I20260807 22:40:28.688505 27115 consensus_queue.cc:260] T 7d8d3e645ee649f18ace96f1ac5b9a05 P 357bd21dd5404914a28864e0f0599b4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } }
I20260807 22:40:28.688603 27115 ts_tablet_manager.cc:1428] T 7d8d3e645ee649f18ace96f1ac5b9a05 P 357bd21dd5404914a28864e0f0599b4a: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260807 22:40:28.689177 27112 tablet_bootstrap.cc:492] T 7d8d3e645ee649f18ace96f1ac5b9a05 P a10640a6ff9041f3adb4b5825db85735: No bootstrap required, opened a new log
I20260807 22:40:28.689235 27112 ts_tablet_manager.cc:1397] T 7d8d3e645ee649f18ace96f1ac5b9a05 P a10640a6ff9041f3adb4b5825db85735: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 22:40:28.689393 27112 raft_consensus.cc:348] T 7d8d3e645ee649f18ace96f1ac5b9a05 P a10640a6ff9041f3adb4b5825db85735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } }
I20260807 22:40:28.689478 27112 raft_consensus.cc:374] T 7d8d3e645ee649f18ace96f1ac5b9a05 P a10640a6ff9041f3adb4b5825db85735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:28.689507 27112 raft_consensus.cc:729] T 7d8d3e645ee649f18ace96f1ac5b9a05 P a10640a6ff9041f3adb4b5825db85735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a10640a6ff9041f3adb4b5825db85735, State: Initialized, Role: FOLLOWER
I20260807 22:40:28.689551 27112 consensus_queue.cc:260] T 7d8d3e645ee649f18ace96f1ac5b9a05 P a10640a6ff9041f3adb4b5825db85735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } }
I20260807 22:40:28.689664 27112 ts_tablet_manager.cc:1428] T 7d8d3e645ee649f18ace96f1ac5b9a05 P a10640a6ff9041f3adb4b5825db85735: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260807 22:40:28.689954 27190 tablet_replica.cc:330] T ffa296f9adbe49c0b94bc82d468d7506 P 357bd21dd5404914a28864e0f0599b4a: stopping tablet replica
I20260807 22:40:28.690073 27190 raft_consensus.cc:2229] T ffa296f9adbe49c0b94bc82d468d7506 P 357bd21dd5404914a28864e0f0599b4a [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:40:28.690196 27190 raft_consensus.cc:2258] T ffa296f9adbe49c0b94bc82d468d7506 P 357bd21dd5404914a28864e0f0599b4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:28.690368 27192 tablet_replica.cc:330] T ffa296f9adbe49c0b94bc82d468d7506 P a10640a6ff9041f3adb4b5825db85735: stopping tablet replica
I20260807 22:40:28.690578 27192 raft_consensus.cc:2229] T ffa296f9adbe49c0b94bc82d468d7506 P a10640a6ff9041f3adb4b5825db85735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:40:28.690653 27192 raft_consensus.cc:2258] T ffa296f9adbe49c0b94bc82d468d7506 P a10640a6ff9041f3adb4b5825db85735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:28.691192 27192 ts_tablet_manager.cc:1905] T ffa296f9adbe49c0b94bc82d468d7506 P a10640a6ff9041f3adb4b5825db85735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:28.692510 27190 ts_tablet_manager.cc:1905] T ffa296f9adbe49c0b94bc82d468d7506 P 357bd21dd5404914a28864e0f0599b4a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:28.692793 27192 ts_tablet_manager.cc:1918] T ffa296f9adbe49c0b94bc82d468d7506 P a10640a6ff9041f3adb4b5825db85735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 22:40:28.693164 27192 log.cc:1196] T ffa296f9adbe49c0b94bc82d468d7506 P a10640a6ff9041f3adb4b5825db85735: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-2/wal/wals/ffa296f9adbe49c0b94bc82d468d7506
I20260807 22:40:28.693478 27192 ts_tablet_manager.cc:1939] T ffa296f9adbe49c0b94bc82d468d7506 P a10640a6ff9041f3adb4b5825db85735: Deleting consensus metadata
I20260807 22:40:28.693915 26243 catalog_manager.cc:4841] TS a10640a6ff9041f3adb4b5825db85735 (127.22.212.67:37069): tablet ffa296f9adbe49c0b94bc82d468d7506 (table test-table [id=4991d3cb55024a498b16204377a02050]) successfully deleted
I20260807 22:40:28.694482 27190 ts_tablet_manager.cc:1918] T ffa296f9adbe49c0b94bc82d468d7506 P 357bd21dd5404914a28864e0f0599b4a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 22:40:28.694576 27190 log.cc:1196] T ffa296f9adbe49c0b94bc82d468d7506 P 357bd21dd5404914a28864e0f0599b4a: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-0/wal/wals/ffa296f9adbe49c0b94bc82d468d7506
I20260807 22:40:28.694816 27190 ts_tablet_manager.cc:1939] T ffa296f9adbe49c0b94bc82d468d7506 P 357bd21dd5404914a28864e0f0599b4a: Deleting consensus metadata
I20260807 22:40:28.695225 26247 catalog_manager.cc:4841] TS 357bd21dd5404914a28864e0f0599b4a (127.22.212.65:38139): tablet ffa296f9adbe49c0b94bc82d468d7506 (table test-table [id=4991d3cb55024a498b16204377a02050]) successfully deleted
I20260807 22:40:28.696636 27111 tablet_bootstrap.cc:492] T 7d8d3e645ee649f18ace96f1ac5b9a05 P 1df00320c8644126a1779e84089ef0e9: No bootstrap required, opened a new log
I20260807 22:40:28.696707 27111 ts_tablet_manager.cc:1397] T 7d8d3e645ee649f18ace96f1ac5b9a05 P 1df00320c8644126a1779e84089ef0e9: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.000s
I20260807 22:40:28.696823 27111 raft_consensus.cc:348] T 7d8d3e645ee649f18ace96f1ac5b9a05 P 1df00320c8644126a1779e84089ef0e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } }
I20260807 22:40:28.696910 27111 raft_consensus.cc:374] T 7d8d3e645ee649f18ace96f1ac5b9a05 P 1df00320c8644126a1779e84089ef0e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:28.696938 27111 raft_consensus.cc:729] T 7d8d3e645ee649f18ace96f1ac5b9a05 P 1df00320c8644126a1779e84089ef0e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1df00320c8644126a1779e84089ef0e9, State: Initialized, Role: FOLLOWER
I20260807 22:40:28.696981 27111 consensus_queue.cc:260] T 7d8d3e645ee649f18ace96f1ac5b9a05 P 1df00320c8644126a1779e84089ef0e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } }
I20260807 22:40:28.697082 27111 ts_tablet_manager.cc:1428] T 7d8d3e645ee649f18ace96f1ac5b9a05 P 1df00320c8644126a1779e84089ef0e9: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260807 22:40:28.716187 27119 raft_consensus.cc:482] T 7d8d3e645ee649f18ace96f1ac5b9a05 P a10640a6ff9041f3adb4b5825db85735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:40:28.716328 27119 raft_consensus.cc:504] T 7d8d3e645ee649f18ace96f1ac5b9a05 P a10640a6ff9041f3adb4b5825db85735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } }
I20260807 22:40:28.716826 27119 leader_election.cc:288] T 7d8d3e645ee649f18ace96f1ac5b9a05 P a10640a6ff9041f3adb4b5825db85735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 357bd21dd5404914a28864e0f0599b4a (127.22.212.65:38139), 1df00320c8644126a1779e84089ef0e9 (127.22.212.66:34649)
I20260807 22:40:28.720886 26910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:28.716978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:38139 (local address 127.22.212.67:34229)
0807 22:40:28.717166 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:28.717177 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:28.717237 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:28.717418 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:28.717420 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:28.717421 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:28.717499 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:28.717501 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.718624 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.718625 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:28.719783 (+ 1158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:28.719785 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.720619 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.720620 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:28.720701 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:28.720704 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:40:28.720750 (+ 46us) client_negotiation.cc:240] Negotiation successful
0807 22:40:28.720786 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173}
I20260807 22:40:28.721200 27108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:28.717384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:49925 (local address 127.22.212.66:34649)
0807 22:40:28.717589 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:28.717590 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:28.717597 (+ 7us) server_negotiation.cc:407] Connection header received
0807 22:40:28.717622 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:28.717623 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:28.717630 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:28.717686 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:28.718215 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.718934 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.720310 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.720815 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.720855 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:28.720862 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:28.721104 (+ 242us) server_negotiation.cc:299] Negotiation successful
0807 22:40:28.721143 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179}
I20260807 22:40:28.721443 27198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:28.717060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.66:34649 (local address 127.22.212.67:49925)
0807 22:40:28.717464 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:28.717476 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:28.717523 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:28.717698 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:28.717699 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:28.717700 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:28.718115 (+ 415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:28.718118 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.719078 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.719079 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:28.720187 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:28.720189 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.720935 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.720935 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:28.721013 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:28.721018 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 22:40:28.721313 (+ 295us) client_negotiation.cc:240] Negotiation successful
0807 22:40:28.721351 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":390,"thread_start_us":68,"threads_started":1}
I20260807 22:40:28.721511 27110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:28.717082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:34229 (local address 127.22.212.65:38139)
0807 22:40:28.717134 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:28.717137 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:28.717223 (+ 86us) server_negotiation.cc:407] Connection header received
0807 22:40:28.717293 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:28.717295 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:28.717305 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:28.717354 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:28.717738 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.718517 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.719882 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.720521 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.720582 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:28.720590 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:28.721383 (+ 793us) server_negotiation.cc:299] Negotiation successful
0807 22:40:28.721428 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260807 22:40:28.721680 26778 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d8d3e645ee649f18ace96f1ac5b9a05" candidate_uuid: "a10640a6ff9041f3adb4b5825db85735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1df00320c8644126a1779e84089ef0e9" is_pre_election: true
I20260807 22:40:28.721705 26551 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d8d3e645ee649f18ace96f1ac5b9a05" candidate_uuid: "a10640a6ff9041f3adb4b5825db85735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "357bd21dd5404914a28864e0f0599b4a" is_pre_election: true
I20260807 22:40:28.721768 26778 raft_consensus.cc:2454] T 7d8d3e645ee649f18ace96f1ac5b9a05 P 1df00320c8644126a1779e84089ef0e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a10640a6ff9041f3adb4b5825db85735 in term 0.
I20260807 22:40:28.721776 26551 raft_consensus.cc:2454] T 7d8d3e645ee649f18ace96f1ac5b9a05 P 357bd21dd5404914a28864e0f0599b4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a10640a6ff9041f3adb4b5825db85735 in term 0.
I20260807 22:40:28.721956 26894 leader_election.cc:302] T 7d8d3e645ee649f18ace96f1ac5b9a05 P a10640a6ff9041f3adb4b5825db85735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1df00320c8644126a1779e84089ef0e9, a10640a6ff9041f3adb4b5825db85735; no voters:
I20260807 22:40:28.722088 27119 raft_consensus.cc:2781] T 7d8d3e645ee649f18ace96f1ac5b9a05 P a10640a6ff9041f3adb4b5825db85735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:40:28.722134 27119 raft_consensus.cc:482] T 7d8d3e645ee649f18ace96f1ac5b9a05 P a10640a6ff9041f3adb4b5825db85735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:40:28.722154 27119 raft_consensus.cc:3037] T 7d8d3e645ee649f18ace96f1ac5b9a05 P a10640a6ff9041f3adb4b5825db85735 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:28.723276 27119 raft_consensus.cc:504] T 7d8d3e645ee649f18ace96f1ac5b9a05 P a10640a6ff9041f3adb4b5825db85735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } }
I20260807 22:40:28.723438 27119 leader_election.cc:288] T 7d8d3e645ee649f18ace96f1ac5b9a05 P a10640a6ff9041f3adb4b5825db85735 [CANDIDATE]: Term 1 election: Requested vote from peers 357bd21dd5404914a28864e0f0599b4a (127.22.212.65:38139), 1df00320c8644126a1779e84089ef0e9 (127.22.212.66:34649)
I20260807 22:40:28.723628 26778 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d8d3e645ee649f18ace96f1ac5b9a05" candidate_uuid: "a10640a6ff9041f3adb4b5825db85735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1df00320c8644126a1779e84089ef0e9"
I20260807 22:40:28.723642 26551 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d8d3e645ee649f18ace96f1ac5b9a05" candidate_uuid: "a10640a6ff9041f3adb4b5825db85735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "357bd21dd5404914a28864e0f0599b4a"
I20260807 22:40:28.723701 26778 raft_consensus.cc:3037] T 7d8d3e645ee649f18ace96f1ac5b9a05 P 1df00320c8644126a1779e84089ef0e9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:28.723706 26551 raft_consensus.cc:3037] T 7d8d3e645ee649f18ace96f1ac5b9a05 P 357bd21dd5404914a28864e0f0599b4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:28.724586 26778 raft_consensus.cc:2454] T 7d8d3e645ee649f18ace96f1ac5b9a05 P 1df00320c8644126a1779e84089ef0e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a10640a6ff9041f3adb4b5825db85735 in term 1.
I20260807 22:40:28.724720 26551 raft_consensus.cc:2454] T 7d8d3e645ee649f18ace96f1ac5b9a05 P 357bd21dd5404914a28864e0f0599b4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a10640a6ff9041f3adb4b5825db85735 in term 1.
I20260807 22:40:28.724781 26894 leader_election.cc:302] T 7d8d3e645ee649f18ace96f1ac5b9a05 P a10640a6ff9041f3adb4b5825db85735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1df00320c8644126a1779e84089ef0e9, a10640a6ff9041f3adb4b5825db85735; no voters:
I20260807 22:40:28.724869 27119 raft_consensus.cc:2781] T 7d8d3e645ee649f18ace96f1ac5b9a05 P a10640a6ff9041f3adb4b5825db85735 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:40:28.724984 27119 raft_consensus.cc:686] T 7d8d3e645ee649f18ace96f1ac5b9a05 P a10640a6ff9041f3adb4b5825db85735 [term 1 LEADER]: Becoming Leader. State: Replica: a10640a6ff9041f3adb4b5825db85735, State: Running, Role: LEADER
I20260807 22:40:28.725055 27119 consensus_queue.cc:237] T 7d8d3e645ee649f18ace96f1ac5b9a05 P a10640a6ff9041f3adb4b5825db85735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } }
I20260807 22:40:28.725792 26272 catalog_manager.cc:5495] T 7d8d3e645ee649f18ace96f1ac5b9a05 P a10640a6ff9041f3adb4b5825db85735 reported cstate change: term changed from 0 to 1, leader changed from <none> to a10640a6ff9041f3adb4b5825db85735 (127.22.212.67). New cstate: current_term: 1 leader_uuid: "a10640a6ff9041f3adb4b5825db85735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } health_report { overall_health: HEALTHY } } }
I20260807 22:40:28.739288 27109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:28.736824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58544 (local address 127.22.212.67:37069)
0807 22:40:28.736865 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:28.736867 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:28.736875 (+ 8us) server_negotiation.cc:407] Connection header received
0807 22:40:28.736937 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:28.736938 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:28.736960 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:28.737055 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:40:28.737160 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.737686 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.738447 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.738662 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.738739 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:28.738927 (+ 188us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:40:28.739053 (+ 126us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:40:28.739137 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:28.739183 (+ 46us) server_negotiation.cc:299] Negotiation successful
0807 22:40:28.739205 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 22:40:28.744408 27091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:28.741821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.66:34649 (local address 127.22.212.67:37473)
0807 22:40:28.741901 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:28.741916 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:28.741969 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:28.742133 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:28.742134 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:28.742136 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 22:40:28.742201 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:28.742203 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.742866 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.742867 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:28.743573 (+ 706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:28.743576 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.743941 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.743942 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:28.744007 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:28.744030 (+ 23us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 22:40:28.744220 (+ 190us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 22:40:28.744221 (+ 1us) client_negotiation.cc:769] Sending connection context
0807 22:40:28.744301 (+ 80us) client_negotiation.cc:240] Negotiation successful
0807 22:40:28.744345 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260807 22:40:28.744403 27108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:28.741904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:37473 (local address 127.22.212.66:34649)
0807 22:40:28.741959 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:28.741961 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:28.741970 (+ 9us) server_negotiation.cc:407] Connection header received
0807 22:40:28.742044 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:28.742044 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:28.742070 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:28.742130 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:40:28.742276 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.742789 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.743645 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.743854 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.743940 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:28.744126 (+ 186us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:40:28.744158 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:40:28.744209 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:28.744306 (+ 97us) server_negotiation.cc:299] Negotiation successful
0807 22:40:28.744328 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260807 22:40:28.746968 26551 raft_consensus.cc:1261] T 7d8d3e645ee649f18ace96f1ac5b9a05 P 357bd21dd5404914a28864e0f0599b4a [term 1 FOLLOWER]: Refusing update from remote peer a10640a6ff9041f3adb4b5825db85735: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:40:28.747080 26778 raft_consensus.cc:1261] T 7d8d3e645ee649f18ace96f1ac5b9a05 P 1df00320c8644126a1779e84089ef0e9 [term 1 FOLLOWER]: Refusing update from remote peer a10640a6ff9041f3adb4b5825db85735: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:40:28.747282 27119 consensus_queue.cc:1035] T 7d8d3e645ee649f18ace96f1ac5b9a05 P a10640a6ff9041f3adb4b5825db85735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:40:28.747566 27200 consensus_queue.cc:1035] T 7d8d3e645ee649f18ace96f1ac5b9a05 P a10640a6ff9041f3adb4b5825db85735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:40:28.756019 26860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:28.753072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.67:37069 (local address 127.22.212.66:36791)
0807 22:40:28.753157 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:28.753169 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:28.753208 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:28.753467 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:28.753469 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:28.753470 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 22:40:28.753514 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:28.753515 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.754317 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.754318 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:28.755129 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:28.755133 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.755615 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.755616 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:28.755671 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:28.755676 (+ 5us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 22:40:28.755869 (+ 193us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 22:40:28.755872 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:40:28.755910 (+ 38us) client_negotiation.cc:240] Negotiation successful
0807 22:40:28.755956 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64}
I20260807 22:40:28.756017 27109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:28.753282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:36791 (local address 127.22.212.67:37069)
0807 22:40:28.753323 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:28.753326 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:28.753333 (+ 7us) server_negotiation.cc:407] Connection header received
0807 22:40:28.753353 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:28.753353 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:28.753362 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:28.753410 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:40:28.753586 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.754217 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.755230 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:28.755520 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:28.755581 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:28.755772 (+ 191us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:40:28.755804 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:40:28.755854 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:28.755922 (+ 68us) server_negotiation.cc:299] Negotiation successful
0807 22:40:28.755939 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
W20260807 22:40:28.756619 27155 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260807 22:40:30.279047 26272 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58722:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:40:30.279151 26272 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58722:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:40:30.280200 26272 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 024906e65af04e2cbec41a8143b2af24: Sending DeleteTablet for 3 replicas of tablet 7d8d3e645ee649f18ace96f1ac5b9a05
I20260807 22:40:30.280534 26510 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d8d3e645ee649f18ace96f1ac5b9a05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:30 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:50100
I20260807 22:40:30.280571 26750 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d8d3e645ee649f18ace96f1ac5b9a05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:30 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:42402
I20260807 22:40:30.280818 27249 tablet_replica.cc:330] T 7d8d3e645ee649f18ace96f1ac5b9a05 P 357bd21dd5404914a28864e0f0599b4a: stopping tablet replica
I20260807 22:40:30.280805 26967 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d8d3e645ee649f18ace96f1ac5b9a05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:30 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:58542
I20260807 22:40:30.280902 27249 raft_consensus.cc:2229] T 7d8d3e645ee649f18ace96f1ac5b9a05 P 357bd21dd5404914a28864e0f0599b4a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:40:30.280951 27249 raft_consensus.cc:2258] T 7d8d3e645ee649f18ace96f1ac5b9a05 P 357bd21dd5404914a28864e0f0599b4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:30.281076 27248 tablet_replica.cc:330] T 7d8d3e645ee649f18ace96f1ac5b9a05 P 1df00320c8644126a1779e84089ef0e9: stopping tablet replica
I20260807 22:40:30.281147 27248 raft_consensus.cc:2229] T 7d8d3e645ee649f18ace96f1ac5b9a05 P 1df00320c8644126a1779e84089ef0e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:40:30.281196 27248 raft_consensus.cc:2258] T 7d8d3e645ee649f18ace96f1ac5b9a05 P 1df00320c8644126a1779e84089ef0e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:30.281349 27249 ts_tablet_manager.cc:1905] T 7d8d3e645ee649f18ace96f1ac5b9a05 P 357bd21dd5404914a28864e0f0599b4a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:30.281451 27248 ts_tablet_manager.cc:1905] T 7d8d3e645ee649f18ace96f1ac5b9a05 P 1df00320c8644126a1779e84089ef0e9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:30.283474 27248 ts_tablet_manager.cc:1918] T 7d8d3e645ee649f18ace96f1ac5b9a05 P 1df00320c8644126a1779e84089ef0e9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 22:40:30.283483 27249 ts_tablet_manager.cc:1918] T 7d8d3e645ee649f18ace96f1ac5b9a05 P 357bd21dd5404914a28864e0f0599b4a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 22:40:30.283560 27248 log.cc:1196] T 7d8d3e645ee649f18ace96f1ac5b9a05 P 1df00320c8644126a1779e84089ef0e9: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-1/wal/wals/7d8d3e645ee649f18ace96f1ac5b9a05
I20260807 22:40:30.283697 27249 log.cc:1196] T 7d8d3e645ee649f18ace96f1ac5b9a05 P 357bd21dd5404914a28864e0f0599b4a: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-0/wal/wals/7d8d3e645ee649f18ace96f1ac5b9a05
I20260807 22:40:30.283823 27248 ts_tablet_manager.cc:1939] T 7d8d3e645ee649f18ace96f1ac5b9a05 P 1df00320c8644126a1779e84089ef0e9: Deleting consensus metadata
I20260807 22:40:30.283927 27250 tablet_replica.cc:330] T 7d8d3e645ee649f18ace96f1ac5b9a05 P a10640a6ff9041f3adb4b5825db85735: stopping tablet replica
I20260807 22:40:30.284000 27250 raft_consensus.cc:2229] T 7d8d3e645ee649f18ace96f1ac5b9a05 P a10640a6ff9041f3adb4b5825db85735 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:40:30.284080 27249 ts_tablet_manager.cc:1939] T 7d8d3e645ee649f18ace96f1ac5b9a05 P 357bd21dd5404914a28864e0f0599b4a: Deleting consensus metadata
I20260807 22:40:30.284111 27250 raft_consensus.cc:2258] T 7d8d3e645ee649f18ace96f1ac5b9a05 P a10640a6ff9041f3adb4b5825db85735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:30.284226 26248 catalog_manager.cc:4841] TS 1df00320c8644126a1779e84089ef0e9 (127.22.212.66:34649): tablet 7d8d3e645ee649f18ace96f1ac5b9a05 (table test-table [id=387052db0dbd4739aff29144ba6d5f97]) successfully deleted
I20260807 22:40:30.284395 27250 ts_tablet_manager.cc:1905] T 7d8d3e645ee649f18ace96f1ac5b9a05 P a10640a6ff9041f3adb4b5825db85735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:30.284435 26247 catalog_manager.cc:4841] TS 357bd21dd5404914a28864e0f0599b4a (127.22.212.65:38139): tablet 7d8d3e645ee649f18ace96f1ac5b9a05 (table test-table [id=387052db0dbd4739aff29144ba6d5f97]) successfully deleted
I20260807 22:40:30.285758 27250 ts_tablet_manager.cc:1918] T 7d8d3e645ee649f18ace96f1ac5b9a05 P a10640a6ff9041f3adb4b5825db85735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 22:40:30.285807 27250 log.cc:1196] T 7d8d3e645ee649f18ace96f1ac5b9a05 P a10640a6ff9041f3adb4b5825db85735: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-2/wal/wals/7d8d3e645ee649f18ace96f1ac5b9a05
I20260807 22:40:30.286047 27250 ts_tablet_manager.cc:1939] T 7d8d3e645ee649f18ace96f1ac5b9a05 P a10640a6ff9041f3adb4b5825db85735: Deleting consensus metadata
I20260807 22:40:30.286399 26243 catalog_manager.cc:4841] TS a10640a6ff9041f3adb4b5825db85735 (127.22.212.67:37069): tablet 7d8d3e645ee649f18ace96f1ac5b9a05 (table test-table [id=387052db0dbd4739aff29144ba6d5f97]) successfully deleted
Aug 07 22:40:30 dist-test-slave-2d19 krb5kdc[26184](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142430, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 22:40:30 dist-test-slave-2d19 krb5kdc[26184](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142430, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:40:30.307137 27260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:30.299694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58744 (local address 127.22.212.126:39363)
0807 22:40:30.299871 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:30.299873 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:30.299898 (+ 25us) server_negotiation.cc:407] Connection header received
0807 22:40:30.299974 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:30.299974 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:30.299986 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:30.300082 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:30.300705 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:30.301287 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:30.301971 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:30.302199 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:30.302255 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:30.304560 (+ 2305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:30.304562 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:30.304562 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:30.304569 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:30.305981 (+ 1412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:30.306313 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:30.306314 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:30.306315 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:30.306380 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:30.306619 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:30.306620 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:30.306621 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:30.306735 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:30.306821 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:30.306958 (+ 137us) server_negotiation.cc:299] Negotiation successful
0807 22:40:30.307062 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":96,"threads_started":1}
I20260807 22:40:30.308682 26272 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58744:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:40:30.308857 26272 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:40:30.310392 26510 tablet_service.cc:1467] Processing CreateTablet for tablet 81d931f710fd412091e8d34d46656188 (DEFAULT_TABLE table=test-table [id=5b91630685244c249c658abc7ceac09d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:30.310432 26967 tablet_service.cc:1467] Processing CreateTablet for tablet 81d931f710fd412091e8d34d46656188 (DEFAULT_TABLE table=test-table [id=5b91630685244c249c658abc7ceac09d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:30.310576 26510 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81d931f710fd412091e8d34d46656188. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:30.310590 26967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81d931f710fd412091e8d34d46656188. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:30.311620 27264 tablet_bootstrap.cc:492] T 81d931f710fd412091e8d34d46656188 P 357bd21dd5404914a28864e0f0599b4a: Bootstrap starting.
I20260807 22:40:30.311755 26750 tablet_service.cc:1467] Processing CreateTablet for tablet 81d931f710fd412091e8d34d46656188 (DEFAULT_TABLE table=test-table [id=5b91630685244c249c658abc7ceac09d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:30.311807 27265 tablet_bootstrap.cc:492] T 81d931f710fd412091e8d34d46656188 P a10640a6ff9041f3adb4b5825db85735: Bootstrap starting.
I20260807 22:40:30.311918 26750 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81d931f710fd412091e8d34d46656188. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:30.312080 27264 tablet_bootstrap.cc:654] T 81d931f710fd412091e8d34d46656188 P 357bd21dd5404914a28864e0f0599b4a: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:30.312291 27265 tablet_bootstrap.cc:654] T 81d931f710fd412091e8d34d46656188 P a10640a6ff9041f3adb4b5825db85735: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:30.312754 27264 tablet_bootstrap.cc:492] T 81d931f710fd412091e8d34d46656188 P 357bd21dd5404914a28864e0f0599b4a: No bootstrap required, opened a new log
I20260807 22:40:30.312826 27264 ts_tablet_manager.cc:1397] T 81d931f710fd412091e8d34d46656188 P 357bd21dd5404914a28864e0f0599b4a: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260807 22:40:30.312958 27264 raft_consensus.cc:348] T 81d931f710fd412091e8d34d46656188 P 357bd21dd5404914a28864e0f0599b4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } }
I20260807 22:40:30.313033 27265 tablet_bootstrap.cc:492] T 81d931f710fd412091e8d34d46656188 P a10640a6ff9041f3adb4b5825db85735: No bootstrap required, opened a new log
I20260807 22:40:30.313053 27264 raft_consensus.cc:374] T 81d931f710fd412091e8d34d46656188 P 357bd21dd5404914a28864e0f0599b4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:30.313079 27264 raft_consensus.cc:729] T 81d931f710fd412091e8d34d46656188 P 357bd21dd5404914a28864e0f0599b4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 357bd21dd5404914a28864e0f0599b4a, State: Initialized, Role: FOLLOWER
I20260807 22:40:30.313077 27265 ts_tablet_manager.cc:1397] T 81d931f710fd412091e8d34d46656188 P a10640a6ff9041f3adb4b5825db85735: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260807 22:40:30.313130 27264 consensus_queue.cc:260] T 81d931f710fd412091e8d34d46656188 P 357bd21dd5404914a28864e0f0599b4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } }
I20260807 22:40:30.313184 27265 raft_consensus.cc:348] T 81d931f710fd412091e8d34d46656188 P a10640a6ff9041f3adb4b5825db85735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } }
I20260807 22:40:30.313268 27265 raft_consensus.cc:374] T 81d931f710fd412091e8d34d46656188 P a10640a6ff9041f3adb4b5825db85735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:30.313293 27265 raft_consensus.cc:729] T 81d931f710fd412091e8d34d46656188 P a10640a6ff9041f3adb4b5825db85735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a10640a6ff9041f3adb4b5825db85735, State: Initialized, Role: FOLLOWER
I20260807 22:40:30.313309 27264 ts_tablet_manager.cc:1428] T 81d931f710fd412091e8d34d46656188 P 357bd21dd5404914a28864e0f0599b4a: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260807 22:40:30.313335 27265 consensus_queue.cc:260] T 81d931f710fd412091e8d34d46656188 P a10640a6ff9041f3adb4b5825db85735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } }
I20260807 22:40:30.313470 27265 ts_tablet_manager.cc:1428] T 81d931f710fd412091e8d34d46656188 P a10640a6ff9041f3adb4b5825db85735: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:30.313968 27269 tablet_bootstrap.cc:492] T 81d931f710fd412091e8d34d46656188 P 1df00320c8644126a1779e84089ef0e9: Bootstrap starting.
I20260807 22:40:30.314436 27269 tablet_bootstrap.cc:654] T 81d931f710fd412091e8d34d46656188 P 1df00320c8644126a1779e84089ef0e9: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:30.315174 27269 tablet_bootstrap.cc:492] T 81d931f710fd412091e8d34d46656188 P 1df00320c8644126a1779e84089ef0e9: No bootstrap required, opened a new log
I20260807 22:40:30.315248 27269 ts_tablet_manager.cc:1397] T 81d931f710fd412091e8d34d46656188 P 1df00320c8644126a1779e84089ef0e9: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 22:40:30.315369 27269 raft_consensus.cc:348] T 81d931f710fd412091e8d34d46656188 P 1df00320c8644126a1779e84089ef0e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } }
I20260807 22:40:30.315460 27269 raft_consensus.cc:374] T 81d931f710fd412091e8d34d46656188 P 1df00320c8644126a1779e84089ef0e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:30.315495 27269 raft_consensus.cc:729] T 81d931f710fd412091e8d34d46656188 P 1df00320c8644126a1779e84089ef0e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1df00320c8644126a1779e84089ef0e9, State: Initialized, Role: FOLLOWER
I20260807 22:40:30.315559 27269 consensus_queue.cc:260] T 81d931f710fd412091e8d34d46656188 P 1df00320c8644126a1779e84089ef0e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } }
I20260807 22:40:30.315668 27269 ts_tablet_manager.cc:1428] T 81d931f710fd412091e8d34d46656188 P 1df00320c8644126a1779e84089ef0e9: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
W20260807 22:40:30.418829 26850 tablet.cc:2369] T 81d931f710fd412091e8d34d46656188 P 1df00320c8644126a1779e84089ef0e9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:40:30.594511 27268 raft_consensus.cc:482] T 81d931f710fd412091e8d34d46656188 P 357bd21dd5404914a28864e0f0599b4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:40:30.594619 27268 raft_consensus.cc:504] T 81d931f710fd412091e8d34d46656188 P 357bd21dd5404914a28864e0f0599b4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } }
I20260807 22:40:30.594810 27268 leader_election.cc:288] T 81d931f710fd412091e8d34d46656188 P 357bd21dd5404914a28864e0f0599b4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1df00320c8644126a1779e84089ef0e9 (127.22.212.66:34649), a10640a6ff9041f3adb4b5825db85735 (127.22.212.67:37069)
I20260807 22:40:30.595021 26778 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81d931f710fd412091e8d34d46656188" candidate_uuid: "357bd21dd5404914a28864e0f0599b4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1df00320c8644126a1779e84089ef0e9" is_pre_election: true
I20260807 22:40:30.595115 26778 raft_consensus.cc:2454] T 81d931f710fd412091e8d34d46656188 P 1df00320c8644126a1779e84089ef0e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 357bd21dd5404914a28864e0f0599b4a in term 0.
I20260807 22:40:30.595059 27012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81d931f710fd412091e8d34d46656188" candidate_uuid: "357bd21dd5404914a28864e0f0599b4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10640a6ff9041f3adb4b5825db85735" is_pre_election: true
I20260807 22:40:30.595192 27012 raft_consensus.cc:2454] T 81d931f710fd412091e8d34d46656188 P a10640a6ff9041f3adb4b5825db85735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 357bd21dd5404914a28864e0f0599b4a in term 0.
I20260807 22:40:30.595295 26441 leader_election.cc:302] T 81d931f710fd412091e8d34d46656188 P 357bd21dd5404914a28864e0f0599b4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1df00320c8644126a1779e84089ef0e9, 357bd21dd5404914a28864e0f0599b4a; no voters:
I20260807 22:40:30.595398 27268 raft_consensus.cc:2781] T 81d931f710fd412091e8d34d46656188 P 357bd21dd5404914a28864e0f0599b4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:40:30.595438 27268 raft_consensus.cc:482] T 81d931f710fd412091e8d34d46656188 P 357bd21dd5404914a28864e0f0599b4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:40:30.595467 27268 raft_consensus.cc:3037] T 81d931f710fd412091e8d34d46656188 P 357bd21dd5404914a28864e0f0599b4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:30.596154 27268 raft_consensus.cc:504] T 81d931f710fd412091e8d34d46656188 P 357bd21dd5404914a28864e0f0599b4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } }
I20260807 22:40:30.596323 27268 leader_election.cc:288] T 81d931f710fd412091e8d34d46656188 P 357bd21dd5404914a28864e0f0599b4a [CANDIDATE]: Term 1 election: Requested vote from peers 1df00320c8644126a1779e84089ef0e9 (127.22.212.66:34649), a10640a6ff9041f3adb4b5825db85735 (127.22.212.67:37069)
I20260807 22:40:30.596484 26778 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81d931f710fd412091e8d34d46656188" candidate_uuid: "357bd21dd5404914a28864e0f0599b4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1df00320c8644126a1779e84089ef0e9"
I20260807 22:40:30.596503 27012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81d931f710fd412091e8d34d46656188" candidate_uuid: "357bd21dd5404914a28864e0f0599b4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10640a6ff9041f3adb4b5825db85735"
I20260807 22:40:30.596594 27012 raft_consensus.cc:3037] T 81d931f710fd412091e8d34d46656188 P a10640a6ff9041f3adb4b5825db85735 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:30.596599 26778 raft_consensus.cc:3037] T 81d931f710fd412091e8d34d46656188 P 1df00320c8644126a1779e84089ef0e9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:30.597194 26778 raft_consensus.cc:2454] T 81d931f710fd412091e8d34d46656188 P 1df00320c8644126a1779e84089ef0e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 357bd21dd5404914a28864e0f0599b4a in term 1.
I20260807 22:40:30.597255 27012 raft_consensus.cc:2454] T 81d931f710fd412091e8d34d46656188 P a10640a6ff9041f3adb4b5825db85735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 357bd21dd5404914a28864e0f0599b4a in term 1.
I20260807 22:40:30.597431 26434 leader_election.cc:302] T 81d931f710fd412091e8d34d46656188 P 357bd21dd5404914a28864e0f0599b4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 357bd21dd5404914a28864e0f0599b4a, a10640a6ff9041f3adb4b5825db85735; no voters:
I20260807 22:40:30.597534 27268 raft_consensus.cc:2781] T 81d931f710fd412091e8d34d46656188 P 357bd21dd5404914a28864e0f0599b4a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:40:30.597707 27268 raft_consensus.cc:686] T 81d931f710fd412091e8d34d46656188 P 357bd21dd5404914a28864e0f0599b4a [term 1 LEADER]: Becoming Leader. State: Replica: 357bd21dd5404914a28864e0f0599b4a, State: Running, Role: LEADER
I20260807 22:40:30.597761 27268 consensus_queue.cc:237] T 81d931f710fd412091e8d34d46656188 P 357bd21dd5404914a28864e0f0599b4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } }
I20260807 22:40:30.598482 26275 catalog_manager.cc:5495] T 81d931f710fd412091e8d34d46656188 P 357bd21dd5404914a28864e0f0599b4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 357bd21dd5404914a28864e0f0599b4a (127.22.212.65). New cstate: current_term: 1 leader_uuid: "357bd21dd5404914a28864e0f0599b4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } health_report { overall_health: UNKNOWN } } }
I20260807 22:40:30.670085 27280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:30.667507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50126 (local address 127.22.212.65:38139)
0807 22:40:30.667669 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:30.667671 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:30.667679 (+ 8us) server_negotiation.cc:407] Connection header received
0807 22:40:30.667709 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:30.667710 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:30.667720 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:30.667774 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:40:30.667890 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:30.668456 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:30.669274 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:30.669556 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:30.669658 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:30.669811 (+ 153us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:40:30.669846 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:40:30.669910 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:30.669963 (+ 53us) server_negotiation.cc:299] Negotiation successful
0807 22:40:30.669989 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":107,"threads_started":1}
I20260807 22:40:30.672683 26778 raft_consensus.cc:1261] T 81d931f710fd412091e8d34d46656188 P 1df00320c8644126a1779e84089ef0e9 [term 1 FOLLOWER]: Refusing update from remote peer 357bd21dd5404914a28864e0f0599b4a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:40:30.672683 27012 raft_consensus.cc:1261] T 81d931f710fd412091e8d34d46656188 P a10640a6ff9041f3adb4b5825db85735 [term 1 FOLLOWER]: Refusing update from remote peer 357bd21dd5404914a28864e0f0599b4a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:40:30.672941 27275 consensus_queue.cc:1035] T 81d931f710fd412091e8d34d46656188 P 357bd21dd5404914a28864e0f0599b4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:40:30.673082 27275 consensus_queue.cc:1035] T 81d931f710fd412091e8d34d46656188 P 357bd21dd5404914a28864e0f0599b4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:40:30.682796 26273 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58744:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:40:30.682883 26273 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58744:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:40:30.683488 26273 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 024906e65af04e2cbec41a8143b2af24: Sending DeleteTablet for 3 replicas of tablet 81d931f710fd412091e8d34d46656188
I20260807 22:40:30.683719 26510 tablet_service.cc:1514] Processing DeleteTablet for tablet 81d931f710fd412091e8d34d46656188 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:30 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:50100
I20260807 22:40:30.683730 26750 tablet_service.cc:1514] Processing DeleteTablet for tablet 81d931f710fd412091e8d34d46656188 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:30 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:42402
I20260807 22:40:30.683821 27249 tablet_replica.cc:330] T 81d931f710fd412091e8d34d46656188 P 357bd21dd5404914a28864e0f0599b4a: stopping tablet replica
I20260807 22:40:30.683869 27248 tablet_replica.cc:330] T 81d931f710fd412091e8d34d46656188 P 1df00320c8644126a1779e84089ef0e9: stopping tablet replica
I20260807 22:40:30.683885 27249 raft_consensus.cc:2229] T 81d931f710fd412091e8d34d46656188 P 357bd21dd5404914a28864e0f0599b4a [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:40:30.683995 27249 raft_consensus.cc:2258] T 81d931f710fd412091e8d34d46656188 P 357bd21dd5404914a28864e0f0599b4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:30.683990 27248 raft_consensus.cc:2229] T 81d931f710fd412091e8d34d46656188 P 1df00320c8644126a1779e84089ef0e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:40:30.684046 27248 raft_consensus.cc:2258] T 81d931f710fd412091e8d34d46656188 P 1df00320c8644126a1779e84089ef0e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:30.684127 26967 tablet_service.cc:1514] Processing DeleteTablet for tablet 81d931f710fd412091e8d34d46656188 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:30 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:58542
I20260807 22:40:30.684228 27250 tablet_replica.cc:330] T 81d931f710fd412091e8d34d46656188 P a10640a6ff9041f3adb4b5825db85735: stopping tablet replica
I20260807 22:40:30.684333 27250 raft_consensus.cc:2229] T 81d931f710fd412091e8d34d46656188 P a10640a6ff9041f3adb4b5825db85735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:40:30.684381 27250 raft_consensus.cc:2258] T 81d931f710fd412091e8d34d46656188 P a10640a6ff9041f3adb4b5825db85735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:30.684484 27249 ts_tablet_manager.cc:1905] T 81d931f710fd412091e8d34d46656188 P 357bd21dd5404914a28864e0f0599b4a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:30.684523 26273 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58744:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 22:40:30.684612 27250 ts_tablet_manager.cc:1905] T 81d931f710fd412091e8d34d46656188 P a10640a6ff9041f3adb4b5825db85735: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260807 22:40:30.684648 26273 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:40:30.685801 26750 tablet_service.cc:1467] Processing CreateTablet for tablet 30984d66d03344998484d2a655307571 (DEFAULT_TABLE table=test-table [id=5a3491fcdb124a61b7186eeba04c5d91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:30.685801 26510 tablet_service.cc:1467] Processing CreateTablet for tablet 30984d66d03344998484d2a655307571 (DEFAULT_TABLE table=test-table [id=5a3491fcdb124a61b7186eeba04c5d91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:30.685909 26510 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30984d66d03344998484d2a655307571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:30.685909 26750 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30984d66d03344998484d2a655307571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:30.686178 26967 tablet_service.cc:1467] Processing CreateTablet for tablet 30984d66d03344998484d2a655307571 (DEFAULT_TABLE table=test-table [id=5a3491fcdb124a61b7186eeba04c5d91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:30.686329 27248 ts_tablet_manager.cc:1905] T 81d931f710fd412091e8d34d46656188 P 1df00320c8644126a1779e84089ef0e9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:30.686352 27249 ts_tablet_manager.cc:1918] T 81d931f710fd412091e8d34d46656188 P 357bd21dd5404914a28864e0f0599b4a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 22:40:30.686398 27249 log.cc:1196] T 81d931f710fd412091e8d34d46656188 P 357bd21dd5404914a28864e0f0599b4a: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-0/wal/wals/81d931f710fd412091e8d34d46656188
I20260807 22:40:30.686627 27249 ts_tablet_manager.cc:1939] T 81d931f710fd412091e8d34d46656188 P 357bd21dd5404914a28864e0f0599b4a: Deleting consensus metadata
I20260807 22:40:30.686721 27250 ts_tablet_manager.cc:1918] T 81d931f710fd412091e8d34d46656188 P a10640a6ff9041f3adb4b5825db85735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 22:40:30.686769 27250 log.cc:1196] T 81d931f710fd412091e8d34d46656188 P a10640a6ff9041f3adb4b5825db85735: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-2/wal/wals/81d931f710fd412091e8d34d46656188
I20260807 22:40:30.687004 27250 ts_tablet_manager.cc:1939] T 81d931f710fd412091e8d34d46656188 P a10640a6ff9041f3adb4b5825db85735: Deleting consensus metadata
I20260807 22:40:30.687145 26967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30984d66d03344998484d2a655307571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:30.687813 27248 ts_tablet_manager.cc:1918] T 81d931f710fd412091e8d34d46656188 P 1df00320c8644126a1779e84089ef0e9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 22:40:30.687865 27248 log.cc:1196] T 81d931f710fd412091e8d34d46656188 P 1df00320c8644126a1779e84089ef0e9: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-1/wal/wals/81d931f710fd412091e8d34d46656188
I20260807 22:40:30.687906 27264 tablet_bootstrap.cc:492] T 30984d66d03344998484d2a655307571 P 357bd21dd5404914a28864e0f0599b4a: Bootstrap starting.
I20260807 22:40:30.688001 26247 catalog_manager.cc:4841] TS 357bd21dd5404914a28864e0f0599b4a (127.22.212.65:38139): tablet 81d931f710fd412091e8d34d46656188 (table test-table [id=5b91630685244c249c658abc7ceac09d]) successfully deleted
I20260807 22:40:30.688079 27248 ts_tablet_manager.cc:1939] T 81d931f710fd412091e8d34d46656188 P 1df00320c8644126a1779e84089ef0e9: Deleting consensus metadata
I20260807 22:40:30.688344 27264 tablet_bootstrap.cc:654] T 30984d66d03344998484d2a655307571 P 357bd21dd5404914a28864e0f0599b4a: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:30.688359 27269 tablet_bootstrap.cc:492] T 30984d66d03344998484d2a655307571 P 1df00320c8644126a1779e84089ef0e9: Bootstrap starting.
I20260807 22:40:30.688513 27265 tablet_bootstrap.cc:492] T 30984d66d03344998484d2a655307571 P a10640a6ff9041f3adb4b5825db85735: Bootstrap starting.
I20260807 22:40:30.688660 27269 tablet_bootstrap.cc:654] T 30984d66d03344998484d2a655307571 P 1df00320c8644126a1779e84089ef0e9: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:30.688719 26248 catalog_manager.cc:4841] TS 1df00320c8644126a1779e84089ef0e9 (127.22.212.66:34649): tablet 81d931f710fd412091e8d34d46656188 (table test-table [id=5b91630685244c249c658abc7ceac09d]) successfully deleted
I20260807 22:40:30.688854 27265 tablet_bootstrap.cc:654] T 30984d66d03344998484d2a655307571 P a10640a6ff9041f3adb4b5825db85735: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:30.688946 27264 tablet_bootstrap.cc:492] T 30984d66d03344998484d2a655307571 P 357bd21dd5404914a28864e0f0599b4a: No bootstrap required, opened a new log
I20260807 22:40:30.688989 27264 ts_tablet_manager.cc:1397] T 30984d66d03344998484d2a655307571 P 357bd21dd5404914a28864e0f0599b4a: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260807 22:40:30.689105 27264 raft_consensus.cc:348] T 30984d66d03344998484d2a655307571 P 357bd21dd5404914a28864e0f0599b4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } }
I20260807 22:40:30.689177 27264 raft_consensus.cc:374] T 30984d66d03344998484d2a655307571 P 357bd21dd5404914a28864e0f0599b4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:30.689196 27264 raft_consensus.cc:729] T 30984d66d03344998484d2a655307571 P 357bd21dd5404914a28864e0f0599b4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 357bd21dd5404914a28864e0f0599b4a, State: Initialized, Role: FOLLOWER
I20260807 22:40:30.689239 27264 consensus_queue.cc:260] T 30984d66d03344998484d2a655307571 P 357bd21dd5404914a28864e0f0599b4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } }
I20260807 22:40:30.689311 26243 catalog_manager.cc:4841] TS a10640a6ff9041f3adb4b5825db85735 (127.22.212.67:37069): tablet 81d931f710fd412091e8d34d46656188 (table test-table [id=5b91630685244c249c658abc7ceac09d]) successfully deleted
I20260807 22:40:30.689343 27264 ts_tablet_manager.cc:1428] T 30984d66d03344998484d2a655307571 P 357bd21dd5404914a28864e0f0599b4a: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260807 22:40:30.689388 27269 tablet_bootstrap.cc:492] T 30984d66d03344998484d2a655307571 P 1df00320c8644126a1779e84089ef0e9: No bootstrap required, opened a new log
I20260807 22:40:30.689431 27269 ts_tablet_manager.cc:1397] T 30984d66d03344998484d2a655307571 P 1df00320c8644126a1779e84089ef0e9: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 22:40:30.689550 27269 raft_consensus.cc:348] T 30984d66d03344998484d2a655307571 P 1df00320c8644126a1779e84089ef0e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } }
I20260807 22:40:30.689620 27269 raft_consensus.cc:374] T 30984d66d03344998484d2a655307571 P 1df00320c8644126a1779e84089ef0e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:30.689639 27269 raft_consensus.cc:729] T 30984d66d03344998484d2a655307571 P 1df00320c8644126a1779e84089ef0e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1df00320c8644126a1779e84089ef0e9, State: Initialized, Role: FOLLOWER
I20260807 22:40:30.689679 27269 consensus_queue.cc:260] T 30984d66d03344998484d2a655307571 P 1df00320c8644126a1779e84089ef0e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } }
I20260807 22:40:30.689777 27269 ts_tablet_manager.cc:1428] T 30984d66d03344998484d2a655307571 P 1df00320c8644126a1779e84089ef0e9: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:30.689908 27265 tablet_bootstrap.cc:492] T 30984d66d03344998484d2a655307571 P a10640a6ff9041f3adb4b5825db85735: No bootstrap required, opened a new log
I20260807 22:40:30.689949 27265 ts_tablet_manager.cc:1397] T 30984d66d03344998484d2a655307571 P a10640a6ff9041f3adb4b5825db85735: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260807 22:40:30.690045 27265 raft_consensus.cc:348] T 30984d66d03344998484d2a655307571 P a10640a6ff9041f3adb4b5825db85735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } }
I20260807 22:40:30.690135 27265 raft_consensus.cc:374] T 30984d66d03344998484d2a655307571 P a10640a6ff9041f3adb4b5825db85735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:30.690162 27265 raft_consensus.cc:729] T 30984d66d03344998484d2a655307571 P a10640a6ff9041f3adb4b5825db85735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a10640a6ff9041f3adb4b5825db85735, State: Initialized, Role: FOLLOWER
I20260807 22:40:30.690198 27265 consensus_queue.cc:260] T 30984d66d03344998484d2a655307571 P a10640a6ff9041f3adb4b5825db85735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } }
I20260807 22:40:30.690292 27265 ts_tablet_manager.cc:1428] T 30984d66d03344998484d2a655307571 P a10640a6ff9041f3adb4b5825db85735: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:30.897266 27268 raft_consensus.cc:482] T 30984d66d03344998484d2a655307571 P 357bd21dd5404914a28864e0f0599b4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:40:30.897392 27268 raft_consensus.cc:504] T 30984d66d03344998484d2a655307571 P 357bd21dd5404914a28864e0f0599b4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } }
I20260807 22:40:30.897593 27268 leader_election.cc:288] T 30984d66d03344998484d2a655307571 P 357bd21dd5404914a28864e0f0599b4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1df00320c8644126a1779e84089ef0e9 (127.22.212.66:34649), a10640a6ff9041f3adb4b5825db85735 (127.22.212.67:37069)
I20260807 22:40:30.897869 27012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30984d66d03344998484d2a655307571" candidate_uuid: "357bd21dd5404914a28864e0f0599b4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10640a6ff9041f3adb4b5825db85735" is_pre_election: true
I20260807 22:40:30.897869 26778 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30984d66d03344998484d2a655307571" candidate_uuid: "357bd21dd5404914a28864e0f0599b4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1df00320c8644126a1779e84089ef0e9" is_pre_election: true
I20260807 22:40:30.897981 26778 raft_consensus.cc:2454] T 30984d66d03344998484d2a655307571 P 1df00320c8644126a1779e84089ef0e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 357bd21dd5404914a28864e0f0599b4a in term 0.
I20260807 22:40:30.897981 27012 raft_consensus.cc:2454] T 30984d66d03344998484d2a655307571 P a10640a6ff9041f3adb4b5825db85735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 357bd21dd5404914a28864e0f0599b4a in term 0.
I20260807 22:40:30.898183 26434 leader_election.cc:302] T 30984d66d03344998484d2a655307571 P 357bd21dd5404914a28864e0f0599b4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 357bd21dd5404914a28864e0f0599b4a, a10640a6ff9041f3adb4b5825db85735; no voters:
I20260807 22:40:30.898319 27268 raft_consensus.cc:2781] T 30984d66d03344998484d2a655307571 P 357bd21dd5404914a28864e0f0599b4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:40:30.898398 27268 raft_consensus.cc:482] T 30984d66d03344998484d2a655307571 P 357bd21dd5404914a28864e0f0599b4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:40:30.898422 27268 raft_consensus.cc:3037] T 30984d66d03344998484d2a655307571 P 357bd21dd5404914a28864e0f0599b4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:30.899187 27268 raft_consensus.cc:504] T 30984d66d03344998484d2a655307571 P 357bd21dd5404914a28864e0f0599b4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } }
I20260807 22:40:30.899329 27268 leader_election.cc:288] T 30984d66d03344998484d2a655307571 P 357bd21dd5404914a28864e0f0599b4a [CANDIDATE]: Term 1 election: Requested vote from peers 1df00320c8644126a1779e84089ef0e9 (127.22.212.66:34649), a10640a6ff9041f3adb4b5825db85735 (127.22.212.67:37069)
I20260807 22:40:30.899500 27012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30984d66d03344998484d2a655307571" candidate_uuid: "357bd21dd5404914a28864e0f0599b4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10640a6ff9041f3adb4b5825db85735"
I20260807 22:40:30.899475 26778 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30984d66d03344998484d2a655307571" candidate_uuid: "357bd21dd5404914a28864e0f0599b4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1df00320c8644126a1779e84089ef0e9"
I20260807 22:40:30.899587 27012 raft_consensus.cc:3037] T 30984d66d03344998484d2a655307571 P a10640a6ff9041f3adb4b5825db85735 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:30.899590 26778 raft_consensus.cc:3037] T 30984d66d03344998484d2a655307571 P 1df00320c8644126a1779e84089ef0e9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:30.900233 26778 raft_consensus.cc:2454] T 30984d66d03344998484d2a655307571 P 1df00320c8644126a1779e84089ef0e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 357bd21dd5404914a28864e0f0599b4a in term 1.
I20260807 22:40:30.900295 27012 raft_consensus.cc:2454] T 30984d66d03344998484d2a655307571 P a10640a6ff9041f3adb4b5825db85735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 357bd21dd5404914a28864e0f0599b4a in term 1.
I20260807 22:40:30.900477 26441 leader_election.cc:302] T 30984d66d03344998484d2a655307571 P 357bd21dd5404914a28864e0f0599b4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1df00320c8644126a1779e84089ef0e9, 357bd21dd5404914a28864e0f0599b4a; no voters:
I20260807 22:40:30.900610 27268 raft_consensus.cc:2781] T 30984d66d03344998484d2a655307571 P 357bd21dd5404914a28864e0f0599b4a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:40:30.900676 27268 raft_consensus.cc:686] T 30984d66d03344998484d2a655307571 P 357bd21dd5404914a28864e0f0599b4a [term 1 LEADER]: Becoming Leader. State: Replica: 357bd21dd5404914a28864e0f0599b4a, State: Running, Role: LEADER
I20260807 22:40:30.900710 27268 consensus_queue.cc:237] T 30984d66d03344998484d2a655307571 P 357bd21dd5404914a28864e0f0599b4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } }
I20260807 22:40:30.901360 26275 catalog_manager.cc:5495] T 30984d66d03344998484d2a655307571 P 357bd21dd5404914a28864e0f0599b4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 357bd21dd5404914a28864e0f0599b4a (127.22.212.65). New cstate: current_term: 1 leader_uuid: "357bd21dd5404914a28864e0f0599b4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "357bd21dd5404914a28864e0f0599b4a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 } health_report { overall_health: UNKNOWN } } }
I20260807 22:40:30.919620 26778 raft_consensus.cc:1261] T 30984d66d03344998484d2a655307571 P 1df00320c8644126a1779e84089ef0e9 [term 1 FOLLOWER]: Refusing update from remote peer 357bd21dd5404914a28864e0f0599b4a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:40:30.919597 27012 raft_consensus.cc:1261] T 30984d66d03344998484d2a655307571 P a10640a6ff9041f3adb4b5825db85735 [term 1 FOLLOWER]: Refusing update from remote peer 357bd21dd5404914a28864e0f0599b4a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:40:30.919816 27268 consensus_queue.cc:1035] T 30984d66d03344998484d2a655307571 P 357bd21dd5404914a28864e0f0599b4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a10640a6ff9041f3adb4b5825db85735" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:40:30.919950 27286 consensus_queue.cc:1035] T 30984d66d03344998484d2a655307571 P 357bd21dd5404914a28864e0f0599b4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1df00320c8644126a1779e84089ef0e9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 34649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 22:40:30.924177 27221 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260807 22:40:32.443101 26272 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58744:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:40:32.443233 26272 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58744:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:40:32.444124 26272 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 024906e65af04e2cbec41a8143b2af24: Sending DeleteTablet for 3 replicas of tablet 30984d66d03344998484d2a655307571
I20260807 22:40:32.444386 26510 tablet_service.cc:1514] Processing DeleteTablet for tablet 30984d66d03344998484d2a655307571 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:32 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:50100
I20260807 22:40:32.444391 26750 tablet_service.cc:1514] Processing DeleteTablet for tablet 30984d66d03344998484d2a655307571 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:32 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:42402
I20260807 22:40:32.444577 26967 tablet_service.cc:1514] Processing DeleteTablet for tablet 30984d66d03344998484d2a655307571 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:32 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:58542
I20260807 22:40:32.444609 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 26408
I20260807 22:40:32.454456 27340 tablet_replica.cc:330] T 30984d66d03344998484d2a655307571 P a10640a6ff9041f3adb4b5825db85735: stopping tablet replica
I20260807 22:40:32.454574 27340 raft_consensus.cc:2229] T 30984d66d03344998484d2a655307571 P a10640a6ff9041f3adb4b5825db85735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:40:32.454634 27340 raft_consensus.cc:2258] T 30984d66d03344998484d2a655307571 P a10640a6ff9041f3adb4b5825db85735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:32.454914 27340 ts_tablet_manager.cc:1905] T 30984d66d03344998484d2a655307571 P a10640a6ff9041f3adb4b5825db85735: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:32.456566 27340 ts_tablet_manager.cc:1918] T 30984d66d03344998484d2a655307571 P a10640a6ff9041f3adb4b5825db85735: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 22:40:32.456708 27340 log.cc:1196] T 30984d66d03344998484d2a655307571 P a10640a6ff9041f3adb4b5825db85735: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-2/wal/wals/30984d66d03344998484d2a655307571
I20260807 22:40:32.457017 27340 ts_tablet_manager.cc:1939] T 30984d66d03344998484d2a655307571 P a10640a6ff9041f3adb4b5825db85735: Deleting consensus metadata
I20260807 22:40:32.458280 26243 catalog_manager.cc:4841] TS a10640a6ff9041f3adb4b5825db85735 (127.22.212.67:37069): tablet 30984d66d03344998484d2a655307571 (table test-table [id=5a3491fcdb124a61b7186eeba04c5d91]) successfully deleted
I20260807 22:40:32.459228 27338 tablet_replica.cc:330] T 30984d66d03344998484d2a655307571 P 1df00320c8644126a1779e84089ef0e9: stopping tablet replica
I20260807 22:40:32.459300 27338 raft_consensus.cc:2229] T 30984d66d03344998484d2a655307571 P 1df00320c8644126a1779e84089ef0e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:40:32.459337 27338 raft_consensus.cc:2258] T 30984d66d03344998484d2a655307571 P 1df00320c8644126a1779e84089ef0e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:32.460369 27338 ts_tablet_manager.cc:1905] T 30984d66d03344998484d2a655307571 P 1df00320c8644126a1779e84089ef0e9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:32.461920 27338 ts_tablet_manager.cc:1918] T 30984d66d03344998484d2a655307571 P 1df00320c8644126a1779e84089ef0e9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 22:40:32.462002 27338 log.cc:1196] T 30984d66d03344998484d2a655307571 P 1df00320c8644126a1779e84089ef0e9: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786142418640232-23377-0/minicluster-data/ts-1/wal/wals/30984d66d03344998484d2a655307571
I20260807 22:40:32.462224 27338 ts_tablet_manager.cc:1939] T 30984d66d03344998484d2a655307571 P 1df00320c8644126a1779e84089ef0e9: Deleting consensus metadata
I20260807 22:40:32.462622 26248 catalog_manager.cc:4841] TS 1df00320c8644126a1779e84089ef0e9 (127.22.212.66:34649): tablet 30984d66d03344998484d2a655307571 (table test-table [id=5a3491fcdb124a61b7186eeba04c5d91]) successfully deleted
W20260807 22:40:32.466325 26247 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.212.65:38139 (error 108)
I20260807 22:40:32.467025 27343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:32.466784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:38139 (local address 127.0.0.1:50132)
0807 22:40:32.466913 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:32.466976 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.65:38139: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":75,"threads_started":1}
I20260807 22:40:32.467053 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 26640
W20260807 22:40:32.467175 26247 catalog_manager.cc:4584] TS 357bd21dd5404914a28864e0f0599b4a (127.22.212.65:38139): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 30984d66d03344998484d2a655307571: Network error: Client connection negotiation failed: client connection to 127.22.212.65:38139: connect: Connection refused (error 111)
I20260807 22:40:32.479055 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 26863
I20260807 22:40:32.489646 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 26211
2026-08-07T22:40:32Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6193 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:40:32 dist-test-slave-2d19 krb5kdc[27346](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:40:32 dist-test-slave-2d19 krb5kdc[27346](info): set up 2 sockets
Aug 07 22:40:32 dist-test-slave-2d19 krb5kdc[27346](info): commencing operation
krb5kdc: starting...
W20260807 22:40:33.762189 23377 mini_kdc.cc:121] Time spent starting KDC: real 1.239s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Aug 07 22:40:33 dist-test-slave-2d19 krb5kdc[27346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142433, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:40:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:40:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.212.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
I20260807 22:40:33.893239 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:41759
--webserver_interface=127.22.212.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:41217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:41759
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:33.978181 27370 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:33.978423 27370 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:33.978447 27370 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:33.979597 27370 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:40:33.979640 27370 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:33.979655 27370 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:33.979693 27370 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:40:33.979723 27370 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:40:33.981205 27370 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:41217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:41759
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:41759
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27370
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:33.981464 27370 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:33.981704 27370 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 22:40:33.987429 27370 server_base.cc:1034] running on GCE node
W20260807 22:40:33.987371 27387 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:33.987371 27381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:33.987367 27382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:33.987898 27370 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:33.988157 27370 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:33.989301 27370 hybrid_clock.cc:648] HybridClock initialized: now 1786142433989300 us; error 38 us; skew 500 ppm
Aug 07 22:40:33 dist-test-slave-2d19 krb5kdc[27346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142433, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:33.991775 27370 init.cc:377] Logged in from keytab as kudu/127.22.212.126@KRBTEST.COM (short username kudu)
I20260807 22:40:33.992344 27370 webserver.cc:460] Webserver started at http://127.22.212.126:38505/ using document root <none> and password file <none>
I20260807 22:40:33.992599 27370 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:33.992671 27370 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:33.992825 27370 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:33.993909 27370 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "befd99b1271a4334820374c222c1532c"
format_stamp: "Formatted at 2026-08-07 22:40:33 on dist-test-slave-2d19"
server_key: "6e84a21027f6220c1e7f1393022b8be1"
server_key_iv: "60bfe3a2a3021ded6a40c0af32d9f469"
server_key_version: "encryptionkey@0"
I20260807 22:40:33.994302 27370 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "befd99b1271a4334820374c222c1532c"
format_stamp: "Formatted at 2026-08-07 22:40:33 on dist-test-slave-2d19"
server_key: "6e84a21027f6220c1e7f1393022b8be1"
server_key_iv: "60bfe3a2a3021ded6a40c0af32d9f469"
server_key_version: "encryptionkey@0"
I20260807 22:40:33.995653 27370 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 22:40:33.996429 27396 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:33.996613 27370 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 22:40:33.996718 27370 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "befd99b1271a4334820374c222c1532c"
format_stamp: "Formatted at 2026-08-07 22:40:33 on dist-test-slave-2d19"
server_key: "6e84a21027f6220c1e7f1393022b8be1"
server_key_iv: "60bfe3a2a3021ded6a40c0af32d9f469"
server_key_version: "encryptionkey@0"
I20260807 22:40:33.996802 27370 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:34.021174 27370 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:34.023168 27370 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:34.023342 27370 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:34.027565 27370 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:41759
I20260807 22:40:34.027601 27485 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:41759 every 8 connection(s)
I20260807 22:40:34.027961 27370 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:40:34.028931 27488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:34.028993 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 27370
I20260807 22:40:34.029095 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:40:34.029280 23377 external_mini_cluster.cc:1428] Setting key 44ae883a0ddc0826345539b92801a1cb
I20260807 22:40:34.032312 27488 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P befd99b1271a4334820374c222c1532c: Bootstrap starting.
I20260807 22:40:34.033078 27488 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P befd99b1271a4334820374c222c1532c: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:34.033385 27488 log.cc:824] T 00000000000000000000000000000000 P befd99b1271a4334820374c222c1532c: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:34.034129 27488 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P befd99b1271a4334820374c222c1532c: No bootstrap required, opened a new log
Aug 07 22:40:34 dist-test-slave-2d19 krb5kdc[27346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142433, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:40:34.036806 27488 raft_consensus.cc:348] T 00000000000000000000000000000000 P befd99b1271a4334820374c222c1532c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "befd99b1271a4334820374c222c1532c" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 41759 } }
I20260807 22:40:34.036965 27488 raft_consensus.cc:374] T 00000000000000000000000000000000 P befd99b1271a4334820374c222c1532c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:34.037014 27488 raft_consensus.cc:729] T 00000000000000000000000000000000 P befd99b1271a4334820374c222c1532c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: befd99b1271a4334820374c222c1532c, State: Initialized, Role: FOLLOWER
I20260807 22:40:34.037163 27488 consensus_queue.cc:260] T 00000000000000000000000000000000 P befd99b1271a4334820374c222c1532c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "befd99b1271a4334820374c222c1532c" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 41759 } }
I20260807 22:40:34.037253 27488 raft_consensus.cc:388] T 00000000000000000000000000000000 P befd99b1271a4334820374c222c1532c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:40:34.037297 27488 raft_consensus.cc:482] T 00000000000000000000000000000000 P befd99b1271a4334820374c222c1532c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:40:34.037346 27488 raft_consensus.cc:3037] T 00000000000000000000000000000000 P befd99b1271a4334820374c222c1532c [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:34.038048 27488 raft_consensus.cc:504] T 00000000000000000000000000000000 P befd99b1271a4334820374c222c1532c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "befd99b1271a4334820374c222c1532c" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 41759 } }
I20260807 22:40:34.038172 27488 leader_election.cc:302] T 00000000000000000000000000000000 P befd99b1271a4334820374c222c1532c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: befd99b1271a4334820374c222c1532c; no voters:
I20260807 22:40:34.038372 27488 leader_election.cc:288] T 00000000000000000000000000000000 P befd99b1271a4334820374c222c1532c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:40:34.038409 27497 raft_consensus.cc:2781] T 00000000000000000000000000000000 P befd99b1271a4334820374c222c1532c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:40:34.038522 27497 raft_consensus.cc:686] T 00000000000000000000000000000000 P befd99b1271a4334820374c222c1532c [term 1 LEADER]: Becoming Leader. State: Replica: befd99b1271a4334820374c222c1532c, State: Running, Role: LEADER
I20260807 22:40:34.038663 27497 consensus_queue.cc:237] T 00000000000000000000000000000000 P befd99b1271a4334820374c222c1532c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "befd99b1271a4334820374c222c1532c" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 41759 } }
I20260807 22:40:34.038672 27488 sys_catalog.cc:564] T 00000000000000000000000000000000 P befd99b1271a4334820374c222c1532c [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:40:34.039901 27502 sys_catalog.cc:455] T 00000000000000000000000000000000 P befd99b1271a4334820374c222c1532c [sys.catalog]: SysCatalogTable state changed. Reason: New leader befd99b1271a4334820374c222c1532c. Latest consensus state: current_term: 1 leader_uuid: "befd99b1271a4334820374c222c1532c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "befd99b1271a4334820374c222c1532c" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 41759 } } }
I20260807 22:40:34.039994 27502 sys_catalog.cc:458] T 00000000000000000000000000000000 P befd99b1271a4334820374c222c1532c [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:34.040536 27522 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:40:34.040419 27500 sys_catalog.cc:455] T 00000000000000000000000000000000 P befd99b1271a4334820374c222c1532c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "befd99b1271a4334820374c222c1532c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "befd99b1271a4334820374c222c1532c" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 41759 } } }
I20260807 22:40:34.040771 27500 sys_catalog.cc:458] T 00000000000000000000000000000000 P befd99b1271a4334820374c222c1532c [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:34.041074 27494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:34.029825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51464 (local address 127.22.212.126:41759)
0807 22:40:34.029995 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:34.030002 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:34.030028 (+ 26us) server_negotiation.cc:407] Connection header received
0807 22:40:34.030520 (+ 492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:34.030527 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:34.030600 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:34.030715 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:34.031517 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:34.032525 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:34.033615 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:34.034125 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:34.034244 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:34.036981 (+ 2737us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:34.036985 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:34.036986 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:34.037017 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:34.039113 (+ 2096us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:34.039549 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:34.039553 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:34.039554 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:34.039732 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:34.040058 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:34.040059 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:34.040060 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:34.040427 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:34.040590 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:34.040729 (+ 139us) server_negotiation.cc:299] Negotiation successful
0807 22:40:34.040871 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":70,"threads_started":1}
I20260807 22:40:34.041220 27522 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:40:34.042680 27522 catalog_manager.cc:1347] Generated new cluster ID: cb982143a2c649688c2ecd1a33d392ad
I20260807 22:40:34.042737 27522 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:40:34.055990 27522 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:40:34.056608 27522 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:40:34.062942 27522 catalog_manager.cc:5868] T 00000000000000000000000000000000 P befd99b1271a4334820374c222c1532c: Generated new TSK 0
I20260807 22:40:34.063154 27522 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.212.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab.
Entry for principal kudu/127.22.212.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab.
I20260807 22:40:34.091238 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.65:0
--local_ip_for_outbound_sockets=127.22.212.65
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:41759
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:41217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:34.177388 27534 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:34.177614 27534 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:34.177640 27534 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:34.178864 27534 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:34.178910 27534 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:34.178938 27534 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.65
I20260807 22:40:34.180480 27534 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:41217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:41759
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27534
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.65
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:34.180745 27534 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:34.181000 27534 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:34.186398 27542 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:34.186450 27547 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:34.186594 27534 server_base.cc:1034] running on GCE node
W20260807 22:40:34.186407 27544 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:34.186934 27534 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:34.187209 27534 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:34.188324 27534 hybrid_clock.cc:648] HybridClock initialized: now 1786142434188290 us; error 43 us; skew 500 ppm
Aug 07 22:40:34 dist-test-slave-2d19 krb5kdc[27346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142434, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:34.190968 27534 init.cc:377] Logged in from keytab as kudu/127.22.212.65@KRBTEST.COM (short username kudu)
I20260807 22:40:34.191365 27534 webserver.cc:460] Webserver started at http://127.22.212.65:46137/ using document root <none> and password file <none>
I20260807 22:40:34.191586 27534 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:34.191628 27534 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:34.191720 27534 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:34.192844 27534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-0/data/instance:
uuid: "5522c7a7e02e41d094cb4479ffc769cc"
format_stamp: "Formatted at 2026-08-07 22:40:34 on dist-test-slave-2d19"
server_key: "2b7fd82bb1e5eb19a2ca7f19d5d5838e"
server_key_iv: "734570a55e6f6af0062c405584ab9e43"
server_key_version: "encryptionkey@0"
I20260807 22:40:34.193158 27534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance:
uuid: "5522c7a7e02e41d094cb4479ffc769cc"
format_stamp: "Formatted at 2026-08-07 22:40:34 on dist-test-slave-2d19"
server_key: "2b7fd82bb1e5eb19a2ca7f19d5d5838e"
server_key_iv: "734570a55e6f6af0062c405584ab9e43"
server_key_version: "encryptionkey@0"
I20260807 22:40:34.194429 27534 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 22:40:34.195150 27559 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:34.195330 27534 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 22:40:34.195425 27534 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-0/wal
uuid: "5522c7a7e02e41d094cb4479ffc769cc"
format_stamp: "Formatted at 2026-08-07 22:40:34 on dist-test-slave-2d19"
server_key: "2b7fd82bb1e5eb19a2ca7f19d5d5838e"
server_key_iv: "734570a55e6f6af0062c405584ab9e43"
server_key_version: "encryptionkey@0"
I20260807 22:40:34.195510 27534 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:34.206212 27534 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:34.208143 27534 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:34.208354 27534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:34.208621 27534 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:34.208968 27534 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:34.209025 27534 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:34.209060 27534 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:34.209092 27534 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:34.214823 27534 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.65:33951
I20260807 22:40:34.214923 27745 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.65:33951 every 8 connection(s)
I20260807 22:40:34.215233 27534 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
I20260807 22:40:34.216778 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 27534
I20260807 22:40:34.216872 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance
I20260807 22:40:34.217078 23377 external_mini_cluster.cc:1428] Setting key 0155f2019bcfc13388e05533ffffa9a4
Aug 07 22:40:34 dist-test-slave-2d19 krb5kdc[27346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142434, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:40:34.225684 27494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:34.216052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:33581 (local address 127.22.212.126:41759)
0807 22:40:34.216127 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:34.216129 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:34.216366 (+ 237us) server_negotiation.cc:407] Connection header received
0807 22:40:34.217093 (+ 727us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:34.217094 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:34.217104 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:34.217196 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:34.218313 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:34.218806 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:34.219834 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:34.220052 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:34.220174 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:34.222554 (+ 2380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:34.222556 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:34.222557 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:34.222564 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:34.224004 (+ 1440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:34.224581 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:34.224582 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:34.224583 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:34.224639 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:34.224948 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:34.224949 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:34.224949 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:34.225081 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:34.225132 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:34.225536 (+ 404us) server_negotiation.cc:299] Negotiation successful
0807 22:40:34.225614 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 22:40:34.225947 27751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:34.216029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:41759 (local address 127.22.212.65:33581)
0807 22:40:34.216207 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:34.216272 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:34.216976 (+ 704us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:34.217296 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:34.217305 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:34.218001 (+ 696us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:34.218193 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:34.218198 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:34.218902 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:34.218904 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:34.219732 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:34.219735 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:34.220184 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:34.220185 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:34.220353 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:34.220899 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:34.220908 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:34.222445 (+ 1537us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:34.224126 (+ 1681us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:34.224134 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:34.224136 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:34.224497 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:34.224716 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:34.224717 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:34.224718 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:34.224873 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:34.225156 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:34.225163 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:34.225343 (+ 180us) client_negotiation.cc:769] Sending connection context
0807 22:40:34.225463 (+ 120us) client_negotiation.cc:240] Negotiation successful
0807 22:40:34.225665 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":96,"threads_started":1}
I20260807 22:40:34.226543 27747 heartbeater.cc:347] Connected to a master server at 127.22.212.126:41759
I20260807 22:40:34.226637 27747 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.22.212.66@KRBTEST.COM; defaulting to no policy
I20260807 22:40:34.226861 27747 heartbeater.cc:511] Master 127.22.212.126:41759 requested a full tablet report, sending...
I20260807 22:40:34.227497 27422 ts_manager.cc:194] Registered new tserver with Master: 5522c7a7e02e41d094cb4479ffc769cc (127.22.212.65:33951)
I20260807 22:40:34.228145 27422 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.65@KRBTEST.COM'} at 127.22.212.65:33581
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab.
Entry for principal kudu/127.22.212.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab.
I20260807 22:40:34.247180 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.66:0
--local_ip_for_outbound_sockets=127.22.212.66
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:41759
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:41217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:34.332484 27757 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:34.332687 27757 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:34.332711 27757 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:34.333915 27757 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:34.333973 27757 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:34.334002 27757 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.66
I20260807 22:40:34.335551 27757 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:41217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:41759
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27757
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.66
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:34.335808 27757 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:34.336079 27757 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:34.341303 27765 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:34.341310 27769 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:34.341518 27757 server_base.cc:1034] running on GCE node
W20260807 22:40:34.341440 27766 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:34.341760 27757 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:34.342011 27757 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:34.343187 27757 hybrid_clock.cc:648] HybridClock initialized: now 1786142434343173 us; error 44 us; skew 500 ppm
Aug 07 22:40:34 dist-test-slave-2d19 krb5kdc[27346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142434, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:34.345793 27757 init.cc:377] Logged in from keytab as kudu/127.22.212.66@KRBTEST.COM (short username kudu)
I20260807 22:40:34.346266 27757 webserver.cc:460] Webserver started at http://127.22.212.66:39727/ using document root <none> and password file <none>
I20260807 22:40:34.346602 27757 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:34.346670 27757 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:34.346818 27757 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:34.347930 27757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-1/data/instance:
uuid: "dd1690bf36674455b20c32f8e9d02188"
format_stamp: "Formatted at 2026-08-07 22:40:34 on dist-test-slave-2d19"
server_key: "94551aa4d4f2e75ef2d3d9c3a607176b"
server_key_iv: "84eedee316fa09c54918b0b3684e70f3"
server_key_version: "encryptionkey@0"
I20260807 22:40:34.348374 27757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance:
uuid: "dd1690bf36674455b20c32f8e9d02188"
format_stamp: "Formatted at 2026-08-07 22:40:34 on dist-test-slave-2d19"
server_key: "94551aa4d4f2e75ef2d3d9c3a607176b"
server_key_iv: "84eedee316fa09c54918b0b3684e70f3"
server_key_version: "encryptionkey@0"
I20260807 22:40:34.349771 27757 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:40:34.350586 27781 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:34.350786 27757 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:40:34.350888 27757 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-1/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-1/wal
uuid: "dd1690bf36674455b20c32f8e9d02188"
format_stamp: "Formatted at 2026-08-07 22:40:34 on dist-test-slave-2d19"
server_key: "94551aa4d4f2e75ef2d3d9c3a607176b"
server_key_iv: "84eedee316fa09c54918b0b3684e70f3"
server_key_version: "encryptionkey@0"
I20260807 22:40:34.350975 27757 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:34.364125 27757 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:34.366221 27757 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:34.366391 27757 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:34.366647 27757 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:34.366979 27757 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:34.367041 27757 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:34.367086 27757 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:34.367115 27757 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:34.373710 27757 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.66:44945
I20260807 22:40:34.373760 27973 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.66:44945 every 8 connection(s)
I20260807 22:40:34.374137 27757 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
Aug 07 22:40:34 dist-test-slave-2d19 krb5kdc[27346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142434, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:40:34.383052 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 27757
I20260807 22:40:34.383168 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance
I20260807 22:40:34.383407 23377 external_mini_cluster.cc:1428] Setting key be7f308efed8cd74d8f9f3e98c2d3d41
I20260807 22:40:34.383759 27494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:34.374965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:55085 (local address 127.22.212.126:41759)
0807 22:40:34.375045 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:34.375047 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:34.375234 (+ 187us) server_negotiation.cc:407] Connection header received
0807 22:40:34.375714 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:34.375715 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:34.375725 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:34.375786 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:34.376818 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:34.377323 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:34.378295 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:34.378476 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:34.378534 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:34.380614 (+ 2080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:34.380615 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:34.380616 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:34.380623 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:34.382047 (+ 1424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:34.382498 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:34.382499 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:34.382499 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:34.382568 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:34.382855 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:34.382856 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:34.382857 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:34.383012 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:34.383098 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:34.383565 (+ 467us) server_negotiation.cc:299] Negotiation successful
0807 22:40:34.383650 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 22:40:34.383937 27979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:34.374932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:41759 (local address 127.22.212.66:55085)
0807 22:40:34.375093 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:34.375136 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:34.375627 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:34.375841 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:34.375844 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:34.376512 (+ 668us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:34.376726 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:34.376731 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:34.377407 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:34.377408 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:34.378219 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:34.378221 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:34.378550 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:34.378551 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:34.378648 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:34.379153 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:34.379162 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:34.380525 (+ 1363us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:34.382142 (+ 1617us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:34.382148 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:34.382150 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:34.382390 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:34.382642 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:34.382643 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:34.382643 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:34.382780 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:34.383102 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:34.383109 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:34.383338 (+ 229us) client_negotiation.cc:769] Sending connection context
0807 22:40:34.383488 (+ 150us) client_negotiation.cc:240] Negotiation successful
0807 22:40:34.383694 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":84,"threads_started":1}
I20260807 22:40:34.384527 27974 heartbeater.cc:347] Connected to a master server at 127.22.212.126:41759
I20260807 22:40:34.384642 27974 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:34.384856 27974 heartbeater.cc:511] Master 127.22.212.126:41759 requested a full tablet report, sending...
I20260807 22:40:34.385285 27422 ts_manager.cc:194] Registered new tserver with Master: dd1690bf36674455b20c32f8e9d02188 (127.22.212.66:44945)
I20260807 22:40:34.385661 27422 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.66@KRBTEST.COM'} at 127.22.212.66:55085
WARNING: no policy specified for kudu/127.22.212.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab.
Entry for principal kudu/127.22.212.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab.
I20260807 22:40:34.411805 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.67:0
--local_ip_for_outbound_sockets=127.22.212.67
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:41759
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:41217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:34.494932 27984 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:34.495182 27984 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:34.495220 27984 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:34.496395 27984 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:34.496465 27984 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:34.496510 27984 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.67
I20260807 22:40:34.497969 27984 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:41217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:41759
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27984
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.67
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:34.498246 27984 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:34.498519 27984 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:34.503688 27992 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:34.503815 27984 server_base.cc:1034] running on GCE node
W20260807 22:40:34.503695 27998 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:34.503695 27994 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:34.504182 27984 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:34.504480 27984 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:34.505662 27984 hybrid_clock.cc:648] HybridClock initialized: now 1786142434505641 us; error 29 us; skew 500 ppm
Aug 07 22:40:34 dist-test-slave-2d19 krb5kdc[27346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142434, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:34.508332 27984 init.cc:377] Logged in from keytab as kudu/127.22.212.67@KRBTEST.COM (short username kudu)
I20260807 22:40:34.508785 27984 webserver.cc:460] Webserver started at http://127.22.212.67:37995/ using document root <none> and password file <none>
I20260807 22:40:34.509024 27984 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:34.509073 27984 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:34.509222 27984 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:34.510290 27984 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-2/data/instance:
uuid: "8e02d224e7794904a59e678fd148c143"
format_stamp: "Formatted at 2026-08-07 22:40:34 on dist-test-slave-2d19"
server_key: "3405d6ce5f2328c8ecbb7cb9ac04e843"
server_key_iv: "4e8b7c713e4f3ab621f73636e4ba5b85"
server_key_version: "encryptionkey@0"
I20260807 22:40:34.510664 27984 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance:
uuid: "8e02d224e7794904a59e678fd148c143"
format_stamp: "Formatted at 2026-08-07 22:40:34 on dist-test-slave-2d19"
server_key: "3405d6ce5f2328c8ecbb7cb9ac04e843"
server_key_iv: "4e8b7c713e4f3ab621f73636e4ba5b85"
server_key_version: "encryptionkey@0"
I20260807 22:40:34.512041 27984 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260807 22:40:34.512893 28006 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:34.513105 27984 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260807 22:40:34.513183 27984 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-2/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-2/wal
uuid: "8e02d224e7794904a59e678fd148c143"
format_stamp: "Formatted at 2026-08-07 22:40:34 on dist-test-slave-2d19"
server_key: "3405d6ce5f2328c8ecbb7cb9ac04e843"
server_key_iv: "4e8b7c713e4f3ab621f73636e4ba5b85"
server_key_version: "encryptionkey@0"
I20260807 22:40:34.513267 27984 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:34.526841 27984 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:34.528997 27984 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:34.529140 27984 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:34.529371 27984 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:34.529701 27984 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:34.529762 27984 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:34.529795 27984 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:34.529824 27984 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:34.535713 27984 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.67:34639
I20260807 22:40:34.535761 28182 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.67:34639 every 8 connection(s)
I20260807 22:40:34.536096 27984 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
I20260807 22:40:34.537163 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 27984
I20260807 22:40:34.537269 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance
I20260807 22:40:34.537463 23377 external_mini_cluster.cc:1428] Setting key 1e2ffce4750902e2c6915693862ec269
Aug 07 22:40:34 dist-test-slave-2d19 krb5kdc[27346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142434, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:40:34.546258 27494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:34.536886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:38633 (local address 127.22.212.126:41759)
0807 22:40:34.536989 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:34.536992 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:34.537155 (+ 163us) server_negotiation.cc:407] Connection header received
0807 22:40:34.537781 (+ 626us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:34.537783 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:34.537796 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:34.537838 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:34.539095 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:34.539701 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:34.540948 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:34.541140 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:34.541220 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:34.543434 (+ 2214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:34.543435 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:34.543435 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:34.543444 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:34.544980 (+ 1536us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:34.545402 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:34.545403 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:34.545404 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:34.545466 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:34.545692 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:34.545692 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:34.545693 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:34.545798 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:34.545852 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:34.546119 (+ 267us) server_negotiation.cc:299] Negotiation successful
0807 22:40:34.546190 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 22:40:34.546435 28187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:34.536804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:41759 (local address 127.22.212.67:38633)
0807 22:40:34.537002 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:34.537050 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:34.537687 (+ 637us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:34.537904 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:34.537909 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:34.538760 (+ 851us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:34.538969 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:34.538975 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:34.539802 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:34.539803 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:34.540849 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:34.540852 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:34.541225 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:34.541227 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:34.541365 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:34.541890 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:34.541899 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:34.543335 (+ 1436us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:34.545090 (+ 1755us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:34.545096 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:34.545098 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:34.545317 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:34.545537 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:34.545537 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:34.545538 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:34.545634 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:34.545856 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:34.545860 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:34.545998 (+ 138us) client_negotiation.cc:769] Sending connection context
0807 22:40:34.546089 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 22:40:34.546210 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":109,"threads_started":1}
I20260807 22:40:34.546967 28183 heartbeater.cc:347] Connected to a master server at 127.22.212.126:41759
I20260807 22:40:34.547075 28183 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:34.547269 28183 heartbeater.cc:511] Master 127.22.212.126:41759 requested a full tablet report, sending...
I20260807 22:40:34.547675 27422 ts_manager.cc:194] Registered new tserver with Master: 8e02d224e7794904a59e678fd148c143 (127.22.212.67:34639)
I20260807 22:40:34.548053 27422 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.67@KRBTEST.COM'} at 127.22.212.67:38633
I20260807 22:40:34.549335 23377 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 22:40:34.562302 27494 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:40:34.561244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51478 (local address 127.22.212.126:41759)
0807 22:40:34.561315 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:34.561317 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:34.561352 (+ 35us) server_negotiation.cc:407] Connection header received
0807 22:40:34.561441 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:34.561442 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:34.561452 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:34.561518 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:34.562212 (+ 694us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51478: BlockingRecv error: recv got EOF from 127.0.0.1:51478 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 22:40:34.565143 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 27534
I20260807 22:40:34.576877 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 27757
I20260807 22:40:34.600776 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 27984
I20260807 22:40:34.606627 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 27370
2026-08-07T22:40:34Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2109 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142418640232-23377-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:40:34 dist-test-slave-2d19 krb5kdc[28207](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:40:34 dist-test-slave-2d19 krb5kdc[28207](info): set up 2 sockets
Aug 07 22:40:34 dist-test-slave-2d19 krb5kdc[28207](info): commencing operation
krb5kdc: starting...
W20260807 22:40:35.888912 23377 mini_kdc.cc:121] Time spent starting KDC: real 1.256s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Aug 07 22:40:35 dist-test-slave-2d19 krb5kdc[28207](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142435, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:40:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:40:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.212.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
I20260807 22:40:36.017661 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:41893
--webserver_interface=127.22.212.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:40319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:41893
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:36.101243 28223 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:36.101485 28223 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:36.101522 28223 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:36.102671 28223 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:40:36.102739 28223 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:36.102763 28223 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:36.102783 28223 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:40:36.102814 28223 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:40:36.104375 28223 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:40319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:41893
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:41893
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28223
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:36.104656 28223 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:36.104890 28223 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:36.109898 28233 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:36.109912 28236 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:36.109917 28232 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:36.110160 28223 server_base.cc:1034] running on GCE node
I20260807 22:40:36.110409 28223 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:36.110666 28223 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:36.111807 28223 hybrid_clock.cc:648] HybridClock initialized: now 1786142436111785 us; error 37 us; skew 500 ppm
Aug 07 22:40:36 dist-test-slave-2d19 krb5kdc[28207](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142436, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:36.114396 28223 init.cc:377] Logged in from keytab as kudu/127.22.212.126@KRBTEST.COM (short username kudu)
I20260807 22:40:36.114884 28223 webserver.cc:460] Webserver started at http://127.22.212.126:41029/ using document root <none> and password file <none>
I20260807 22:40:36.115146 28223 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:36.115218 28223 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:36.115372 28223 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:36.116537 28223 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "fbeb96ce37d74060801629e1619de69c"
format_stamp: "Formatted at 2026-08-07 22:40:36 on dist-test-slave-2d19"
server_key: "533e47c6e9caac8617d6b62bb78a1443"
server_key_iv: "db93f19f1eb0e310947100faad4dcaf5"
server_key_version: "encryptionkey@0"
I20260807 22:40:36.116894 28223 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "fbeb96ce37d74060801629e1619de69c"
format_stamp: "Formatted at 2026-08-07 22:40:36 on dist-test-slave-2d19"
server_key: "533e47c6e9caac8617d6b62bb78a1443"
server_key_iv: "db93f19f1eb0e310947100faad4dcaf5"
server_key_version: "encryptionkey@0"
I20260807 22:40:36.118300 28223 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 22:40:36.119151 28246 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:36.119351 28223 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:40:36.119469 28223 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "fbeb96ce37d74060801629e1619de69c"
format_stamp: "Formatted at 2026-08-07 22:40:36 on dist-test-slave-2d19"
server_key: "533e47c6e9caac8617d6b62bb78a1443"
server_key_iv: "db93f19f1eb0e310947100faad4dcaf5"
server_key_version: "encryptionkey@0"
I20260807 22:40:36.119547 28223 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:36.141508 28223 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:36.143472 28223 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:36.143641 28223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:36.147949 28223 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:41893
I20260807 22:40:36.147989 28321 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:41893 every 8 connection(s)
I20260807 22:40:36.148598 28223 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:40:36.149304 28324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:36.151717 28324 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbeb96ce37d74060801629e1619de69c: Bootstrap starting.
I20260807 22:40:36.152406 28324 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fbeb96ce37d74060801629e1619de69c: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:36.152729 28324 log.cc:824] T 00000000000000000000000000000000 P fbeb96ce37d74060801629e1619de69c: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:36.153435 28324 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbeb96ce37d74060801629e1619de69c: No bootstrap required, opened a new log
I20260807 22:40:36.153430 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 28223
I20260807 22:40:36.153576 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:40:36.153785 23377 external_mini_cluster.cc:1428] Setting key 79146decc3e086ac3dfc9c019da03e69
I20260807 22:40:36.155849 28324 raft_consensus.cc:348] T 00000000000000000000000000000000 P fbeb96ce37d74060801629e1619de69c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbeb96ce37d74060801629e1619de69c" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 41893 } }
I20260807 22:40:36.156020 28324 raft_consensus.cc:374] T 00000000000000000000000000000000 P fbeb96ce37d74060801629e1619de69c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:36.156097 28324 raft_consensus.cc:729] T 00000000000000000000000000000000 P fbeb96ce37d74060801629e1619de69c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbeb96ce37d74060801629e1619de69c, State: Initialized, Role: FOLLOWER
I20260807 22:40:36.156311 28324 consensus_queue.cc:260] T 00000000000000000000000000000000 P fbeb96ce37d74060801629e1619de69c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbeb96ce37d74060801629e1619de69c" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 41893 } }
I20260807 22:40:36.156420 28324 raft_consensus.cc:388] T 00000000000000000000000000000000 P fbeb96ce37d74060801629e1619de69c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:40:36.156459 28324 raft_consensus.cc:482] T 00000000000000000000000000000000 P fbeb96ce37d74060801629e1619de69c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:40:36.156507 28324 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fbeb96ce37d74060801629e1619de69c [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:36.157181 28324 raft_consensus.cc:504] T 00000000000000000000000000000000 P fbeb96ce37d74060801629e1619de69c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbeb96ce37d74060801629e1619de69c" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 41893 } }
I20260807 22:40:36.157274 28324 leader_election.cc:302] T 00000000000000000000000000000000 P fbeb96ce37d74060801629e1619de69c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fbeb96ce37d74060801629e1619de69c; no voters:
I20260807 22:40:36.157510 28324 leader_election.cc:288] T 00000000000000000000000000000000 P fbeb96ce37d74060801629e1619de69c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:40:36.157547 28332 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fbeb96ce37d74060801629e1619de69c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:40:36.157696 28332 raft_consensus.cc:686] T 00000000000000000000000000000000 P fbeb96ce37d74060801629e1619de69c [term 1 LEADER]: Becoming Leader. State: Replica: fbeb96ce37d74060801629e1619de69c, State: Running, Role: LEADER
I20260807 22:40:36.157799 28324 sys_catalog.cc:564] T 00000000000000000000000000000000 P fbeb96ce37d74060801629e1619de69c [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:40:36.157871 28332 consensus_queue.cc:237] T 00000000000000000000000000000000 P fbeb96ce37d74060801629e1619de69c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbeb96ce37d74060801629e1619de69c" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 41893 } }
I20260807 22:40:36.158272 28332 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbeb96ce37d74060801629e1619de69c [sys.catalog]: SysCatalogTable state changed. Reason: New leader fbeb96ce37d74060801629e1619de69c. Latest consensus state: current_term: 1 leader_uuid: "fbeb96ce37d74060801629e1619de69c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbeb96ce37d74060801629e1619de69c" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 41893 } } }
I20260807 22:40:36.158380 28337 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbeb96ce37d74060801629e1619de69c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fbeb96ce37d74060801629e1619de69c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbeb96ce37d74060801629e1619de69c" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 41893 } } }
I20260807 22:40:36.158507 28337 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbeb96ce37d74060801629e1619de69c [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:36.158742 28332 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbeb96ce37d74060801629e1619de69c [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:36.158916 28345 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:40:36.159523 28345 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:40:36.161597 28345 catalog_manager.cc:1347] Generated new cluster ID: 297a4edcfd194c7f91bbada45f5d333b
I20260807 22:40:36.161654 28345 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 22:40:36 dist-test-slave-2d19 krb5kdc[28207](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142435, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:40:36.165663 28345 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:40:36.166260 28331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:36.154319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45318 (local address 127.22.212.126:41893)
0807 22:40:36.154499 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:36.154508 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:36.154534 (+ 26us) server_negotiation.cc:407] Connection header received
0807 22:40:36.155833 (+ 1299us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:36.155841 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:36.155895 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:36.156106 (+ 211us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:36.156924 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:36.158157 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:36.159304 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:36.159976 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:36.160090 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:36.162747 (+ 2657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:36.162751 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:36.162751 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:36.162763 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:36.164519 (+ 1756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:36.164898 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:36.164902 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:36.164903 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:36.165010 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:36.165224 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:36.165226 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:36.165226 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:36.165495 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:36.165694 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:36.165948 (+ 254us) server_negotiation.cc:299] Negotiation successful
0807 22:40:36.166102 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":81,"threads_started":1}
I20260807 22:40:36.166553 28345 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:40:36.167166 23377 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:40:36.170816 28345 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fbeb96ce37d74060801629e1619de69c: Generated new TSK 0
I20260807 22:40:36.170993 28345 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:40:36.184908 28331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:36.181164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45322 (local address 127.22.212.126:41893)
0807 22:40:36.181224 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:36.181227 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:36.181360 (+ 133us) server_negotiation.cc:407] Connection header received
0807 22:40:36.181439 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:36.181440 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:36.181459 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:36.181526 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:36.181930 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:36.182450 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:36.183243 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:36.183475 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:36.183574 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:36.184399 (+ 825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:36.184400 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:36.184401 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:40:36.184602 (+ 201us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:36.184619 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:40:36.184626 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:36.184691 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:36.184783 (+ 92us) server_negotiation.cc:299] Negotiation successful
0807 22:40:36.184810 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260807 22:40:36.187582 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 28223
2026-08-07T22:40:36Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1585 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:40:36 dist-test-slave-2d19 krb5kdc[28383](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:40:36 dist-test-slave-2d19 krb5kdc[28383](info): set up 2 sockets
Aug 07 22:40:36 dist-test-slave-2d19 krb5kdc[28383](info): commencing operation
krb5kdc: starting...
W20260807 22:40:37.459751 23377 mini_kdc.cc:121] Time spent starting KDC: real 1.242s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Aug 07 22:40:37 dist-test-slave-2d19 krb5kdc[28383](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142437, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:40:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:40:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.212.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
I20260807 22:40:37.589685 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:36957
--webserver_interface=127.22.212.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:36585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:36957
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:37.673733 28400 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:37.673997 28400 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:37.674038 28400 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:37.675212 28400 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:40:37.675287 28400 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:37.675310 28400 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:37.675333 28400 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:40:37.675362 28400 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:40:37.676916 28400 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:36585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:36957
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:36957
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28400
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:37.677227 28400 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:37.677482 28400 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:37.682837 28405 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:37.682860 28409 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:37.682912 28406 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:37.683015 28400 server_base.cc:1034] running on GCE node
I20260807 22:40:37.683398 28400 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:37.683712 28400 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:37.684860 28400 hybrid_clock.cc:648] HybridClock initialized: now 1786142437684843 us; error 44 us; skew 500 ppm
Aug 07 22:40:37 dist-test-slave-2d19 krb5kdc[28383](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142437, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:37.690553 28400 init.cc:377] Logged in from keytab as kudu/127.22.212.126@KRBTEST.COM (short username kudu)
I20260807 22:40:37.691071 28400 webserver.cc:460] Webserver started at http://127.22.212.126:45495/ using document root <none> and password file <none>
I20260807 22:40:37.691335 28400 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:37.691411 28400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:37.691583 28400 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:37.692766 28400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "a8c5a527e7464b628d58c6ea9411d5c5"
format_stamp: "Formatted at 2026-08-07 22:40:37 on dist-test-slave-2d19"
server_key: "98807b8f1f570b0c616fa17baf0fdeab"
server_key_iv: "bc59a10c2c62c822fc782ae00f4165ec"
server_key_version: "encryptionkey@0"
I20260807 22:40:37.693138 28400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "a8c5a527e7464b628d58c6ea9411d5c5"
format_stamp: "Formatted at 2026-08-07 22:40:37 on dist-test-slave-2d19"
server_key: "98807b8f1f570b0c616fa17baf0fdeab"
server_key_iv: "bc59a10c2c62c822fc782ae00f4165ec"
server_key_version: "encryptionkey@0"
I20260807 22:40:37.694521 28400 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 22:40:37.695299 28422 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:37.695487 28400 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:40:37.695609 28400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "a8c5a527e7464b628d58c6ea9411d5c5"
format_stamp: "Formatted at 2026-08-07 22:40:37 on dist-test-slave-2d19"
server_key: "98807b8f1f570b0c616fa17baf0fdeab"
server_key_iv: "bc59a10c2c62c822fc782ae00f4165ec"
server_key_version: "encryptionkey@0"
I20260807 22:40:37.695688 28400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:37.706033 28400 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:37.707865 28400 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:37.708036 28400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:37.712112 28400 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:36957
I20260807 22:40:37.712162 28492 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:36957 every 8 connection(s)
I20260807 22:40:37.712577 28400 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:40:37.713681 28494 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:37.715132 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 28400
I20260807 22:40:37.715224 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:40:37.715435 23377 external_mini_cluster.cc:1428] Setting key b2aa51a5357d21264b458b518525f481
I20260807 22:40:37.716602 28494 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8c5a527e7464b628d58c6ea9411d5c5: Bootstrap starting.
I20260807 22:40:37.717321 28494 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a8c5a527e7464b628d58c6ea9411d5c5: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:37.717651 28494 log.cc:824] T 00000000000000000000000000000000 P a8c5a527e7464b628d58c6ea9411d5c5: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:37.718411 28494 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8c5a527e7464b628d58c6ea9411d5c5: No bootstrap required, opened a new log
I20260807 22:40:37.720683 28494 raft_consensus.cc:348] T 00000000000000000000000000000000 P a8c5a527e7464b628d58c6ea9411d5c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8c5a527e7464b628d58c6ea9411d5c5" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36957 } }
I20260807 22:40:37.720866 28494 raft_consensus.cc:374] T 00000000000000000000000000000000 P a8c5a527e7464b628d58c6ea9411d5c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:37.720904 28494 raft_consensus.cc:729] T 00000000000000000000000000000000 P a8c5a527e7464b628d58c6ea9411d5c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c5a527e7464b628d58c6ea9411d5c5, State: Initialized, Role: FOLLOWER
I20260807 22:40:37.721045 28494 consensus_queue.cc:260] T 00000000000000000000000000000000 P a8c5a527e7464b628d58c6ea9411d5c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8c5a527e7464b628d58c6ea9411d5c5" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36957 } }
I20260807 22:40:37.721158 28494 raft_consensus.cc:388] T 00000000000000000000000000000000 P a8c5a527e7464b628d58c6ea9411d5c5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:40:37.721200 28494 raft_consensus.cc:482] T 00000000000000000000000000000000 P a8c5a527e7464b628d58c6ea9411d5c5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:40:37.721259 28494 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a8c5a527e7464b628d58c6ea9411d5c5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:37.721804 28494 raft_consensus.cc:504] T 00000000000000000000000000000000 P a8c5a527e7464b628d58c6ea9411d5c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8c5a527e7464b628d58c6ea9411d5c5" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36957 } }
I20260807 22:40:37.721930 28494 leader_election.cc:302] T 00000000000000000000000000000000 P a8c5a527e7464b628d58c6ea9411d5c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a8c5a527e7464b628d58c6ea9411d5c5; no voters:
I20260807 22:40:37.722116 28494 leader_election.cc:288] T 00000000000000000000000000000000 P a8c5a527e7464b628d58c6ea9411d5c5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:40:37.722153 28505 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a8c5a527e7464b628d58c6ea9411d5c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:40:37.722302 28505 raft_consensus.cc:686] T 00000000000000000000000000000000 P a8c5a527e7464b628d58c6ea9411d5c5 [term 1 LEADER]: Becoming Leader. State: Replica: a8c5a527e7464b628d58c6ea9411d5c5, State: Running, Role: LEADER
I20260807 22:40:37.722386 28494 sys_catalog.cc:564] T 00000000000000000000000000000000 P a8c5a527e7464b628d58c6ea9411d5c5 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:40:37.722388 28505 consensus_queue.cc:237] T 00000000000000000000000000000000 P a8c5a527e7464b628d58c6ea9411d5c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8c5a527e7464b628d58c6ea9411d5c5" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36957 } }
Aug 07 22:40:37 dist-test-slave-2d19 krb5kdc[28383](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142437, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:40:37.722774 28507 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8c5a527e7464b628d58c6ea9411d5c5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a8c5a527e7464b628d58c6ea9411d5c5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8c5a527e7464b628d58c6ea9411d5c5" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36957 } } }
I20260807 22:40:37.722852 28507 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8c5a527e7464b628d58c6ea9411d5c5 [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:37.723045 28509 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8c5a527e7464b628d58c6ea9411d5c5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a8c5a527e7464b628d58c6ea9411d5c5. Latest consensus state: current_term: 1 leader_uuid: "a8c5a527e7464b628d58c6ea9411d5c5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8c5a527e7464b628d58c6ea9411d5c5" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36957 } } }
I20260807 22:40:37.723196 28509 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8c5a527e7464b628d58c6ea9411d5c5 [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:37.723105 28514 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:40:37.723822 28514 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:40:37.725455 28514 catalog_manager.cc:1347] Generated new cluster ID: 5481d9a70223452db0bf7253436b0e4f
I20260807 22:40:37.725962 28514 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:40:37.727101 28501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:37.715972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58822 (local address 127.22.212.126:36957)
0807 22:40:37.716192 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:37.716202 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:37.716235 (+ 33us) server_negotiation.cc:407] Connection header received
0807 22:40:37.716783 (+ 548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:37.716792 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:37.716851 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:37.717051 (+ 200us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:37.717677 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:37.719014 (+ 1337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:37.719748 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:37.720479 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:37.720596 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:37.723269 (+ 2673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:37.723273 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:37.723273 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:37.723284 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:37.725436 (+ 2152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:37.725859 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:37.725863 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:37.725864 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:37.725976 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:37.726211 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:37.726212 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:37.726212 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:37.726454 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:37.726634 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:37.726749 (+ 115us) server_negotiation.cc:299] Negotiation successful
0807 22:40:37.726895 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":103,"threads_started":1}
I20260807 22:40:37.761080 28514 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:40:37.761823 28514 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:40:37.772540 28514 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a8c5a527e7464b628d58c6ea9411d5c5: Generated new TSK 0
I20260807 22:40:37.772763 28514 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.212.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab.
Entry for principal kudu/127.22.212.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab.
I20260807 22:40:37.815173 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.65:0
--local_ip_for_outbound_sockets=127.22.212.65
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:36957
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:36585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:37.909140 28532 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:37.909343 28532 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:37.909368 28532 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:37.910521 28532 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:37.910564 28532 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:37.910591 28532 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.65
I20260807 22:40:37.912123 28532 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:36585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:36957
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28532
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.65
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:37.912407 28532 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:37.912664 28532 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 22:40:37.917838 28532 server_base.cc:1034] running on GCE node
W20260807 22:40:37.917812 28539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:37.917822 28542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:37.917932 28540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:37.918249 28532 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:37.918466 28532 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:37.919607 28532 hybrid_clock.cc:648] HybridClock initialized: now 1786142437919592 us; error 30 us; skew 500 ppm
Aug 07 22:40:37 dist-test-slave-2d19 krb5kdc[28383](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142437, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:37.922169 28532 init.cc:377] Logged in from keytab as kudu/127.22.212.65@KRBTEST.COM (short username kudu)
I20260807 22:40:37.922626 28532 webserver.cc:460] Webserver started at http://127.22.212.65:33807/ using document root <none> and password file <none>
I20260807 22:40:37.922840 28532 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:37.922883 28532 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:37.922973 28532 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:37.924084 28532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-0/data/instance:
uuid: "0c6c6d4fbe0b42c7b5ddbc2027bc149b"
format_stamp: "Formatted at 2026-08-07 22:40:37 on dist-test-slave-2d19"
server_key: "f108e40f4cda728a4077a31574b1fe89"
server_key_iv: "5ee78fa635d939b78371e6161650f791"
server_key_version: "encryptionkey@0"
I20260807 22:40:37.924549 28532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance:
uuid: "0c6c6d4fbe0b42c7b5ddbc2027bc149b"
format_stamp: "Formatted at 2026-08-07 22:40:37 on dist-test-slave-2d19"
server_key: "f108e40f4cda728a4077a31574b1fe89"
server_key_iv: "5ee78fa635d939b78371e6161650f791"
server_key_version: "encryptionkey@0"
I20260807 22:40:37.925844 28532 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 22:40:37.926532 28553 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:37.926702 28532 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 22:40:37.926818 28532 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-0/wal
uuid: "0c6c6d4fbe0b42c7b5ddbc2027bc149b"
format_stamp: "Formatted at 2026-08-07 22:40:37 on dist-test-slave-2d19"
server_key: "f108e40f4cda728a4077a31574b1fe89"
server_key_iv: "5ee78fa635d939b78371e6161650f791"
server_key_version: "encryptionkey@0"
I20260807 22:40:37.926893 28532 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:37.940598 28532 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:37.942669 28532 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:37.942847 28532 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:37.943110 28532 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:37.943450 28532 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:37.943506 28532 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:37.943552 28532 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:37.943583 28532 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:37.949517 28532 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.65:44197
I20260807 22:40:37.949570 28740 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.65:44197 every 8 connection(s)
I20260807 22:40:37.949903 28532 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
I20260807 22:40:37.951571 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 28532
I20260807 22:40:37.951675 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance
I20260807 22:40:37.951889 23377 external_mini_cluster.cc:1428] Setting key db22ce2566f058a06a5d893f5e9bd4a3
Aug 07 22:40:37 dist-test-slave-2d19 krb5kdc[28383](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142437, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:40:37.960487 28501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:37.950653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:47563 (local address 127.22.212.126:36957)
0807 22:40:37.950706 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:37.950708 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:37.950883 (+ 175us) server_negotiation.cc:407] Connection header received
0807 22:40:37.951419 (+ 536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:37.951420 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:37.951432 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:37.951513 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:37.952877 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:37.953645 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:37.954702 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:37.955043 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:37.955115 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:37.957484 (+ 2369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:37.957486 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:37.957486 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:37.957494 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:37.959002 (+ 1508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:37.959441 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:37.959442 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:37.959443 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:37.959507 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:37.959765 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:37.959766 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:37.959766 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:37.959884 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:37.959959 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:37.960245 (+ 286us) server_negotiation.cc:299] Negotiation successful
0807 22:40:37.960384 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 22:40:37.960650 28745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:37.950597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:36957 (local address 127.22.212.65:47563)
0807 22:40:37.950766 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:37.950810 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:37.951308 (+ 498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:37.951589 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:37.951593 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:37.952496 (+ 903us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:37.952779 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:37.952785 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:37.953745 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:37.953745 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:37.954614 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:37.954617 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:37.955139 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:37.955140 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:37.955242 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:37.955844 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:37.955858 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:37.957375 (+ 1517us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:37.959110 (+ 1735us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:37.959118 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:37.959120 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:37.959358 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:37.959580 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:37.959581 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:37.959581 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:37.959696 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:37.959962 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:37.959970 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:37.960112 (+ 142us) client_negotiation.cc:769] Sending connection context
0807 22:40:37.960225 (+ 113us) client_negotiation.cc:240] Negotiation successful
0807 22:40:37.960413 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":95,"threads_started":1}
WARNING: no policy specified for kudu/127.22.212.66@KRBTEST.COM; defaulting to no policy
I20260807 22:40:37.961153 28741 heartbeater.cc:347] Connected to a master server at 127.22.212.126:36957
I20260807 22:40:37.961259 28741 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:37.961462 28741 heartbeater.cc:511] Master 127.22.212.126:36957 requested a full tablet report, sending...
I20260807 22:40:37.962006 28444 ts_manager.cc:194] Registered new tserver with Master: 0c6c6d4fbe0b42c7b5ddbc2027bc149b (127.22.212.65:44197)
I20260807 22:40:37.962663 28444 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.65@KRBTEST.COM'} at 127.22.212.65:47563
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab.
Entry for principal kudu/127.22.212.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab.
I20260807 22:40:37.980008 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.66:0
--local_ip_for_outbound_sockets=127.22.212.66
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:36957
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:36585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:38.065712 28755 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:38.065959 28755 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:38.066005 28755 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:38.067205 28755 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:38.067284 28755 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:38.067327 28755 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.66
I20260807 22:40:38.068846 28755 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:36585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:36957
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28755
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.66
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:38.069128 28755 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:38.069371 28755 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:38.074796 28762 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:38.074826 28760 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:38.074841 28755 server_base.cc:1034] running on GCE node
W20260807 22:40:38.074808 28765 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:38.075213 28755 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:38.075418 28755 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:38.076570 28755 hybrid_clock.cc:648] HybridClock initialized: now 1786142438076559 us; error 36 us; skew 500 ppm
Aug 07 22:40:38 dist-test-slave-2d19 krb5kdc[28383](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142438, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:38.079128 28755 init.cc:377] Logged in from keytab as kudu/127.22.212.66@KRBTEST.COM (short username kudu)
I20260807 22:40:38.079629 28755 webserver.cc:460] Webserver started at http://127.22.212.66:35239/ using document root <none> and password file <none>
I20260807 22:40:38.079864 28755 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:38.079932 28755 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:38.080089 28755 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:38.081223 28755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-1/data/instance:
uuid: "3c16ab3339ea4bb293e3472781271b31"
format_stamp: "Formatted at 2026-08-07 22:40:38 on dist-test-slave-2d19"
server_key: "2b21ff39598fe17ebef3cda2287bef51"
server_key_iv: "10ec2b3f45ed9440fafdeb5c219d9415"
server_key_version: "encryptionkey@0"
I20260807 22:40:38.081609 28755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance:
uuid: "3c16ab3339ea4bb293e3472781271b31"
format_stamp: "Formatted at 2026-08-07 22:40:38 on dist-test-slave-2d19"
server_key: "2b21ff39598fe17ebef3cda2287bef51"
server_key_iv: "10ec2b3f45ed9440fafdeb5c219d9415"
server_key_version: "encryptionkey@0"
I20260807 22:40:38.082948 28755 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 22:40:38.083663 28774 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:38.083828 28755 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 22:40:38.083936 28755 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-1/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-1/wal
uuid: "3c16ab3339ea4bb293e3472781271b31"
format_stamp: "Formatted at 2026-08-07 22:40:38 on dist-test-slave-2d19"
server_key: "2b21ff39598fe17ebef3cda2287bef51"
server_key_iv: "10ec2b3f45ed9440fafdeb5c219d9415"
server_key_version: "encryptionkey@0"
I20260807 22:40:38.084013 28755 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:38.112864 28755 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:38.115139 28755 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:38.115329 28755 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:38.115698 28755 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:38.116165 28755 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:38.116240 28755 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:38.116299 28755 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:38.116328 28755 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:38.122553 28755 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.66:33513
I20260807 22:40:38.122598 28940 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.66:33513 every 8 connection(s)
I20260807 22:40:38.123031 28755 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
I20260807 22:40:38.126672 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 28755
I20260807 22:40:38.126782 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance
I20260807 22:40:38.126992 23377 external_mini_cluster.cc:1428] Setting key 010bd51373a5cb5494d9e7880251c57b
Aug 07 22:40:38 dist-test-slave-2d19 krb5kdc[28383](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142438, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:40:38.134102 28501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:38.123833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:38457 (local address 127.22.212.126:36957)
0807 22:40:38.123898 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:38.123900 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:38.124099 (+ 199us) server_negotiation.cc:407] Connection header received
0807 22:40:38.124706 (+ 607us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:38.124707 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:38.124718 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:38.124783 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:38.125732 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:38.126235 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:38.127661 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:38.127913 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:38.127982 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:38.130834 (+ 2852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:38.130836 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:38.130836 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:38.130847 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:38.132505 (+ 1658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:38.133016 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:38.133017 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:38.133017 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:38.133070 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:38.133373 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:38.133374 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:38.133374 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:38.133504 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:38.133561 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:38.133955 (+ 394us) server_negotiation.cc:299] Negotiation successful
0807 22:40:38.134034 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 22:40:38.134431 28945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:38.123836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:36957 (local address 127.22.212.66:38457)
0807 22:40:38.123992 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:38.124030 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:38.124589 (+ 559us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:38.124840 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:38.124843 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:38.125435 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:38.125641 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:38.125646 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:38.126320 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:38.126321 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:38.127537 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:38.127539 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:38.128008 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:38.128009 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:38.128158 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:38.128696 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:38.128707 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:38.130718 (+ 2011us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:38.132573 (+ 1855us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:38.132581 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:38.132584 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:38.132923 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:38.133138 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:38.133138 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:38.133138 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:38.133300 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:38.133577 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:38.133584 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:38.133784 (+ 200us) client_negotiation.cc:769] Sending connection context
0807 22:40:38.133919 (+ 135us) client_negotiation.cc:240] Negotiation successful
0807 22:40:38.134129 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":91,"threads_started":1}
I20260807 22:40:38.135030 28942 heartbeater.cc:347] Connected to a master server at 127.22.212.126:36957
I20260807 22:40:38.135150 28942 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:38.135357 28942 heartbeater.cc:511] Master 127.22.212.126:36957 requested a full tablet report, sending...
I20260807 22:40:38.135800 28444 ts_manager.cc:194] Registered new tserver with Master: 3c16ab3339ea4bb293e3472781271b31 (127.22.212.66:33513)
I20260807 22:40:38.136198 28444 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.66@KRBTEST.COM'} at 127.22.212.66:38457
WARNING: no policy specified for kudu/127.22.212.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab.
Entry for principal kudu/127.22.212.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab.
I20260807 22:40:38.157120 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.67:0
--local_ip_for_outbound_sockets=127.22.212.67
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:36957
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:36585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:38.247884 28950 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:38.248174 28950 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:38.248216 28950 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:38.250717 28950 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:38.250790 28950 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:38.250833 28950 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.67
I20260807 22:40:38.253075 28950 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:36585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:36957
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28950
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.67
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:38.253363 28950 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:38.253656 28950 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:38.259804 28956 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:38.259809 28959 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:38.260028 28950 server_base.cc:1034] running on GCE node
W20260807 22:40:38.260165 28957 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:38.260462 28950 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:38.262696 28950 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:38.263873 28950 hybrid_clock.cc:648] HybridClock initialized: now 1786142438263847 us; error 42 us; skew 500 ppm
Aug 07 22:40:38 dist-test-slave-2d19 krb5kdc[28383](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142438, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:38.266853 28950 init.cc:377] Logged in from keytab as kudu/127.22.212.67@KRBTEST.COM (short username kudu)
I20260807 22:40:38.267293 28950 webserver.cc:460] Webserver started at http://127.22.212.67:37365/ using document root <none> and password file <none>
I20260807 22:40:38.267554 28950 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:38.267623 28950 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:38.267765 28950 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:38.268930 28950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-2/data/instance:
uuid: "f22c84fd80b4466889ec7ecc524d218a"
format_stamp: "Formatted at 2026-08-07 22:40:38 on dist-test-slave-2d19"
server_key: "95a53808f81e99e09fbf49dc12245af9"
server_key_iv: "f9ce7783371874369c89394a6e3645ec"
server_key_version: "encryptionkey@0"
I20260807 22:40:38.269315 28950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance:
uuid: "f22c84fd80b4466889ec7ecc524d218a"
format_stamp: "Formatted at 2026-08-07 22:40:38 on dist-test-slave-2d19"
server_key: "95a53808f81e99e09fbf49dc12245af9"
server_key_iv: "f9ce7783371874369c89394a6e3645ec"
server_key_version: "encryptionkey@0"
I20260807 22:40:38.270649 28950 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260807 22:40:38.271364 28966 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:38.271551 28950 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 22:40:38.271656 28950 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-2/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-2/wal
uuid: "f22c84fd80b4466889ec7ecc524d218a"
format_stamp: "Formatted at 2026-08-07 22:40:38 on dist-test-slave-2d19"
server_key: "95a53808f81e99e09fbf49dc12245af9"
server_key_iv: "f9ce7783371874369c89394a6e3645ec"
server_key_version: "encryptionkey@0"
I20260807 22:40:38.271726 28950 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:38.284135 28950 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:38.286098 28950 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:38.286254 28950 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:38.286494 28950 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:38.286819 28950 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:38.286900 28950 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:38.286936 28950 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:38.286974 28950 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:38.292953 28950 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.67:41425
I20260807 22:40:38.293058 29144 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.67:41425 every 8 connection(s)
I20260807 22:40:38.293345 28950 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
Aug 07 22:40:38 dist-test-slave-2d19 krb5kdc[28383](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142438, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:40:38.302775 28501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:38.294080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:54469 (local address 127.22.212.126:36957)
0807 22:40:38.294145 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:38.294147 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:38.294356 (+ 209us) server_negotiation.cc:407] Connection header received
0807 22:40:38.294910 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:38.294912 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:38.294926 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:38.294977 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:38.295943 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:38.296540 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:38.297550 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:38.297757 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:38.297839 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:38.300420 (+ 2581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:38.300421 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:38.300421 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:38.300428 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:38.301625 (+ 1197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:38.301980 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:38.301981 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:38.301981 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:38.302048 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:38.302254 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:38.302254 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:38.302255 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:38.302355 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:38.302406 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:38.302647 (+ 241us) server_negotiation.cc:299] Negotiation successful
0807 22:40:38.302708 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 22:40:38.303010 29155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:38.294055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:36957 (local address 127.22.212.67:54469)
0807 22:40:38.294229 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:38.294271 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:38.294793 (+ 522us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:38.295067 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:38.295073 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:38.295651 (+ 578us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:38.295838 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:38.295843 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:38.296634 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:38.296635 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:38.297447 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:38.297449 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:38.297846 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:38.297847 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:38.297983 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:38.298593 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:38.298603 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:38.300328 (+ 1725us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:38.301696 (+ 1368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:38.301702 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:38.301704 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:38.301915 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:38.302108 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:38.302109 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:38.302109 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:38.302200 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:38.302409 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:38.302413 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:38.302522 (+ 109us) client_negotiation.cc:769] Sending connection context
0807 22:40:38.302621 (+ 99us) client_negotiation.cc:240] Negotiation successful
0807 22:40:38.302741 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":87,"threads_started":1}
I20260807 22:40:38.303313 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 28950
I20260807 22:40:38.303416 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance
I20260807 22:40:38.303607 23377 external_mini_cluster.cc:1428] Setting key bf8f1222d234b3cab59563f6380e70d3
I20260807 22:40:38.303587 29152 heartbeater.cc:347] Connected to a master server at 127.22.212.126:36957
I20260807 22:40:38.303696 29152 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:38.303902 29152 heartbeater.cc:511] Master 127.22.212.126:36957 requested a full tablet report, sending...
I20260807 22:40:38.304420 28443 ts_manager.cc:194] Registered new tserver with Master: f22c84fd80b4466889ec7ecc524d218a (127.22.212.67:41425)
I20260807 22:40:38.304786 28443 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.67@KRBTEST.COM'} at 127.22.212.67:54469
I20260807 22:40:38.315289 23377 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 22:40:38 dist-test-slave-2d19 krb5kdc[28383](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142438, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 07 22:40:38 dist-test-slave-2d19 krb5kdc[28383](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142438, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:40:38.339679 28501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:38.332436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58824 (local address 127.22.212.126:36957)
0807 22:40:38.332497 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:38.332499 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:38.332732 (+ 233us) server_negotiation.cc:407] Connection header received
0807 22:40:38.332768 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:38.332769 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:38.332780 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:38.332831 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:38.333520 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:38.334008 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:38.334881 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:38.335072 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:38.335125 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:38.337507 (+ 2382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:38.337508 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:38.337509 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:38.337516 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:38.338718 (+ 1202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:38.339036 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:38.339037 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:38.339037 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:38.339086 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:38.339250 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:38.339251 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:38.339251 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:38.339391 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:38.339467 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:38.339551 (+ 84us) server_negotiation.cc:299] Negotiation successful
0807 22:40:38.339611 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
W20260807 22:40:38.339949 28443 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:58824
I20260807 22:40:38.340631 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 28532
I20260807 22:40:38.357831 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 28755
I20260807 22:40:38.372864 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 28950
I20260807 22:40:38.391767 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 28400
2026-08-07T22:40:38Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2201 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:40:38 dist-test-slave-2d19 krb5kdc[29168](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:40:38 dist-test-slave-2d19 krb5kdc[29168](info): set up 2 sockets
Aug 07 22:40:38 dist-test-slave-2d19 krb5kdc[29168](info): commencing operation
krb5kdc: starting...
W20260807 22:40:39.673434 23377 mini_kdc.cc:121] Time spent starting KDC: real 1.254s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Aug 07 22:40:39 dist-test-slave-2d19 krb5kdc[29168](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142439, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:40:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:40:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.212.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
I20260807 22:40:39.803884 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:46439
--webserver_interface=127.22.212.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:35701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:46439
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:39.889518 29184 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:39.889731 29184 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:39.889755 29184 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:39.890856 29184 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:40:39.890889 29184 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:39.890903 29184 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:39.890916 29184 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:40:39.890928 29184 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:40:39.892474 29184 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:35701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:46439
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:46439
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29184
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:39.892688 29184 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:39.892867 29184 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:39.898145 29193 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:39.898145 29191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:39.898136 29196 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:39.898337 29184 server_base.cc:1034] running on GCE node
I20260807 22:40:39.898589 29184 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:39.898885 29184 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:39.900053 29184 hybrid_clock.cc:648] HybridClock initialized: now 1786142439900028 us; error 36 us; skew 500 ppm
Aug 07 22:40:39 dist-test-slave-2d19 krb5kdc[29168](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142439, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:39.902595 29184 init.cc:377] Logged in from keytab as kudu/127.22.212.126@KRBTEST.COM (short username kudu)
I20260807 22:40:39.903023 29184 webserver.cc:460] Webserver started at http://127.22.212.126:42665/ using document root <none> and password file <none>
I20260807 22:40:39.903277 29184 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:39.903347 29184 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:39.903498 29184 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:39.904698 29184 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "ba07fbf93d034b3b86748ef3dbbe1e4c"
format_stamp: "Formatted at 2026-08-07 22:40:39 on dist-test-slave-2d19"
server_key: "ff1152186b05095b41023af00a7a3815"
server_key_iv: "525fd3c6be08c46f0e02ebb01d55ca0c"
server_key_version: "encryptionkey@0"
I20260807 22:40:39.905074 29184 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "ba07fbf93d034b3b86748ef3dbbe1e4c"
format_stamp: "Formatted at 2026-08-07 22:40:39 on dist-test-slave-2d19"
server_key: "ff1152186b05095b41023af00a7a3815"
server_key_iv: "525fd3c6be08c46f0e02ebb01d55ca0c"
server_key_version: "encryptionkey@0"
I20260807 22:40:39.906440 29184 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 22:40:39.907151 29209 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:39.907322 29184 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 22:40:39.907436 29184 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "ba07fbf93d034b3b86748ef3dbbe1e4c"
format_stamp: "Formatted at 2026-08-07 22:40:39 on dist-test-slave-2d19"
server_key: "ff1152186b05095b41023af00a7a3815"
server_key_iv: "525fd3c6be08c46f0e02ebb01d55ca0c"
server_key_version: "encryptionkey@0"
I20260807 22:40:39.907521 29184 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:39.932417 29184 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:39.934381 29184 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:39.934557 29184 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:39.938656 29184 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:46439
I20260807 22:40:39.938690 29287 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:46439 every 8 connection(s)
I20260807 22:40:39.939203 29184 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:40:39.939702 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 29184
I20260807 22:40:39.939800 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:40:39.940004 23377 external_mini_cluster.cc:1428] Setting key d53b7832412f23716b2810da2050123f
I20260807 22:40:39.940096 29288 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:39.943706 29288 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba07fbf93d034b3b86748ef3dbbe1e4c: Bootstrap starting.
I20260807 22:40:39.944460 29288 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ba07fbf93d034b3b86748ef3dbbe1e4c: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:39.944764 29288 log.cc:824] T 00000000000000000000000000000000 P ba07fbf93d034b3b86748ef3dbbe1e4c: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:39.945465 29288 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba07fbf93d034b3b86748ef3dbbe1e4c: No bootstrap required, opened a new log
Aug 07 22:40:39 dist-test-slave-2d19 krb5kdc[29168](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142439, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:40:39.947858 29288 raft_consensus.cc:348] T 00000000000000000000000000000000 P ba07fbf93d034b3b86748ef3dbbe1e4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba07fbf93d034b3b86748ef3dbbe1e4c" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 46439 } }
I20260807 22:40:39.948000 29288 raft_consensus.cc:374] T 00000000000000000000000000000000 P ba07fbf93d034b3b86748ef3dbbe1e4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:39.948024 29288 raft_consensus.cc:729] T 00000000000000000000000000000000 P ba07fbf93d034b3b86748ef3dbbe1e4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba07fbf93d034b3b86748ef3dbbe1e4c, State: Initialized, Role: FOLLOWER
I20260807 22:40:39.948215 29288 consensus_queue.cc:260] T 00000000000000000000000000000000 P ba07fbf93d034b3b86748ef3dbbe1e4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba07fbf93d034b3b86748ef3dbbe1e4c" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 46439 } }
I20260807 22:40:39.948369 29288 raft_consensus.cc:388] T 00000000000000000000000000000000 P ba07fbf93d034b3b86748ef3dbbe1e4c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:40:39.948418 29288 raft_consensus.cc:482] T 00000000000000000000000000000000 P ba07fbf93d034b3b86748ef3dbbe1e4c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:40:39.948474 29288 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ba07fbf93d034b3b86748ef3dbbe1e4c [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:39.949023 29288 raft_consensus.cc:504] T 00000000000000000000000000000000 P ba07fbf93d034b3b86748ef3dbbe1e4c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba07fbf93d034b3b86748ef3dbbe1e4c" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 46439 } }
I20260807 22:40:39.949151 29288 leader_election.cc:302] T 00000000000000000000000000000000 P ba07fbf93d034b3b86748ef3dbbe1e4c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ba07fbf93d034b3b86748ef3dbbe1e4c; no voters:
I20260807 22:40:39.949368 29288 leader_election.cc:288] T 00000000000000000000000000000000 P ba07fbf93d034b3b86748ef3dbbe1e4c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:40:39.949399 29296 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ba07fbf93d034b3b86748ef3dbbe1e4c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:40:39.949507 29296 raft_consensus.cc:686] T 00000000000000000000000000000000 P ba07fbf93d034b3b86748ef3dbbe1e4c [term 1 LEADER]: Becoming Leader. State: Replica: ba07fbf93d034b3b86748ef3dbbe1e4c, State: Running, Role: LEADER
I20260807 22:40:39.949595 29296 consensus_queue.cc:237] T 00000000000000000000000000000000 P ba07fbf93d034b3b86748ef3dbbe1e4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba07fbf93d034b3b86748ef3dbbe1e4c" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 46439 } }
I20260807 22:40:39.949667 29288 sys_catalog.cc:564] T 00000000000000000000000000000000 P ba07fbf93d034b3b86748ef3dbbe1e4c [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:40:39.949929 29296 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba07fbf93d034b3b86748ef3dbbe1e4c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ba07fbf93d034b3b86748ef3dbbe1e4c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba07fbf93d034b3b86748ef3dbbe1e4c" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 46439 } } }
I20260807 22:40:39.950088 29296 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba07fbf93d034b3b86748ef3dbbe1e4c [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:39.950280 29296 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba07fbf93d034b3b86748ef3dbbe1e4c [sys.catalog]: SysCatalogTable state changed. Reason: New leader ba07fbf93d034b3b86748ef3dbbe1e4c. Latest consensus state: current_term: 1 leader_uuid: "ba07fbf93d034b3b86748ef3dbbe1e4c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba07fbf93d034b3b86748ef3dbbe1e4c" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 46439 } } }
I20260807 22:40:39.950407 29296 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba07fbf93d034b3b86748ef3dbbe1e4c [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:39.950829 29305 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:40:39.951457 29305 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:40:39.951797 29292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:39.940565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60846 (local address 127.22.212.126:46439)
0807 22:40:39.940751 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:39.940761 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:39.940859 (+ 98us) server_negotiation.cc:407] Connection header received
0807 22:40:39.941422 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:39.941429 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:39.941476 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:39.941596 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:39.942408 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:39.943276 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:39.944333 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:39.944800 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:39.944972 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:39.947694 (+ 2722us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:39.947698 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:39.947698 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:39.947710 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:39.949900 (+ 2190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:39.950379 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:39.950382 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:39.950382 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:39.950494 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:39.950717 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:39.950718 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:39.950718 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:39.951059 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:39.951281 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:39.951409 (+ 128us) server_negotiation.cc:299] Negotiation successful
0807 22:40:39.951560 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":101,"threads_started":1}
I20260807 22:40:39.953230 29305 catalog_manager.cc:1347] Generated new cluster ID: a7b4506f9da74345b904129eba2456a7
I20260807 22:40:39.953295 29305 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:40:39.965957 29305 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:40:39.966495 29305 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:40:39.971271 29305 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ba07fbf93d034b3b86748ef3dbbe1e4c: Generated new TSK 0
I20260807 22:40:39.971464 29305 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.212.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab.
Entry for principal kudu/127.22.212.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab.
I20260807 22:40:40.008220 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.65:0
--local_ip_for_outbound_sockets=127.22.212.65
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:46439
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:35701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:40.095175 29332 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:40.095386 29332 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:40.095413 29332 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:40.096597 29332 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:40.096639 29332 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:40.096665 29332 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.65
I20260807 22:40:40.098126 29332 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:35701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:46439
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29332
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.65
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:40.098307 29332 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:40.098488 29332 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:40.103555 29337 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:40.103760 29338 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:40.103571 29340 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:40.103866 29332 server_base.cc:1034] running on GCE node
I20260807 22:40:40.104144 29332 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:40.104449 29332 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:40.105599 29332 hybrid_clock.cc:648] HybridClock initialized: now 1786142440105574 us; error 46 us; skew 500 ppm
Aug 07 22:40:40 dist-test-slave-2d19 krb5kdc[29168](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142440, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:40.108470 29332 init.cc:377] Logged in from keytab as kudu/127.22.212.65@KRBTEST.COM (short username kudu)
I20260807 22:40:40.108979 29332 webserver.cc:460] Webserver started at http://127.22.212.65:46623/ using document root <none> and password file <none>
I20260807 22:40:40.109226 29332 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:40.109272 29332 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:40.109440 29332 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:40.110704 29332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-0/data/instance:
uuid: "a05e95460bb64dc68d23ea2ed4c6133f"
format_stamp: "Formatted at 2026-08-07 22:40:40 on dist-test-slave-2d19"
server_key: "9fd42011527febe14e932c9971329fd9"
server_key_iv: "c6fae503acd19757328c1fc9e6608d5d"
server_key_version: "encryptionkey@0"
I20260807 22:40:40.111078 29332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance:
uuid: "a05e95460bb64dc68d23ea2ed4c6133f"
format_stamp: "Formatted at 2026-08-07 22:40:40 on dist-test-slave-2d19"
server_key: "9fd42011527febe14e932c9971329fd9"
server_key_iv: "c6fae503acd19757328c1fc9e6608d5d"
server_key_version: "encryptionkey@0"
I20260807 22:40:40.112699 29332 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 22:40:40.113559 29349 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:40.113775 29332 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:40:40.113894 29332 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-0/wal
uuid: "a05e95460bb64dc68d23ea2ed4c6133f"
format_stamp: "Formatted at 2026-08-07 22:40:40 on dist-test-slave-2d19"
server_key: "9fd42011527febe14e932c9971329fd9"
server_key_iv: "c6fae503acd19757328c1fc9e6608d5d"
server_key_version: "encryptionkey@0"
I20260807 22:40:40.113961 29332 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:40.123579 29332 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:40.126161 29332 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:40.126332 29332 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:40.126571 29332 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:40.126902 29332 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:40.126959 29332 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:40.127004 29332 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:40.127032 29332 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:40.133210 29332 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.65:34099
I20260807 22:40:40.133255 29527 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.65:34099 every 8 connection(s)
I20260807 22:40:40.133589 29332 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
I20260807 22:40:40.134652 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 29332
I20260807 22:40:40.134770 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance
I20260807 22:40:40.134967 23377 external_mini_cluster.cc:1428] Setting key b5fe0a3b7855c1cb64b906b35b18b5f3
Aug 07 22:40:40 dist-test-slave-2d19 krb5kdc[29168](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142440, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:40:40.144814 29292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:40.134311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:47631 (local address 127.22.212.126:46439)
0807 22:40:40.134369 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:40.134371 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:40.134589 (+ 218us) server_negotiation.cc:407] Connection header received
0807 22:40:40.135702 (+ 1113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:40.135703 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:40.135717 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:40.135785 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:40.136516 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:40.137258 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:40.138822 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:40.139108 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:40.139183 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:40.141487 (+ 2304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:40.141489 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:40.141490 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:40.141499 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:40.143228 (+ 1729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:40.143650 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:40.143651 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:40.143652 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:40.143713 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:40.143996 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:40.143997 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:40.143998 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:40.144155 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:40.144234 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:40.144609 (+ 375us) server_negotiation.cc:299] Negotiation successful
0807 22:40:40.144713 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 22:40:40.144876 29531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:40.134261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:46439 (local address 127.22.212.65:47631)
0807 22:40:40.134458 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:40.134504 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:40.135586 (+ 1082us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:40.135870 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:40.135875 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:40.136155 (+ 280us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:40.136421 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:40.136426 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:40.137385 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:40.137386 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:40.138726 (+ 1340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:40.138730 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:40.139204 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:40.139205 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:40.139314 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:40.139886 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:40.139898 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:40.141378 (+ 1480us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:40.143320 (+ 1942us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:40.143328 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:40.143330 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:40.143569 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:40.143807 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:40.143808 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:40.143808 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:40.143918 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:40.144303 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:40.144312 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:40.144452 (+ 140us) client_negotiation.cc:769] Sending connection context
0807 22:40:40.144563 (+ 111us) client_negotiation.cc:240] Negotiation successful
0807 22:40:40.144703 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":104,"threads_started":1}
WARNING: no policy specified for kudu/127.22.212.66@KRBTEST.COM; defaulting to no policy
I20260807 22:40:40.145783 29529 heartbeater.cc:347] Connected to a master server at 127.22.212.126:46439
I20260807 22:40:40.145905 29529 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:40.146132 29529 heartbeater.cc:511] Master 127.22.212.126:46439 requested a full tablet report, sending...
I20260807 22:40:40.146708 29233 ts_manager.cc:194] Registered new tserver with Master: a05e95460bb64dc68d23ea2ed4c6133f (127.22.212.65:34099)
I20260807 22:40:40.147480 29233 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.65@KRBTEST.COM'} at 127.22.212.65:47631
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab.
Entry for principal kudu/127.22.212.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab.
I20260807 22:40:40.166777 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.66:0
--local_ip_for_outbound_sockets=127.22.212.66
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:46439
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:35701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:40.254037 29535 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:40.254254 29535 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:40.254277 29535 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:40.255451 29535 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:40.255498 29535 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:40.255524 29535 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.66
I20260807 22:40:40.257184 29535 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:35701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:46439
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29535
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.66
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:40.257457 29535 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:40.257705 29535 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:40.263013 29542 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:40.262985 29546 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:40.262985 29544 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:40.263407 29535 server_base.cc:1034] running on GCE node
I20260807 22:40:40.263609 29535 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:40.263816 29535 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:40.264950 29535 hybrid_clock.cc:648] HybridClock initialized: now 1786142440264927 us; error 38 us; skew 500 ppm
Aug 07 22:40:40 dist-test-slave-2d19 krb5kdc[29168](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142440, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:40.267560 29535 init.cc:377] Logged in from keytab as kudu/127.22.212.66@KRBTEST.COM (short username kudu)
I20260807 22:40:40.267941 29535 webserver.cc:460] Webserver started at http://127.22.212.66:40599/ using document root <none> and password file <none>
I20260807 22:40:40.268128 29535 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:40.268168 29535 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:40.268313 29535 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:40.269326 29535 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-1/data/instance:
uuid: "9ae1a8a1efe64a949d6e31194ba646b5"
format_stamp: "Formatted at 2026-08-07 22:40:40 on dist-test-slave-2d19"
server_key: "a5ee392466588fa9f2ec03329176d852"
server_key_iv: "ecbb2b7bd22d0fe2b0b50e185f14d8b8"
server_key_version: "encryptionkey@0"
I20260807 22:40:40.269640 29535 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance:
uuid: "9ae1a8a1efe64a949d6e31194ba646b5"
format_stamp: "Formatted at 2026-08-07 22:40:40 on dist-test-slave-2d19"
server_key: "a5ee392466588fa9f2ec03329176d852"
server_key_iv: "ecbb2b7bd22d0fe2b0b50e185f14d8b8"
server_key_version: "encryptionkey@0"
I20260807 22:40:40.271023 29535 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260807 22:40:40.271669 29554 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:40.271843 29535 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 22:40:40.271958 29535 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-1/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-1/wal
uuid: "9ae1a8a1efe64a949d6e31194ba646b5"
format_stamp: "Formatted at 2026-08-07 22:40:40 on dist-test-slave-2d19"
server_key: "a5ee392466588fa9f2ec03329176d852"
server_key_iv: "ecbb2b7bd22d0fe2b0b50e185f14d8b8"
server_key_version: "encryptionkey@0"
I20260807 22:40:40.272032 29535 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:40.292620 29535 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:40.295769 29535 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:40.295940 29535 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:40.296242 29535 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:40.296674 29535 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:40.296723 29535 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:40.296766 29535 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:40.296794 29535 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:40.307749 29535 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.66:42987
I20260807 22:40:40.307793 29736 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.66:42987 every 8 connection(s)
I20260807 22:40:40.308140 29535 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
I20260807 22:40:40.313237 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 29535
I20260807 22:40:40.313356 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance
I20260807 22:40:40.313561 23377 external_mini_cluster.cc:1428] Setting key 8fc4130e4c72a583d8c62918bb5cf278
Aug 07 22:40:40 dist-test-slave-2d19 krb5kdc[29168](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142440, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:40:40.319094 29292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:40.308932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:42075 (local address 127.22.212.126:46439)
0807 22:40:40.308984 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:40.308987 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:40.309237 (+ 250us) server_negotiation.cc:407] Connection header received
0807 22:40:40.310287 (+ 1050us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:40.310288 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:40.310300 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:40.310356 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:40.311046 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:40.311570 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:40.312622 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:40.312814 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:40.312871 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:40.315596 (+ 2725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:40.315598 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:40.315598 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:40.315605 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:40.317489 (+ 1884us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:40.318039 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:40.318040 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:40.318040 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:40.318096 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:40.318424 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:40.318425 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:40.318425 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:40.318551 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:40.318606 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:40.318941 (+ 335us) server_negotiation.cc:299] Negotiation successful
0807 22:40:40.319029 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 22:40:40.319444 29742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:40.308917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:46439 (local address 127.22.212.66:42075)
0807 22:40:40.309104 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:40.309143 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:40.310190 (+ 1047us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:40.310414 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:40.310417 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:40.310684 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:40.310932 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:40.310937 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:40.311654 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:40.311655 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:40.312543 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:40.312546 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:40.312899 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:40.312899 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:40.312994 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:40.313547 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:40.313556 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:40.315500 (+ 1944us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:40.317571 (+ 2071us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:40.317577 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:40.317580 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:40.317950 (+ 370us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:40.318168 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:40.318169 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:40.318169 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:40.318322 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:40.318620 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:40.318626 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:40.318802 (+ 176us) client_negotiation.cc:769] Sending connection context
0807 22:40:40.318921 (+ 119us) client_negotiation.cc:240] Negotiation successful
0807 22:40:40.319138 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":91,"threads_started":1}
I20260807 22:40:40.320003 29739 heartbeater.cc:347] Connected to a master server at 127.22.212.126:46439
I20260807 22:40:40.320102 29739 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:40.320356 29739 heartbeater.cc:511] Master 127.22.212.126:46439 requested a full tablet report, sending...
I20260807 22:40:40.320793 29233 ts_manager.cc:194] Registered new tserver with Master: 9ae1a8a1efe64a949d6e31194ba646b5 (127.22.212.66:42987)
I20260807 22:40:40.321384 29233 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.66@KRBTEST.COM'} at 127.22.212.66:42075
WARNING: no policy specified for kudu/127.22.212.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab.
Entry for principal kudu/127.22.212.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab.
I20260807 22:40:40.343524 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.67:0
--local_ip_for_outbound_sockets=127.22.212.67
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:46439
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:35701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:40.429646 29747 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:40.429850 29747 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:40.429874 29747 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:40.430991 29747 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:40.431032 29747 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:40.431061 29747 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.67
I20260807 22:40:40.432587 29747 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:35701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:46439
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29747
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.67
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:40.432787 29747 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:40.432972 29747 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:40.438807 29758 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:40.438812 29759 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:40.438859 29747 server_base.cc:1034] running on GCE node
W20260807 22:40:40.438786 29762 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:40.439316 29747 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:40.439595 29747 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:40.440764 29747 hybrid_clock.cc:648] HybridClock initialized: now 1786142440440751 us; error 43 us; skew 500 ppm
Aug 07 22:40:40 dist-test-slave-2d19 krb5kdc[29168](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142440, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:40.443372 29747 init.cc:377] Logged in from keytab as kudu/127.22.212.67@KRBTEST.COM (short username kudu)
I20260807 22:40:40.443856 29747 webserver.cc:460] Webserver started at http://127.22.212.67:36577/ using document root <none> and password file <none>
I20260807 22:40:40.444073 29747 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:40.444115 29747 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:40.444207 29747 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:40.445433 29747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-2/data/instance:
uuid: "ba705caabbed4c2cb0badb6391fa8a06"
format_stamp: "Formatted at 2026-08-07 22:40:40 on dist-test-slave-2d19"
server_key: "00f6c4b2e631e6b3f08142e0bb67dd9b"
server_key_iv: "33c14d430a91bb354be20056aa0b6495"
server_key_version: "encryptionkey@0"
I20260807 22:40:40.445756 29747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance:
uuid: "ba705caabbed4c2cb0badb6391fa8a06"
format_stamp: "Formatted at 2026-08-07 22:40:40 on dist-test-slave-2d19"
server_key: "00f6c4b2e631e6b3f08142e0bb67dd9b"
server_key_iv: "33c14d430a91bb354be20056aa0b6495"
server_key_version: "encryptionkey@0"
I20260807 22:40:40.447125 29747 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 22:40:40.447865 29774 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:40.448052 29747 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:40:40.448130 29747 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-2/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-2/wal
uuid: "ba705caabbed4c2cb0badb6391fa8a06"
format_stamp: "Formatted at 2026-08-07 22:40:40 on dist-test-slave-2d19"
server_key: "00f6c4b2e631e6b3f08142e0bb67dd9b"
server_key_iv: "33c14d430a91bb354be20056aa0b6495"
server_key_version: "encryptionkey@0"
I20260807 22:40:40.448227 29747 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:40.472447 29747 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:40.475009 29747 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:40.475172 29747 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:40.475459 29747 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:40.475824 29747 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:40.475893 29747 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:40.475931 29747 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:40.475976 29747 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:40.482112 29747 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.67:33821
I20260807 22:40:40.482157 29932 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.67:33821 every 8 connection(s)
I20260807 22:40:40.482484 29747 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
Aug 07 22:40:40 dist-test-slave-2d19 krb5kdc[29168](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142440, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:40:40.490141 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 29747
I20260807 22:40:40.490242 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance
I20260807 22:40:40.490468 23377 external_mini_cluster.cc:1428] Setting key 2adcee98cc1bcc99daab68ca914df7b1
I20260807 22:40:40.492508 29292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:40.483266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:41937 (local address 127.22.212.126:46439)
0807 22:40:40.483338 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:40.483340 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:40.483575 (+ 235us) server_negotiation.cc:407] Connection header received
0807 22:40:40.484696 (+ 1121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:40.484697 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:40.484712 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:40.484759 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:40.485406 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:40.485924 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:40.486932 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:40.487133 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:40.487221 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:40.489356 (+ 2135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:40.489358 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:40.489358 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:40.489365 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:40.491151 (+ 1786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:40.491684 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:40.491685 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:40.491685 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:40.491738 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:40.491967 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:40.491968 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:40.491968 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:40.492073 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:40.492124 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:40.492386 (+ 262us) server_negotiation.cc:299] Negotiation successful
0807 22:40:40.492447 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 22:40:40.492754 29938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:40.483247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:46439 (local address 127.22.212.67:41937)
0807 22:40:40.483447 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:40.483485 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:40.484571 (+ 1086us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:40.484845 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:40.484856 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:40.485110 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:40.485309 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:40.485314 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:40.486022 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:40.486023 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:40.486834 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:40.486836 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:40.487228 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:40.487230 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:40.487363 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:40.487838 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:40.487846 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:40.489267 (+ 1421us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:40.491237 (+ 1970us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:40.491245 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:40.491248 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:40.491617 (+ 369us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:40.491796 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:40.491797 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:40.491797 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:40.491914 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:40.492114 (+ 200us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:40.492117 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:40.492225 (+ 108us) client_negotiation.cc:769] Sending connection context
0807 22:40:40.492390 (+ 165us) client_negotiation.cc:240] Negotiation successful
0807 22:40:40.492521 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":77,"threads_started":1}
I20260807 22:40:40.493224 29936 heartbeater.cc:347] Connected to a master server at 127.22.212.126:46439
I20260807 22:40:40.493319 29936 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:40.493474 29936 heartbeater.cc:511] Master 127.22.212.126:46439 requested a full tablet report, sending...
I20260807 22:40:40.493839 29233 ts_manager.cc:194] Registered new tserver with Master: ba705caabbed4c2cb0badb6391fa8a06 (127.22.212.67:33821)
I20260807 22:40:40.494201 29233 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.67@KRBTEST.COM'} at 127.22.212.67:41937
I20260807 22:40:40.502298 23377 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 22:40:40 dist-test-slave-2d19 krb5kdc[29168](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142440, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 22:40:40 dist-test-slave-2d19 krb5kdc[29168](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142440, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.212.65@KRBTEST.COM
I20260807 22:40:40.527231 29944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:40.519286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47864 (local address 127.22.212.65:34099)
0807 22:40:40.519538 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:40.519543 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:40.519554 (+ 11us) server_negotiation.cc:407] Connection header received
0807 22:40:40.519581 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:40.519583 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:40.519597 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:40.519669 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:40.520316 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:40.521141 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:40.521867 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:40.522228 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:40.522288 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:40.524500 (+ 2212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:40.524508 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:40.524508 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:40.524515 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:40.526184 (+ 1669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:40.526477 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:40.526480 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:40.526480 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:40.526535 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:40.526680 (+ 145us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:40.526680 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:40.526680 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:40.526792 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:40.526886 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:40.526993 (+ 107us) server_negotiation.cc:299] Negotiation successful
0807 22:40:40.527056 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":107,"threads_started":1}
Aug 07 22:40:40 dist-test-slave-2d19 krb5kdc[29168](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142440, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:40:40.535583 29292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:40.528672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60850 (local address 127.22.212.126:46439)
0807 22:40:40.528739 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:40.528741 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:40.528770 (+ 29us) server_negotiation.cc:407] Connection header received
0807 22:40:40.528848 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:40.528849 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:40.528859 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:40.528932 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:40.529399 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:40.529891 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:40.530571 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:40.530763 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:40.530840 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:40.532994 (+ 2154us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:40.532995 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:40.532996 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:40.533003 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:40.534353 (+ 1350us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:40.534762 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:40.534763 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:40.534763 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:40.534824 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:40.535035 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:40.535036 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:40.535036 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:40.535188 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:40.535298 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:40.535393 (+ 95us) server_negotiation.cc:299] Negotiation successful
0807 22:40:40.535477 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
W20260807 22:40:40.535949 29233 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60850
I20260807 22:40:40.536407 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 29332
I20260807 22:40:40.547310 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 29535
I20260807 22:40:40.566134 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 29747
I20260807 22:40:40.577045 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 29184
2026-08-07T22:40:40Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2189 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:40:40 dist-test-slave-2d19 krb5kdc[29953](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:40:40 dist-test-slave-2d19 krb5kdc[29953](info): set up 2 sockets
Aug 07 22:40:40 dist-test-slave-2d19 krb5kdc[29953](info): commencing operation
krb5kdc: starting...
W20260807 22:40:41.838881 23377 mini_kdc.cc:121] Time spent starting KDC: real 1.230s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Aug 07 22:40:41 dist-test-slave-2d19 krb5kdc[29953](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142441, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:40:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:40:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.212.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
I20260807 22:40:41.967271 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:36939
--webserver_interface=127.22.212.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:37251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:36939
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:42.051414 29969 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:42.051707 29969 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:42.051751 29969 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:42.053186 29969 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:40:42.053267 29969 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:42.053290 29969 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:42.053311 29969 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:40:42.053342 29969 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:40:42.054983 29969 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:37251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:36939
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:36939
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29969
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:42.055282 29969 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:42.055526 29969 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:42.060609 29977 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:42.060640 29976 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:42.060599 29979 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:42.060966 29969 server_base.cc:1034] running on GCE node
I20260807 22:40:42.061221 29969 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:42.061527 29969 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:42.062700 29969 hybrid_clock.cc:648] HybridClock initialized: now 1786142442062684 us; error 43 us; skew 500 ppm
Aug 07 22:40:42 dist-test-slave-2d19 krb5kdc[29953](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142442, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:42.065279 29969 init.cc:377] Logged in from keytab as kudu/127.22.212.126@KRBTEST.COM (short username kudu)
I20260807 22:40:42.065580 29969 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:42.065625 29969 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:42.065716 29969 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:42.066743 29969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "2a22603869694c83932ff789f430b36d"
format_stamp: "Formatted at 2026-08-07 22:40:42 on dist-test-slave-2d19"
server_key: "f3eff823ab3696c31f4c61bf5067dd86"
server_key_iv: "e9d7f62282efafeba9921e9c1c02d9ef"
server_key_version: "encryptionkey@0"
I20260807 22:40:42.067055 29969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "2a22603869694c83932ff789f430b36d"
format_stamp: "Formatted at 2026-08-07 22:40:42 on dist-test-slave-2d19"
server_key: "f3eff823ab3696c31f4c61bf5067dd86"
server_key_iv: "e9d7f62282efafeba9921e9c1c02d9ef"
server_key_version: "encryptionkey@0"
I20260807 22:40:42.068387 29969 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 22:40:42.069177 29987 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:42.069388 29969 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:40:42.069494 29969 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "2a22603869694c83932ff789f430b36d"
format_stamp: "Formatted at 2026-08-07 22:40:42 on dist-test-slave-2d19"
server_key: "f3eff823ab3696c31f4c61bf5067dd86"
server_key_iv: "e9d7f62282efafeba9921e9c1c02d9ef"
server_key_version: "encryptionkey@0"
I20260807 22:40:42.069554 29969 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:42.087045 29969 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:42.089571 29969 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:42.089701 29969 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:42.093815 29969 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:36939
I20260807 22:40:42.093843 30056 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:36939 every 8 connection(s)
I20260807 22:40:42.094164 29969 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:40:42.095263 30058 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:42.097672 30058 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a22603869694c83932ff789f430b36d: Bootstrap starting.
I20260807 22:40:42.098297 30058 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2a22603869694c83932ff789f430b36d: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:42.098606 30058 log.cc:824] T 00000000000000000000000000000000 P 2a22603869694c83932ff789f430b36d: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:42.099319 30058 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a22603869694c83932ff789f430b36d: No bootstrap required, opened a new log
I20260807 22:40:42.100941 30058 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a22603869694c83932ff789f430b36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a22603869694c83932ff789f430b36d" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36939 } }
I20260807 22:40:42.101136 30058 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2a22603869694c83932ff789f430b36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:42.101192 30058 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a22603869694c83932ff789f430b36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a22603869694c83932ff789f430b36d, State: Initialized, Role: FOLLOWER
I20260807 22:40:42.101351 30058 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a22603869694c83932ff789f430b36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a22603869694c83932ff789f430b36d" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36939 } }
I20260807 22:40:42.101432 30058 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2a22603869694c83932ff789f430b36d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:40:42.101477 30058 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2a22603869694c83932ff789f430b36d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:40:42.101528 30058 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2a22603869694c83932ff789f430b36d [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:42.102356 30058 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2a22603869694c83932ff789f430b36d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a22603869694c83932ff789f430b36d" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36939 } }
I20260807 22:40:42.102480 30058 leader_election.cc:302] T 00000000000000000000000000000000 P 2a22603869694c83932ff789f430b36d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2a22603869694c83932ff789f430b36d; no voters:
I20260807 22:40:42.102694 30058 leader_election.cc:288] T 00000000000000000000000000000000 P 2a22603869694c83932ff789f430b36d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:40:42.102728 30062 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2a22603869694c83932ff789f430b36d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:40:42.102876 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 29969
I20260807 22:40:42.102929 30062 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2a22603869694c83932ff789f430b36d [term 1 LEADER]: Becoming Leader. State: Replica: 2a22603869694c83932ff789f430b36d, State: Running, Role: LEADER
I20260807 22:40:42.102988 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:40:42.102998 30058 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a22603869694c83932ff789f430b36d [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:40:42.103011 30062 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a22603869694c83932ff789f430b36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a22603869694c83932ff789f430b36d" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36939 } }
I20260807 22:40:42.103217 23377 external_mini_cluster.cc:1428] Setting key d9c5d209811cbce935664b957a4df7ac
I20260807 22:40:42.103533 30062 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a22603869694c83932ff789f430b36d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a22603869694c83932ff789f430b36d. Latest consensus state: current_term: 1 leader_uuid: "2a22603869694c83932ff789f430b36d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a22603869694c83932ff789f430b36d" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36939 } } }
I20260807 22:40:42.103615 30062 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a22603869694c83932ff789f430b36d [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:42.103892 30076 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:40:42.104281 30068 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a22603869694c83932ff789f430b36d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2a22603869694c83932ff789f430b36d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a22603869694c83932ff789f430b36d" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36939 } } }
I20260807 22:40:42.104389 30068 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a22603869694c83932ff789f430b36d [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:42.104745 30076 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:40:42.106375 30076 catalog_manager.cc:1347] Generated new cluster ID: d0fa4ef618a443ecae0f9c463afea4be
I20260807 22:40:42.106432 30076 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 22:40:42 dist-test-slave-2d19 krb5kdc[29953](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142441, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:40:42.115348 30082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:42.103838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37602 (local address 127.22.212.126:36939)
0807 22:40:42.104680 (+ 842us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:42.104691 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:42.104725 (+ 34us) server_negotiation.cc:407] Connection header received
0807 22:40:42.104875 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:42.104883 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:42.104946 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:42.105141 (+ 195us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:42.105983 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:42.107062 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:42.108096 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:42.108621 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:42.108767 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:42.111324 (+ 2557us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:42.111329 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:42.111329 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:42.111342 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:42.113723 (+ 2381us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:42.114103 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:42.114107 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:42.114108 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:42.114206 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:42.114429 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:42.114430 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:42.114430 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:42.114684 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:42.114854 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:42.114959 (+ 105us) server_negotiation.cc:299] Negotiation successful
0807 22:40:42.115121 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":789,"thread_start_us":695,"threads_started":1}
I20260807 22:40:42.121367 30076 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:40:42.121907 30076 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:40:42.132779 30076 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2a22603869694c83932ff789f430b36d: Generated new TSK 0
I20260807 22:40:42.132998 30076 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.212.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab.
Entry for principal kudu/127.22.212.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab.
I20260807 22:40:42.167754 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.65:0
--local_ip_for_outbound_sockets=127.22.212.65
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:36939
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:37251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:42.255859 30096 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:42.256079 30096 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:42.256104 30096 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:42.257355 30096 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:42.257398 30096 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:42.257426 30096 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.65
I20260807 22:40:42.258898 30096 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:37251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:36939
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30096
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.65
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:42.259080 30096 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:42.259254 30096 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:42.264338 30105 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:42.264348 30111 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:42.264348 30104 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:42.264379 30096 server_base.cc:1034] running on GCE node
I20260807 22:40:42.264747 30096 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:42.264995 30096 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:42.266147 30096 hybrid_clock.cc:648] HybridClock initialized: now 1786142442266132 us; error 29 us; skew 500 ppm
Aug 07 22:40:42 dist-test-slave-2d19 krb5kdc[29953](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142442, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:42.268692 30096 init.cc:377] Logged in from keytab as kudu/127.22.212.65@KRBTEST.COM (short username kudu)
I20260807 22:40:42.269095 30096 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:42.269146 30096 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:42.269237 30096 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:42.270238 30096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-0/data/instance:
uuid: "9574c97fc8a8478185629134761de595"
format_stamp: "Formatted at 2026-08-07 22:40:42 on dist-test-slave-2d19"
server_key: "c5ffdd401cc90a6e96a519118dcdf538"
server_key_iv: "e965cd701f3134a780321ed3d7a73865"
server_key_version: "encryptionkey@0"
I20260807 22:40:42.270536 30096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance:
uuid: "9574c97fc8a8478185629134761de595"
format_stamp: "Formatted at 2026-08-07 22:40:42 on dist-test-slave-2d19"
server_key: "c5ffdd401cc90a6e96a519118dcdf538"
server_key_iv: "e965cd701f3134a780321ed3d7a73865"
server_key_version: "encryptionkey@0"
I20260807 22:40:42.271731 30096 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260807 22:40:42.272486 30121 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:42.272675 30096 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 22:40:42.272756 30096 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-0/wal
uuid: "9574c97fc8a8478185629134761de595"
format_stamp: "Formatted at 2026-08-07 22:40:42 on dist-test-slave-2d19"
server_key: "c5ffdd401cc90a6e96a519118dcdf538"
server_key_iv: "e965cd701f3134a780321ed3d7a73865"
server_key_version: "encryptionkey@0"
I20260807 22:40:42.272811 30096 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:42.288028 30096 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:42.290073 30096 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:42.290192 30096 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:42.290390 30096 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:42.290781 30096 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:42.290834 30096 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:42.290879 30096 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:42.290904 30096 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:42.296880 30096 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.65:46791
I20260807 22:40:42.296922 30290 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.65:46791 every 8 connection(s)
I20260807 22:40:42.297191 30096 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
Aug 07 22:40:42 dist-test-slave-2d19 krb5kdc[29953](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142442, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:40:42.304517 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 30096
I20260807 22:40:42.304631 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance
I20260807 22:40:42.304864 23377 external_mini_cluster.cc:1428] Setting key efd5f76a36e32044bc8f333ba7e7df12
I20260807 22:40:42.306918 30293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:42.297859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:36939 (local address 127.22.212.65:38989)
0807 22:40:42.298032 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:42.298076 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:42.298567 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:42.298849 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:42.298853 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:42.299110 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:42.299624 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:42.299629 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:42.300371 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:42.300372 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:42.301178 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:42.301180 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:42.301576 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:42.301577 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:42.301673 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:42.302165 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:42.302173 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:42.303585 (+ 1412us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:42.305621 (+ 2036us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:42.305629 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:42.305631 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:42.305851 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:42.306062 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:42.306063 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:42.306063 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:42.306160 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:42.306441 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:42.306446 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:42.306556 (+ 110us) client_negotiation.cc:769] Sending connection context
0807 22:40:42.306638 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 22:40:42.306757 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":97,"threads_started":1}
I20260807 22:40:42.306912 30082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:42.297918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:38989 (local address 127.22.212.126:36939)
0807 22:40:42.297977 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:42.297979 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:42.298162 (+ 183us) server_negotiation.cc:407] Connection header received
0807 22:40:42.298686 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:42.298688 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:42.298703 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:42.298767 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:42.299716 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:42.300213 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:42.301259 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:42.301488 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:42.301547 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:42.303679 (+ 2132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:42.303681 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:42.303681 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:42.303688 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:42.305521 (+ 1833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:42.305925 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:42.305926 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:42.305927 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:42.305991 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:42.306224 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:42.306225 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:42.306225 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:42.306374 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:42.306447 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:42.306682 (+ 235us) server_negotiation.cc:299] Negotiation successful
0807 22:40:42.306774 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260807 22:40:42.307600 30291 heartbeater.cc:347] Connected to a master server at 127.22.212.126:36939
I20260807 22:40:42.307713 30291 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:42.307873 30291 heartbeater.cc:511] Master 127.22.212.126:36939 requested a full tablet report, sending...
I20260807 22:40:42.308465 30007 ts_manager.cc:194] Registered new tserver with Master: 9574c97fc8a8478185629134761de595 (127.22.212.65:46791)
I20260807 22:40:42.309105 30007 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.65@KRBTEST.COM'} at 127.22.212.65:38989
WARNING: no policy specified for kudu/127.22.212.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab.
Entry for principal kudu/127.22.212.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab.
I20260807 22:40:42.332190 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.66:0
--local_ip_for_outbound_sockets=127.22.212.66
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:36939
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:37251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:42.415091 30296 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:42.415333 30296 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:42.415373 30296 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:42.416540 30296 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:42.416610 30296 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:42.416654 30296 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.66
I20260807 22:40:42.418186 30296 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:37251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:36939
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30296
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.66
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:42.418460 30296 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:42.418704 30296 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:42.424305 30303 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:42.424302 30302 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:42.424634 30296 server_base.cc:1034] running on GCE node
W20260807 22:40:42.424315 30306 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:42.424933 30296 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:42.425271 30296 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:42.426437 30296 hybrid_clock.cc:648] HybridClock initialized: now 1786142442426432 us; error 35 us; skew 500 ppm
Aug 07 22:40:42 dist-test-slave-2d19 krb5kdc[29953](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142442, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:42.429121 30296 init.cc:377] Logged in from keytab as kudu/127.22.212.66@KRBTEST.COM (short username kudu)
I20260807 22:40:42.429436 30296 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:42.429481 30296 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:42.429575 30296 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:42.430580 30296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-1/data/instance:
uuid: "82cd3ce9e7b34e3bb38672613c309fbf"
format_stamp: "Formatted at 2026-08-07 22:40:42 on dist-test-slave-2d19"
server_key: "98784baee0e9f993b106536a975d97bd"
server_key_iv: "f070fb54d9b2a45e4fe8d5b9555eb19a"
server_key_version: "encryptionkey@0"
I20260807 22:40:42.430878 30296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance:
uuid: "82cd3ce9e7b34e3bb38672613c309fbf"
format_stamp: "Formatted at 2026-08-07 22:40:42 on dist-test-slave-2d19"
server_key: "98784baee0e9f993b106536a975d97bd"
server_key_iv: "f070fb54d9b2a45e4fe8d5b9555eb19a"
server_key_version: "encryptionkey@0"
I20260807 22:40:42.432118 30296 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 22:40:42.432893 30313 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:42.433061 30296 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 22:40:42.433154 30296 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-1/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-1/wal
uuid: "82cd3ce9e7b34e3bb38672613c309fbf"
format_stamp: "Formatted at 2026-08-07 22:40:42 on dist-test-slave-2d19"
server_key: "98784baee0e9f993b106536a975d97bd"
server_key_iv: "f070fb54d9b2a45e4fe8d5b9555eb19a"
server_key_version: "encryptionkey@0"
I20260807 22:40:42.433210 30296 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:42.444044 30296 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:42.446311 30296 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:42.446424 30296 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:42.446611 30296 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:42.446933 30296 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:42.446966 30296 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:42.447019 30296 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:42.447041 30296 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:42.453639 30296 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.66:32949
I20260807 22:40:42.453672 30471 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.66:32949 every 8 connection(s)
I20260807 22:40:42.453958 30296 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
I20260807 22:40:42.457450 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 30296
I20260807 22:40:42.457557 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance
I20260807 22:40:42.457746 23377 external_mini_cluster.cc:1428] Setting key b2526184cac3d3b99b2c7940bd77bd97
Aug 07 22:40:42 dist-test-slave-2d19 krb5kdc[29953](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142442, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:40:42.464157 30082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:42.454725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:34287 (local address 127.22.212.126:36939)
0807 22:40:42.454787 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:42.454790 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:42.454966 (+ 176us) server_negotiation.cc:407] Connection header received
0807 22:40:42.455431 (+ 465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:42.455432 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:42.455442 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:42.455516 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:42.456473 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:42.456979 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:42.458215 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:42.458402 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:42.458459 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:42.460879 (+ 2420us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:42.460881 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:42.460881 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:42.460889 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:42.462569 (+ 1680us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:42.463147 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:42.463149 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:42.463150 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:42.463212 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:42.463484 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:42.463485 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:42.463486 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:42.463614 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:42.463686 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:42.463973 (+ 287us) server_negotiation.cc:299] Negotiation successful
0807 22:40:42.464063 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260807 22:40:42.464417 30474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:42.454667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:36939 (local address 127.22.212.66:34287)
0807 22:40:42.454832 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:42.454874 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:42.455346 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:42.455586 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:42.455589 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:42.455844 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:42.456392 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:42.456398 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:42.457083 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:42.457084 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:42.458145 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:42.458148 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:42.458470 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:42.458471 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:42.458608 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:42.459128 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:42.459136 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:42.460769 (+ 1633us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:42.462673 (+ 1904us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:42.462680 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:42.462683 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:42.463054 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:42.463293 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:42.463294 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:42.463295 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:42.463407 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:42.463690 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:42.463697 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:42.463839 (+ 142us) client_negotiation.cc:769] Sending connection context
0807 22:40:42.463950 (+ 111us) client_negotiation.cc:240] Negotiation successful
0807 22:40:42.464120 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":95,"threads_started":1}
I20260807 22:40:42.465029 30472 heartbeater.cc:347] Connected to a master server at 127.22.212.126:36939
I20260807 22:40:42.465144 30472 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:42.465293 30472 heartbeater.cc:511] Master 127.22.212.126:36939 requested a full tablet report, sending...
I20260807 22:40:42.465694 30007 ts_manager.cc:194] Registered new tserver with Master: 82cd3ce9e7b34e3bb38672613c309fbf (127.22.212.66:32949)
I20260807 22:40:42.466246 30007 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.66@KRBTEST.COM'} at 127.22.212.66:34287
WARNING: no policy specified for kudu/127.22.212.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab.
Entry for principal kudu/127.22.212.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab.
I20260807 22:40:42.487861 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.67:0
--local_ip_for_outbound_sockets=127.22.212.67
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:36939
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:37251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:42.570799 30480 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:42.571023 30480 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:42.571048 30480 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:42.572161 30480 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:42.572196 30480 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:42.572221 30480 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.67
I20260807 22:40:42.573793 30480 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:37251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:36939
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30480
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.67
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:42.573990 30480 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:42.574172 30480 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:42.579368 30493 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:42.579414 30491 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:42.579491 30490 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:42.579725 30480 server_base.cc:1034] running on GCE node
I20260807 22:40:42.579993 30480 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:42.580245 30480 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:42.581465 30480 hybrid_clock.cc:648] HybridClock initialized: now 1786142442581449 us; error 27 us; skew 500 ppm
Aug 07 22:40:42 dist-test-slave-2d19 krb5kdc[29953](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142442, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:42.584086 30480 init.cc:377] Logged in from keytab as kudu/127.22.212.67@KRBTEST.COM (short username kudu)
I20260807 22:40:42.584514 30480 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:42.584599 30480 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:42.584744 30480 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:42.585843 30480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-2/data/instance:
uuid: "8582a3d3b9744b8faebb8542fbb4e2cb"
format_stamp: "Formatted at 2026-08-07 22:40:42 on dist-test-slave-2d19"
server_key: "2312554e916adbb6e0829e01ac2826e6"
server_key_iv: "a7c525ac8cbd3dc8d5dd0d8496a67011"
server_key_version: "encryptionkey@0"
I20260807 22:40:42.586230 30480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance:
uuid: "8582a3d3b9744b8faebb8542fbb4e2cb"
format_stamp: "Formatted at 2026-08-07 22:40:42 on dist-test-slave-2d19"
server_key: "2312554e916adbb6e0829e01ac2826e6"
server_key_iv: "a7c525ac8cbd3dc8d5dd0d8496a67011"
server_key_version: "encryptionkey@0"
I20260807 22:40:42.587546 30480 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 22:40:42.588316 30501 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:42.588492 30480 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:42.588621 30480 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-2/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-2/wal
uuid: "8582a3d3b9744b8faebb8542fbb4e2cb"
format_stamp: "Formatted at 2026-08-07 22:40:42 on dist-test-slave-2d19"
server_key: "2312554e916adbb6e0829e01ac2826e6"
server_key_iv: "a7c525ac8cbd3dc8d5dd0d8496a67011"
server_key_version: "encryptionkey@0"
I20260807 22:40:42.588713 30480 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:42.597465 30480 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:42.599948 30480 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:42.600116 30480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:42.600389 30480 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:42.600737 30480 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:42.600801 30480 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:42.600844 30480 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:42.600871 30480 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:42.607273 30480 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.67:46661
I20260807 22:40:42.607309 30675 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.67:46661 every 8 connection(s)
I20260807 22:40:42.607627 30480 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
I20260807 22:40:42.613309 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 30480
I20260807 22:40:42.613442 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance
I20260807 22:40:42.613680 23377 external_mini_cluster.cc:1428] Setting key 09387f64bb40f19ccaa8b42b86020ccc
Aug 07 22:40:42 dist-test-slave-2d19 krb5kdc[29953](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142442, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:40:42.617393 30082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:42.608367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:59399 (local address 127.22.212.126:36939)
0807 22:40:42.608413 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:42.608415 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:42.608685 (+ 270us) server_negotiation.cc:407] Connection header received
0807 22:40:42.609225 (+ 540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:42.609226 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:42.609239 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:42.609293 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:42.610268 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:42.610773 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:42.611790 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:42.612003 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:42.612095 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:42.614631 (+ 2536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:42.614633 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:42.614633 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:42.614642 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:42.616151 (+ 1509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:42.616561 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:42.616562 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:42.616563 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:42.616615 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:42.616836 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:42.616837 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:42.616837 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:42.616960 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:42.617009 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:42.617265 (+ 256us) server_negotiation.cc:299] Negotiation successful
0807 22:40:42.617329 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 22:40:42.617527 30678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:42.608385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:36939 (local address 127.22.212.67:59399)
0807 22:40:42.608559 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:42.608596 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:42.609115 (+ 519us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:42.609377 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:42.609383 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:42.609651 (+ 268us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:42.610154 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:42.610160 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:42.610867 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:42.610868 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:42.611697 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:42.611699 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:42.612115 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:42.612116 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:42.612241 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:42.612831 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:42.612840 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:42.614528 (+ 1688us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:42.616223 (+ 1695us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:42.616229 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:42.616231 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:42.616492 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:42.616675 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:42.616676 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:42.616676 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:42.616773 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:42.617015 (+ 242us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:42.617019 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:42.617143 (+ 124us) client_negotiation.cc:769] Sending connection context
0807 22:40:42.617221 (+ 78us) client_negotiation.cc:240] Negotiation successful
0807 22:40:42.617338 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":86,"threads_started":1}
I20260807 22:40:42.618017 30676 heartbeater.cc:347] Connected to a master server at 127.22.212.126:36939
I20260807 22:40:42.618105 30676 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:42.618217 30676 heartbeater.cc:511] Master 127.22.212.126:36939 requested a full tablet report, sending...
I20260807 22:40:42.618574 30007 ts_manager.cc:194] Registered new tserver with Master: 8582a3d3b9744b8faebb8542fbb4e2cb (127.22.212.67:46661)
I20260807 22:40:42.618908 30007 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.67@KRBTEST.COM'} at 127.22.212.67:59399
I20260807 22:40:42.625554 23377 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:40:42.632867 30082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:42.626814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37606 (local address 127.22.212.126:36939)
0807 22:40:42.626887 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:42.626889 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:42.626978 (+ 89us) server_negotiation.cc:407] Connection header received
0807 22:40:42.627072 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:42.627073 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:42.627083 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:42.627139 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:42.627690 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:42.628174 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:42.628942 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:42.629150 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:42.629240 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:42.630332 (+ 1092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:42.630334 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:42.630334 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:42.630341 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:42.631605 (+ 1264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:42.631954 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:42.631955 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:42.631956 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:42.632013 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:42.632232 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:42.632233 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:42.632234 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:42.632412 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:42.632519 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:42.632676 (+ 157us) server_negotiation.cc:299] Negotiation successful
0807 22:40:42.632756 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 22:40:42.634616 30007 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37606:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:40:42.636442 30007 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:40:42.642972 30690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:42.638812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.66:32949 (local address 127.0.0.1:35632)
0807 22:40:42.639093 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:42.639137 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:42.639222 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:42.639578 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:42.639582 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:42.639584 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:42.639663 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:42.639666 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:42.641028 (+ 1362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:42.641029 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:42.641851 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:42.641854 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:42.642664 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:42.642665 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:42.642746 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:42.642761 (+ 15us) client_negotiation.cc:769] Sending connection context
0807 22:40:42.642837 (+ 76us) client_negotiation.cc:240] Negotiation successful
0807 22:40:42.642885 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"mutex_wait_us":39,"thread_start_us":50,"threads_started":1}
I20260807 22:40:42.642990 30696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:42.638914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35632 (local address 127.22.212.66:32949)
0807 22:40:42.639085 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:42.639091 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:42.639306 (+ 215us) server_negotiation.cc:407] Connection header received
0807 22:40:42.639350 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:42.639352 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:42.639370 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:42.639467 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:42.639750 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:42.640921 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:42.641949 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:42.642576 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:42.642651 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:42.642709 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:42.642866 (+ 157us) server_negotiation.cc:299] Negotiation successful
0807 22:40:42.642907 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":84,"threads_started":1}
I20260807 22:40:42.643409 30691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:42.638817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:46791 (local address 127.0.0.1:36820)
0807 22:40:42.639452 (+ 635us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:42.639462 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:42.639512 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:42.639822 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:42.639823 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:42.639825 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:42.639869 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:42.639870 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:42.640844 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:42.640846 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:42.642181 (+ 1335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:42.642184 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:42.643179 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:42.643180 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:42.643239 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:42.643243 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 22:40:42.643290 (+ 47us) client_negotiation.cc:240] Negotiation successful
0807 22:40:42.643340 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":617,"mutex_wait_us":53,"thread_start_us":101,"threads_started":1}
I20260807 22:40:42.643565 30693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:42.638817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.67:46661 (local address 127.0.0.1:58442)
0807 22:40:42.639238 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:42.639250 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:42.639318 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:42.639579 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:42.639582 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:42.639586 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:42.639663 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:42.639665 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:42.641026 (+ 1361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:42.641027 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:42.642398 (+ 1371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:42.642400 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:42.643323 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:42.643324 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:42.643400 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:42.643404 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 22:40:42.643460 (+ 56us) client_negotiation.cc:240] Negotiation successful
0807 22:40:42.643500 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":399,"mutex_wait_us":1,"thread_start_us":104,"threads_started":1}
I20260807 22:40:42.643625 30697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:42.639061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58442 (local address 127.22.212.67:46661)
0807 22:40:42.639225 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:42.639229 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:42.639304 (+ 75us) server_negotiation.cc:407] Connection header received
0807 22:40:42.639400 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:42.639402 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:42.639419 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:42.639493 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:42.639750 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:42.640902 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:42.642485 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:42.643217 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:42.643317 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:42.643374 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:42.643480 (+ 106us) server_negotiation.cc:299] Negotiation successful
0807 22:40:42.643520 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":89,"threads_started":1}
I20260807 22:40:42.643733 30698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:42.639076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36820 (local address 127.22.212.65:46791)
0807 22:40:42.639263 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:42.639269 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:42.639578 (+ 309us) server_negotiation.cc:407] Connection header received
0807 22:40:42.639629 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:42.639631 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:42.639649 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:42.639724 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:42.639993 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:42.640746 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:42.642275 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:42.643011 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:42.643083 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:42.643145 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:42.643577 (+ 432us) server_negotiation.cc:299] Negotiation successful
0807 22:40:42.643650 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":75,"threads_started":1}
I20260807 22:40:42.644095 30380 tablet_service.cc:1467] Processing CreateTablet for tablet a7faab8321884dbcb1f06f59e5847c38 (DEFAULT_TABLE table=test-table [id=7cd1f7eb088241a290df68c928bea2d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:42.644322 30187 tablet_service.cc:1467] Processing CreateTablet for tablet a7faab8321884dbcb1f06f59e5847c38 (DEFAULT_TABLE table=test-table [id=7cd1f7eb088241a290df68c928bea2d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:42.644508 30380 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7faab8321884dbcb1f06f59e5847c38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:42.644629 30187 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7faab8321884dbcb1f06f59e5847c38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:42.647047 30577 tablet_service.cc:1467] Processing CreateTablet for tablet a7faab8321884dbcb1f06f59e5847c38 (DEFAULT_TABLE table=test-table [id=7cd1f7eb088241a290df68c928bea2d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:42.647296 30577 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7faab8321884dbcb1f06f59e5847c38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:42.647921 30699 tablet_bootstrap.cc:492] T a7faab8321884dbcb1f06f59e5847c38 P 9574c97fc8a8478185629134761de595: Bootstrap starting.
I20260807 22:40:42.648414 30700 tablet_bootstrap.cc:492] T a7faab8321884dbcb1f06f59e5847c38 P 82cd3ce9e7b34e3bb38672613c309fbf: Bootstrap starting.
I20260807 22:40:42.648631 30699 tablet_bootstrap.cc:654] T a7faab8321884dbcb1f06f59e5847c38 P 9574c97fc8a8478185629134761de595: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:42.648905 30700 tablet_bootstrap.cc:654] T a7faab8321884dbcb1f06f59e5847c38 P 82cd3ce9e7b34e3bb38672613c309fbf: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:42.649259 30699 log.cc:824] T a7faab8321884dbcb1f06f59e5847c38 P 9574c97fc8a8478185629134761de595: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:42.649346 30700 log.cc:824] T a7faab8321884dbcb1f06f59e5847c38 P 82cd3ce9e7b34e3bb38672613c309fbf: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:42.650017 30699 tablet_bootstrap.cc:492] T a7faab8321884dbcb1f06f59e5847c38 P 9574c97fc8a8478185629134761de595: No bootstrap required, opened a new log
I20260807 22:40:42.650103 30699 ts_tablet_manager.cc:1397] T a7faab8321884dbcb1f06f59e5847c38 P 9574c97fc8a8478185629134761de595: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 22:40:42.650682 30704 tablet_bootstrap.cc:492] T a7faab8321884dbcb1f06f59e5847c38 P 8582a3d3b9744b8faebb8542fbb4e2cb: Bootstrap starting.
I20260807 22:40:42.651302 30704 tablet_bootstrap.cc:654] T a7faab8321884dbcb1f06f59e5847c38 P 8582a3d3b9744b8faebb8542fbb4e2cb: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:42.651428 30700 tablet_bootstrap.cc:492] T a7faab8321884dbcb1f06f59e5847c38 P 82cd3ce9e7b34e3bb38672613c309fbf: No bootstrap required, opened a new log
I20260807 22:40:42.651499 30700 ts_tablet_manager.cc:1397] T a7faab8321884dbcb1f06f59e5847c38 P 82cd3ce9e7b34e3bb38672613c309fbf: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260807 22:40:42.651912 30704 log.cc:824] T a7faab8321884dbcb1f06f59e5847c38 P 8582a3d3b9744b8faebb8542fbb4e2cb: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:42.652405 30699 raft_consensus.cc:348] T a7faab8321884dbcb1f06f59e5847c38 P 9574c97fc8a8478185629134761de595 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82cd3ce9e7b34e3bb38672613c309fbf" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 32949 } } peers { permanent_uuid: "9574c97fc8a8478185629134761de595" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46791 } } peers { permanent_uuid: "8582a3d3b9744b8faebb8542fbb4e2cb" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 46661 } }
I20260807 22:40:42.652606 30699 raft_consensus.cc:374] T a7faab8321884dbcb1f06f59e5847c38 P 9574c97fc8a8478185629134761de595 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:42.652645 30699 raft_consensus.cc:729] T a7faab8321884dbcb1f06f59e5847c38 P 9574c97fc8a8478185629134761de595 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9574c97fc8a8478185629134761de595, State: Initialized, Role: FOLLOWER
I20260807 22:40:42.652746 30704 tablet_bootstrap.cc:492] T a7faab8321884dbcb1f06f59e5847c38 P 8582a3d3b9744b8faebb8542fbb4e2cb: No bootstrap required, opened a new log
I20260807 22:40:42.652807 30704 ts_tablet_manager.cc:1397] T a7faab8321884dbcb1f06f59e5847c38 P 8582a3d3b9744b8faebb8542fbb4e2cb: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 22:40:42.652791 30699 consensus_queue.cc:260] T a7faab8321884dbcb1f06f59e5847c38 P 9574c97fc8a8478185629134761de595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82cd3ce9e7b34e3bb38672613c309fbf" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 32949 } } peers { permanent_uuid: "9574c97fc8a8478185629134761de595" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46791 } } peers { permanent_uuid: "8582a3d3b9744b8faebb8542fbb4e2cb" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 46661 } }
I20260807 22:40:42.653092 30699 ts_tablet_manager.cc:1428] T a7faab8321884dbcb1f06f59e5847c38 P 9574c97fc8a8478185629134761de595: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260807 22:40:42.653105 30291 heartbeater.cc:503] Master 127.22.212.126:36939 was elected leader, sending a full tablet report...
I20260807 22:40:42.653486 30700 raft_consensus.cc:348] T a7faab8321884dbcb1f06f59e5847c38 P 82cd3ce9e7b34e3bb38672613c309fbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82cd3ce9e7b34e3bb38672613c309fbf" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 32949 } } peers { permanent_uuid: "9574c97fc8a8478185629134761de595" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46791 } } peers { permanent_uuid: "8582a3d3b9744b8faebb8542fbb4e2cb" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 46661 } }
I20260807 22:40:42.653662 30700 raft_consensus.cc:374] T a7faab8321884dbcb1f06f59e5847c38 P 82cd3ce9e7b34e3bb38672613c309fbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:42.653707 30700 raft_consensus.cc:729] T a7faab8321884dbcb1f06f59e5847c38 P 82cd3ce9e7b34e3bb38672613c309fbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82cd3ce9e7b34e3bb38672613c309fbf, State: Initialized, Role: FOLLOWER
I20260807 22:40:42.653825 30700 consensus_queue.cc:260] T a7faab8321884dbcb1f06f59e5847c38 P 82cd3ce9e7b34e3bb38672613c309fbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82cd3ce9e7b34e3bb38672613c309fbf" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 32949 } } peers { permanent_uuid: "9574c97fc8a8478185629134761de595" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46791 } } peers { permanent_uuid: "8582a3d3b9744b8faebb8542fbb4e2cb" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 46661 } }
I20260807 22:40:42.654098 30700 ts_tablet_manager.cc:1428] T a7faab8321884dbcb1f06f59e5847c38 P 82cd3ce9e7b34e3bb38672613c309fbf: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 22:40:42.654160 30472 heartbeater.cc:503] Master 127.22.212.126:36939 was elected leader, sending a full tablet report...
I20260807 22:40:42.655100 30704 raft_consensus.cc:348] T a7faab8321884dbcb1f06f59e5847c38 P 8582a3d3b9744b8faebb8542fbb4e2cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82cd3ce9e7b34e3bb38672613c309fbf" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 32949 } } peers { permanent_uuid: "9574c97fc8a8478185629134761de595" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46791 } } peers { permanent_uuid: "8582a3d3b9744b8faebb8542fbb4e2cb" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 46661 } }
I20260807 22:40:42.655251 30704 raft_consensus.cc:374] T a7faab8321884dbcb1f06f59e5847c38 P 8582a3d3b9744b8faebb8542fbb4e2cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:42.655275 30704 raft_consensus.cc:729] T a7faab8321884dbcb1f06f59e5847c38 P 8582a3d3b9744b8faebb8542fbb4e2cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8582a3d3b9744b8faebb8542fbb4e2cb, State: Initialized, Role: FOLLOWER
I20260807 22:40:42.655396 30704 consensus_queue.cc:260] T a7faab8321884dbcb1f06f59e5847c38 P 8582a3d3b9744b8faebb8542fbb4e2cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82cd3ce9e7b34e3bb38672613c309fbf" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 32949 } } peers { permanent_uuid: "9574c97fc8a8478185629134761de595" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46791 } } peers { permanent_uuid: "8582a3d3b9744b8faebb8542fbb4e2cb" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 46661 } }
I20260807 22:40:42.655644 30704 ts_tablet_manager.cc:1428] T a7faab8321884dbcb1f06f59e5847c38 P 8582a3d3b9744b8faebb8542fbb4e2cb: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 22:40:42.655679 30676 heartbeater.cc:503] Master 127.22.212.126:36939 was elected leader, sending a full tablet report...
I20260807 22:40:42.700853 30706 raft_consensus.cc:482] T a7faab8321884dbcb1f06f59e5847c38 P 9574c97fc8a8478185629134761de595 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:40:42.700977 30706 raft_consensus.cc:504] T a7faab8321884dbcb1f06f59e5847c38 P 9574c97fc8a8478185629134761de595 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82cd3ce9e7b34e3bb38672613c309fbf" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 32949 } } peers { permanent_uuid: "9574c97fc8a8478185629134761de595" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46791 } } peers { permanent_uuid: "8582a3d3b9744b8faebb8542fbb4e2cb" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 46661 } }
I20260807 22:40:42.701426 30706 leader_election.cc:288] T a7faab8321884dbcb1f06f59e5847c38 P 9574c97fc8a8478185629134761de595 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82cd3ce9e7b34e3bb38672613c309fbf (127.22.212.66:32949), 8582a3d3b9744b8faebb8542fbb4e2cb (127.22.212.67:46661)
W20260807 22:40:42.704475 30473 tablet.cc:2369] T a7faab8321884dbcb1f06f59e5847c38 P 82cd3ce9e7b34e3bb38672613c309fbf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:40:42.705327 30697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:42.701759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:41463 (local address 127.22.212.67:46661)
0807 22:40:42.701814 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:42.701816 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:42.701826 (+ 10us) server_negotiation.cc:407] Connection header received
0807 22:40:42.701857 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:42.701858 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:42.701867 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:42.701937 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:42.702130 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:42.702903 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:42.704482 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:42.704949 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:42.705040 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:42.705052 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:42.705222 (+ 170us) server_negotiation.cc:299] Negotiation successful
0807 22:40:42.705262 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260807 22:40:42.705327 30293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:42.701641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.67:46661 (local address 127.22.212.65:41463)
0807 22:40:42.701694 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:42.701707 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:42.701756 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:42.701952 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:42.701953 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:42.701955 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:42.702048 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:42.702050 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:42.703019 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:42.703020 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:42.704367 (+ 1347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:42.704371 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:42.705059 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:42.705060 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:42.705144 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:42.705147 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:40:42.705214 (+ 67us) client_negotiation.cc:240] Negotiation successful
0807 22:40:42.705256 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32,"mutex_wait_us":27}
I20260807 22:40:42.705401 30696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:42.701723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:33845 (local address 127.22.212.66:32949)
0807 22:40:42.701773 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:42.701775 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:42.702059 (+ 284us) server_negotiation.cc:407] Connection header received
0807 22:40:42.702103 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:42.702105 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:42.702117 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:42.702176 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:42.702313 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:42.703005 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:42.704468 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:42.704946 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:42.705042 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:42.705053 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:42.705297 (+ 244us) server_negotiation.cc:299] Negotiation successful
0807 22:40:42.705333 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 22:40:42.705446 30709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:42.701641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.66:32949 (local address 127.22.212.65:33845)
0807 22:40:42.701972 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:42.701982 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:42.702038 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:42.702198 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:42.702198 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:42.702200 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:42.702248 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:42.702249 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:42.703068 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:42.703068 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:42.704367 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:42.704371 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:42.705090 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:42.705091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:42.705232 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:42.705236 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 22:40:42.705291 (+ 55us) client_negotiation.cc:240] Negotiation successful
0807 22:40:42.705332 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"mutex_wait_us":116,"thread_start_us":133,"threads_started":1}
I20260807 22:40:42.705714 30612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7faab8321884dbcb1f06f59e5847c38" candidate_uuid: "9574c97fc8a8478185629134761de595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8582a3d3b9744b8faebb8542fbb4e2cb" is_pre_election: true
I20260807 22:40:42.705842 30612 raft_consensus.cc:2454] T a7faab8321884dbcb1f06f59e5847c38 P 8582a3d3b9744b8faebb8542fbb4e2cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9574c97fc8a8478185629134761de595 in term 0.
I20260807 22:40:42.706048 30124 leader_election.cc:302] T a7faab8321884dbcb1f06f59e5847c38 P 9574c97fc8a8478185629134761de595 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8582a3d3b9744b8faebb8542fbb4e2cb, 9574c97fc8a8478185629134761de595; no voters:
I20260807 22:40:42.706107 30404 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7faab8321884dbcb1f06f59e5847c38" candidate_uuid: "9574c97fc8a8478185629134761de595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82cd3ce9e7b34e3bb38672613c309fbf" is_pre_election: true
I20260807 22:40:42.706199 30706 raft_consensus.cc:2781] T a7faab8321884dbcb1f06f59e5847c38 P 9574c97fc8a8478185629134761de595 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:40:42.706252 30706 raft_consensus.cc:482] T a7faab8321884dbcb1f06f59e5847c38 P 9574c97fc8a8478185629134761de595 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:40:42.706262 30404 raft_consensus.cc:2454] T a7faab8321884dbcb1f06f59e5847c38 P 82cd3ce9e7b34e3bb38672613c309fbf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9574c97fc8a8478185629134761de595 in term 0.
I20260807 22:40:42.706285 30706 raft_consensus.cc:3037] T a7faab8321884dbcb1f06f59e5847c38 P 9574c97fc8a8478185629134761de595 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:42.706964 30706 raft_consensus.cc:504] T a7faab8321884dbcb1f06f59e5847c38 P 9574c97fc8a8478185629134761de595 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82cd3ce9e7b34e3bb38672613c309fbf" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 32949 } } peers { permanent_uuid: "9574c97fc8a8478185629134761de595" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46791 } } peers { permanent_uuid: "8582a3d3b9744b8faebb8542fbb4e2cb" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 46661 } }
I20260807 22:40:42.707116 30706 leader_election.cc:288] T a7faab8321884dbcb1f06f59e5847c38 P 9574c97fc8a8478185629134761de595 [CANDIDATE]: Term 1 election: Requested vote from peers 82cd3ce9e7b34e3bb38672613c309fbf (127.22.212.66:32949), 8582a3d3b9744b8faebb8542fbb4e2cb (127.22.212.67:46661)
I20260807 22:40:42.707289 30404 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7faab8321884dbcb1f06f59e5847c38" candidate_uuid: "9574c97fc8a8478185629134761de595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82cd3ce9e7b34e3bb38672613c309fbf"
I20260807 22:40:42.707370 30404 raft_consensus.cc:3037] T a7faab8321884dbcb1f06f59e5847c38 P 82cd3ce9e7b34e3bb38672613c309fbf [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:42.707391 30612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7faab8321884dbcb1f06f59e5847c38" candidate_uuid: "9574c97fc8a8478185629134761de595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8582a3d3b9744b8faebb8542fbb4e2cb"
I20260807 22:40:42.707468 30612 raft_consensus.cc:3037] T a7faab8321884dbcb1f06f59e5847c38 P 8582a3d3b9744b8faebb8542fbb4e2cb [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:42.708173 30612 raft_consensus.cc:2454] T a7faab8321884dbcb1f06f59e5847c38 P 8582a3d3b9744b8faebb8542fbb4e2cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9574c97fc8a8478185629134761de595 in term 1.
I20260807 22:40:42.708189 30404 raft_consensus.cc:2454] T a7faab8321884dbcb1f06f59e5847c38 P 82cd3ce9e7b34e3bb38672613c309fbf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9574c97fc8a8478185629134761de595 in term 1.
I20260807 22:40:42.708369 30123 leader_election.cc:302] T a7faab8321884dbcb1f06f59e5847c38 P 9574c97fc8a8478185629134761de595 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82cd3ce9e7b34e3bb38672613c309fbf, 9574c97fc8a8478185629134761de595; no voters:
I20260807 22:40:42.708485 30706 raft_consensus.cc:2781] T a7faab8321884dbcb1f06f59e5847c38 P 9574c97fc8a8478185629134761de595 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:40:42.708686 30706 raft_consensus.cc:686] T a7faab8321884dbcb1f06f59e5847c38 P 9574c97fc8a8478185629134761de595 [term 1 LEADER]: Becoming Leader. State: Replica: 9574c97fc8a8478185629134761de595, State: Running, Role: LEADER
I20260807 22:40:42.708798 30706 consensus_queue.cc:237] T a7faab8321884dbcb1f06f59e5847c38 P 9574c97fc8a8478185629134761de595 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82cd3ce9e7b34e3bb38672613c309fbf" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 32949 } } peers { permanent_uuid: "9574c97fc8a8478185629134761de595" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46791 } } peers { permanent_uuid: "8582a3d3b9744b8faebb8542fbb4e2cb" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 46661 } }
I20260807 22:40:42.709632 30006 catalog_manager.cc:5495] T a7faab8321884dbcb1f06f59e5847c38 P 9574c97fc8a8478185629134761de595 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9574c97fc8a8478185629134761de595 (127.22.212.65). New cstate: current_term: 1 leader_uuid: "9574c97fc8a8478185629134761de595" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82cd3ce9e7b34e3bb38672613c309fbf" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 32949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9574c97fc8a8478185629134761de595" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 46791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8582a3d3b9744b8faebb8542fbb4e2cb" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 46661 } health_report { overall_health: UNKNOWN } } }
I20260807 22:40:42.715309 30698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:42.712873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36832 (local address 127.22.212.65:46791)
0807 22:40:42.712919 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:42.712921 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:42.712930 (+ 9us) server_negotiation.cc:407] Connection header received
0807 22:40:42.713001 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:42.713002 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:42.713027 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:42.713099 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:40:42.713258 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:42.713707 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:42.714488 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:42.714680 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:42.714783 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:42.714961 (+ 178us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:40:42.715066 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:40:42.715161 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:42.715181 (+ 20us) server_negotiation.cc:299] Negotiation successful
0807 22:40:42.715201 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 22:40:42.717105 30612 raft_consensus.cc:1261] T a7faab8321884dbcb1f06f59e5847c38 P 8582a3d3b9744b8faebb8542fbb4e2cb [term 1 FOLLOWER]: Refusing update from remote peer 9574c97fc8a8478185629134761de595: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:40:42.717126 30404 raft_consensus.cc:1261] T a7faab8321884dbcb1f06f59e5847c38 P 82cd3ce9e7b34e3bb38672613c309fbf [term 1 FOLLOWER]: Refusing update from remote peer 9574c97fc8a8478185629134761de595: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:40:42.717468 30706 consensus_queue.cc:1035] T a7faab8321884dbcb1f06f59e5847c38 P 9574c97fc8a8478185629134761de595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8582a3d3b9744b8faebb8542fbb4e2cb" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 46661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:40:42.717614 30710 consensus_queue.cc:1035] T a7faab8321884dbcb1f06f59e5847c38 P 9574c97fc8a8478185629134761de595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82cd3ce9e7b34e3bb38672613c309fbf" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 32949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:40:42.720222 30717 mvcc.cc:205] Tried to move back new op lower bound from 7316039445366218752 to 7316039445335826432. Current Snapshot: MvccSnapshot[applied={T|T < 7316039445366218752}]
I20260807 22:40:42.720468 30718 mvcc.cc:205] Tried to move back new op lower bound from 7316039445366218752 to 7316039445335826432. Current Snapshot: MvccSnapshot[applied={T|T < 7316039445366218752}]
I20260807 22:40:42.722398 30007 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37606:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:40:42.722506 30007 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37606:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:40:42.723268 30007 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2a22603869694c83932ff789f430b36d: Sending DeleteTablet for 3 replicas of tablet a7faab8321884dbcb1f06f59e5847c38
I20260807 22:40:42.723733 30380 tablet_service.cc:1514] Processing DeleteTablet for tablet a7faab8321884dbcb1f06f59e5847c38 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:42 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:35632
I20260807 22:40:42.723763 30577 tablet_service.cc:1514] Processing DeleteTablet for tablet a7faab8321884dbcb1f06f59e5847c38 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:42 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:58442
I20260807 22:40:42.723970 30729 tablet_replica.cc:330] T a7faab8321884dbcb1f06f59e5847c38 P 82cd3ce9e7b34e3bb38672613c309fbf: stopping tablet replica
I20260807 22:40:42.724074 30729 raft_consensus.cc:2229] T a7faab8321884dbcb1f06f59e5847c38 P 82cd3ce9e7b34e3bb38672613c309fbf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:40:42.724049 30187 tablet_service.cc:1514] Processing DeleteTablet for tablet a7faab8321884dbcb1f06f59e5847c38 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:42 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:36820
I20260807 22:40:42.724078 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 30096
I20260807 22:40:42.724172 30729 raft_consensus.cc:2258] T a7faab8321884dbcb1f06f59e5847c38 P 82cd3ce9e7b34e3bb38672613c309fbf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:42.724418 30731 tablet_replica.cc:330] T a7faab8321884dbcb1f06f59e5847c38 P 8582a3d3b9744b8faebb8542fbb4e2cb: stopping tablet replica
I20260807 22:40:42.724501 30731 raft_consensus.cc:2229] T a7faab8321884dbcb1f06f59e5847c38 P 8582a3d3b9744b8faebb8542fbb4e2cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:40:42.724591 30731 raft_consensus.cc:2258] T a7faab8321884dbcb1f06f59e5847c38 P 8582a3d3b9744b8faebb8542fbb4e2cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:42.729657 30731 ts_tablet_manager.cc:1905] T a7faab8321884dbcb1f06f59e5847c38 P 8582a3d3b9744b8faebb8542fbb4e2cb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:42.731319 30729 ts_tablet_manager.cc:1905] T a7faab8321884dbcb1f06f59e5847c38 P 82cd3ce9e7b34e3bb38672613c309fbf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:42.731917 30731 ts_tablet_manager.cc:1918] T a7faab8321884dbcb1f06f59e5847c38 P 8582a3d3b9744b8faebb8542fbb4e2cb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:40:42.732008 30731 log.cc:1196] T a7faab8321884dbcb1f06f59e5847c38 P 8582a3d3b9744b8faebb8542fbb4e2cb: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-2/wal/wals/a7faab8321884dbcb1f06f59e5847c38
I20260807 22:40:42.732383 30731 ts_tablet_manager.cc:1939] T a7faab8321884dbcb1f06f59e5847c38 P 8582a3d3b9744b8faebb8542fbb4e2cb: Deleting consensus metadata
I20260807 22:40:42.733125 30729 ts_tablet_manager.cc:1918] T a7faab8321884dbcb1f06f59e5847c38 P 82cd3ce9e7b34e3bb38672613c309fbf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:40:42.733201 30729 log.cc:1196] T a7faab8321884dbcb1f06f59e5847c38 P 82cd3ce9e7b34e3bb38672613c309fbf: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786142418640232-23377-0/minicluster-data/ts-1/wal/wals/a7faab8321884dbcb1f06f59e5847c38
I20260807 22:40:42.733428 30729 ts_tablet_manager.cc:1939] T a7faab8321884dbcb1f06f59e5847c38 P 82cd3ce9e7b34e3bb38672613c309fbf: Deleting consensus metadata
I20260807 22:40:42.733927 29989 catalog_manager.cc:4841] TS 82cd3ce9e7b34e3bb38672613c309fbf (127.22.212.66:32949): tablet a7faab8321884dbcb1f06f59e5847c38 (table test-table [id=7cd1f7eb088241a290df68c928bea2d1]) successfully deleted
I20260807 22:40:42.735431 29990 catalog_manager.cc:4841] TS 8582a3d3b9744b8faebb8542fbb4e2cb (127.22.212.67:46661): tablet a7faab8321884dbcb1f06f59e5847c38 (table test-table [id=7cd1f7eb088241a290df68c928bea2d1]) successfully deleted
W20260807 22:40:42.739827 29992 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.212.65:46791 (error 108)
I20260807 22:40:42.740075 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 30296
I20260807 22:40:42.745831 30691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:42.744663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:46791 (local address 127.0.0.1:36846)
0807 22:40:42.745715 (+ 1052us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:42.745778 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.65:46791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1023}
W20260807 22:40:42.747046 29992 catalog_manager.cc:4584] TS 9574c97fc8a8478185629134761de595 (127.22.212.65:46791): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a7faab8321884dbcb1f06f59e5847c38: Network error: Client connection negotiation failed: client connection to 127.22.212.65:46791: connect: Connection refused (error 111)
I20260807 22:40:42.751117 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 30480
I20260807 22:40:42.761714 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 29969
2026-08-07T22:40:42Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2175 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-07T22:40:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:40:42Z Disabled control of system clock
I20260807 22:40:42.792637 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:42707
--webserver_interface=127.22.212.126
--webserver_port=0
--builtin_ntp_servers=127.22.212.84:44807
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:42707
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 22:40:42.874434 30737 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:42.874650 30737 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:42.874671 30737 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:42.875769 30737 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:40:42.875808 30737 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:42.875821 30737 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:42.875833 30737 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:40:42.875845 30737 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:40:42.877265 30737 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:44807
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:42707
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:42707
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30737
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:42.877466 30737 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:42.877729 30737 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:42.882958 30749 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:42.883025 30748 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:42.882962 30753 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:42.883016 30737 server_base.cc:1034] running on GCE node
I20260807 22:40:42.883426 30737 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:42.883682 30737 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:42.884824 30737 hybrid_clock.cc:648] HybridClock initialized: now 1786142442884812 us; error 31 us; skew 500 ppm
I20260807 22:40:42.891866 30737 webserver.cc:460] Webserver started at http://127.22.212.126:36687/ using document root <none> and password file <none>
I20260807 22:40:42.892120 30737 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:42.892165 30737 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:42.892319 30737 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:42.893417 30737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "4adab0f583424e91987cee49ec10c9f0"
format_stamp: "Formatted at 2026-08-07 22:40:42 on dist-test-slave-2d19"
server_key: "a5b9b9dba53c48353b32d42b0176e354"
server_key_iv: "a5505abc6a995b7f60d2de5351a3782d"
server_key_version: "encryptionkey@0"
I20260807 22:40:42.893754 30737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "4adab0f583424e91987cee49ec10c9f0"
format_stamp: "Formatted at 2026-08-07 22:40:42 on dist-test-slave-2d19"
server_key: "a5b9b9dba53c48353b32d42b0176e354"
server_key_iv: "a5505abc6a995b7f60d2de5351a3782d"
server_key_version: "encryptionkey@0"
I20260807 22:40:42.895080 30737 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260807 22:40:42.895838 30764 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:42.896070 30737 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 22:40:42.896188 30737 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "4adab0f583424e91987cee49ec10c9f0"
format_stamp: "Formatted at 2026-08-07 22:40:42 on dist-test-slave-2d19"
server_key: "a5b9b9dba53c48353b32d42b0176e354"
server_key_iv: "a5505abc6a995b7f60d2de5351a3782d"
server_key_version: "encryptionkey@0"
I20260807 22:40:42.896297 30737 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:42.899693 30737 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:42.899966 30737 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:42.900111 30737 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:42.904012 30737 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:42707
I20260807 22:40:42.904052 30841 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:42707 every 8 connection(s)
I20260807 22:40:42.904429 30737 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:40:42.905144 30842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:42.906967 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 30737
I20260807 22:40:42.907081 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:40:42.907269 23377 external_mini_cluster.cc:1428] Setting key 8f9393f18f16621f1118fe012b5cc97e
I20260807 22:40:42.908459 30842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4adab0f583424e91987cee49ec10c9f0: Bootstrap starting.
I20260807 22:40:42.909200 30842 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4adab0f583424e91987cee49ec10c9f0: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:42.909557 30842 log.cc:824] T 00000000000000000000000000000000 P 4adab0f583424e91987cee49ec10c9f0: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:42.909966 30846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:42.907815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52942 (local address 127.22.212.126:42707)
0807 22:40:42.908034 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:42.908042 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:42.908080 (+ 38us) server_negotiation.cc:407] Connection header received
0807 22:40:42.908616 (+ 536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:42.908625 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:42.908677 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:42.908844 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:42.909452 (+ 608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:42.909456 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:42.909456 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:40:42.909462 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:42.909512 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:40:42.909527 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:42.909607 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:42.909698 (+ 91us) server_negotiation.cc:299] Negotiation successful
0807 22:40:42.909760 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":78,"threads_started":1}
I20260807 22:40:42.910349 30842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4adab0f583424e91987cee49ec10c9f0: No bootstrap required, opened a new log
I20260807 22:40:42.911767 30842 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4adab0f583424e91987cee49ec10c9f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4adab0f583424e91987cee49ec10c9f0" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 42707 } }
I20260807 22:40:42.911933 30842 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4adab0f583424e91987cee49ec10c9f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:42.911983 30842 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4adab0f583424e91987cee49ec10c9f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4adab0f583424e91987cee49ec10c9f0, State: Initialized, Role: FOLLOWER
I20260807 22:40:42.912117 30842 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4adab0f583424e91987cee49ec10c9f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4adab0f583424e91987cee49ec10c9f0" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 42707 } }
I20260807 22:40:42.912212 30842 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4adab0f583424e91987cee49ec10c9f0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:40:42.912283 30842 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4adab0f583424e91987cee49ec10c9f0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:40:42.912336 30842 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4adab0f583424e91987cee49ec10c9f0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:42.913132 30842 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4adab0f583424e91987cee49ec10c9f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4adab0f583424e91987cee49ec10c9f0" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 42707 } }
I20260807 22:40:42.913256 30842 leader_election.cc:302] T 00000000000000000000000000000000 P 4adab0f583424e91987cee49ec10c9f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4adab0f583424e91987cee49ec10c9f0; no voters:
I20260807 22:40:42.913444 30842 leader_election.cc:288] T 00000000000000000000000000000000 P 4adab0f583424e91987cee49ec10c9f0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:40:42.913477 30848 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4adab0f583424e91987cee49ec10c9f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:40:42.913650 30848 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4adab0f583424e91987cee49ec10c9f0 [term 1 LEADER]: Becoming Leader. State: Replica: 4adab0f583424e91987cee49ec10c9f0, State: Running, Role: LEADER
I20260807 22:40:42.913728 30842 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4adab0f583424e91987cee49ec10c9f0 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:40:42.913750 30848 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4adab0f583424e91987cee49ec10c9f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4adab0f583424e91987cee49ec10c9f0" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 42707 } }
I20260807 22:40:42.914057 30849 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4adab0f583424e91987cee49ec10c9f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4adab0f583424e91987cee49ec10c9f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4adab0f583424e91987cee49ec10c9f0" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 42707 } } }
I20260807 22:40:42.914070 30850 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4adab0f583424e91987cee49ec10c9f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4adab0f583424e91987cee49ec10c9f0. Latest consensus state: current_term: 1 leader_uuid: "4adab0f583424e91987cee49ec10c9f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4adab0f583424e91987cee49ec10c9f0" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 42707 } } }
I20260807 22:40:42.914175 30849 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4adab0f583424e91987cee49ec10c9f0 [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:42.914186 30850 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4adab0f583424e91987cee49ec10c9f0 [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:42.914400 30855 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:40:42.914893 30855 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:40:42.916289 30869 mvcc.cc:205] Tried to move back new op lower bound from 7316039446182830080 to 7316039446175051776. Current Snapshot: MvccSnapshot[applied={T|T < 7316039446182830080}]
I20260807 22:40:42.916692 30855 catalog_manager.cc:1347] Generated new cluster ID: 0a07233c3c62434b983bee88de21cbf6
I20260807 22:40:42.916746 30855 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:40:42.935160 30855 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:40:42.935364 30855 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:40:42.945426 30855 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4adab0f583424e91987cee49ec10c9f0: Generated new TSK 0
I20260807 22:40:42.945679 30855 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:40:42.954682 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.65:0
--local_ip_for_outbound_sockets=127.22.212.65
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:42707
--builtin_ntp_servers=127.22.212.84:44807
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 22:40:43.039089 30871 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:43.039294 30871 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:43.039316 30871 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:43.040586 30871 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:43.040628 30871 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:43.040654 30871 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.65
I20260807 22:40:43.042011 30871 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:44807
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:42707
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30871
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.65
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:43.042253 30871 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:43.042588 30871 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:43.047685 30884 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:43.047675 30879 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:43.047923 30871 server_base.cc:1034] running on GCE node
W20260807 22:40:43.047676 30878 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:43.048207 30871 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:43.048523 30871 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:43.049686 30871 hybrid_clock.cc:648] HybridClock initialized: now 1786142443049667 us; error 37 us; skew 500 ppm
I20260807 22:40:43.050961 30871 webserver.cc:460] Webserver started at http://127.22.212.65:36939/ using document root <none> and password file <none>
I20260807 22:40:43.051200 30871 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:43.051245 30871 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:43.051337 30871 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:43.052484 30871 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-0/data/instance:
uuid: "6fa75e1676a3448a84ce6f76f34b78da"
format_stamp: "Formatted at 2026-08-07 22:40:43 on dist-test-slave-2d19"
server_key: "49496ae02f0b6b386378fd7f8213fc8d"
server_key_iv: "02b73678a1532aea67538d85163d27cb"
server_key_version: "encryptionkey@0"
I20260807 22:40:43.052800 30871 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance:
uuid: "6fa75e1676a3448a84ce6f76f34b78da"
format_stamp: "Formatted at 2026-08-07 22:40:43 on dist-test-slave-2d19"
server_key: "49496ae02f0b6b386378fd7f8213fc8d"
server_key_iv: "02b73678a1532aea67538d85163d27cb"
server_key_version: "encryptionkey@0"
I20260807 22:40:43.054075 30871 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:40:43.054774 30894 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:43.054971 30871 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 22:40:43.055064 30871 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-0/wal
uuid: "6fa75e1676a3448a84ce6f76f34b78da"
format_stamp: "Formatted at 2026-08-07 22:40:43 on dist-test-slave-2d19"
server_key: "49496ae02f0b6b386378fd7f8213fc8d"
server_key_iv: "02b73678a1532aea67538d85163d27cb"
server_key_version: "encryptionkey@0"
I20260807 22:40:43.055122 30871 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:43.058435 30871 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:43.058655 30871 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:43.058750 30871 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:43.058913 30871 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:43.059157 30871 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:43.059187 30871 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:43.059207 30871 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:43.059221 30871 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:43.064706 30871 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.65:43709
I20260807 22:40:43.064788 31065 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.65:43709 every 8 connection(s)
I20260807 22:40:43.065110 30871 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
I20260807 22:40:43.067951 30846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:43.065875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:54765 (local address 127.22.212.126:42707)
0807 22:40:43.065945 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:43.065947 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:43.066184 (+ 237us) server_negotiation.cc:407] Connection header received
0807 22:40:43.066614 (+ 430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:43.066615 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:43.066620 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:43.066676 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:43.067757 (+ 1081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:43.067758 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:43.067758 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:40:43.067762 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:43.067775 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:40:43.067779 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:43.067826 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:43.067889 (+ 63us) server_negotiation.cc:299] Negotiation successful
0807 22:40:43.067901 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 22:40:43.068161 31069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:43.065850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:42707 (local address 127.22.212.65:54765)
0807 22:40:43.066057 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:43.066096 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:43.066532 (+ 436us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:43.066734 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:43.066737 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:43.066745 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:43.067612 (+ 867us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:40:43.067613 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:43.067641 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:40:43.067668 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:43.067825 (+ 157us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:43.067827 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:43.067829 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 22:40:43.067879 (+ 50us) client_negotiation.cc:240] Negotiation successful
0807 22:40:43.067928 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":104,"threads_started":1}
I20260807 22:40:43.068753 31067 heartbeater.cc:347] Connected to a master server at 127.22.212.126:42707
I20260807 22:40:43.068863 31067 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:43.069036 31067 heartbeater.cc:511] Master 127.22.212.126:42707 requested a full tablet report, sending...
I20260807 22:40:43.069581 30790 ts_manager.cc:194] Registered new tserver with Master: 6fa75e1676a3448a84ce6f76f34b78da (127.22.212.65:43709)
I20260807 22:40:43.070317 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 30871
I20260807 22:40:43.070430 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance
I20260807 22:40:43.070626 23377 external_mini_cluster.cc:1428] Setting key 636340ca052141124952d755a839d6a7
I20260807 22:40:43.071448 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.66:0
--local_ip_for_outbound_sockets=127.22.212.66
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:42707
--builtin_ntp_servers=127.22.212.84:44807
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 22:40:43.155452 31070 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:43.155718 31070 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:43.155755 31070 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:43.157024 31070 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:43.157092 31070 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:43.157135 31070 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.66
I20260807 22:40:43.158630 31070 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:44807
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:42707
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31070
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.66
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:43.158918 31070 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:43.159276 31070 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:43.164688 31078 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:43.164703 31075 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:43.164733 31081 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:43.164896 31070 server_base.cc:1034] running on GCE node
I20260807 22:40:43.165197 31070 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:43.165457 31070 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:43.166602 31070 hybrid_clock.cc:648] HybridClock initialized: now 1786142443166591 us; error 29 us; skew 500 ppm
I20260807 22:40:43.167857 31070 webserver.cc:460] Webserver started at http://127.22.212.66:40431/ using document root <none> and password file <none>
I20260807 22:40:43.168119 31070 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:43.168170 31070 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:43.168365 31070 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:43.169548 31070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-1/data/instance:
uuid: "f276c2a76fac4e989c026e89aeadd4c4"
format_stamp: "Formatted at 2026-08-07 22:40:43 on dist-test-slave-2d19"
server_key: "fd03cfe1ea673c91b55536329e8441a0"
server_key_iv: "d76ff8c309ead46af7a4199516df7e4e"
server_key_version: "encryptionkey@0"
I20260807 22:40:43.169919 31070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance:
uuid: "f276c2a76fac4e989c026e89aeadd4c4"
format_stamp: "Formatted at 2026-08-07 22:40:43 on dist-test-slave-2d19"
server_key: "fd03cfe1ea673c91b55536329e8441a0"
server_key_iv: "d76ff8c309ead46af7a4199516df7e4e"
server_key_version: "encryptionkey@0"
I20260807 22:40:43.171293 31070 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 22:40:43.172060 31089 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:43.172238 31070 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 22:40:43.172384 31070 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-1/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-1/wal
uuid: "f276c2a76fac4e989c026e89aeadd4c4"
format_stamp: "Formatted at 2026-08-07 22:40:43 on dist-test-slave-2d19"
server_key: "fd03cfe1ea673c91b55536329e8441a0"
server_key_iv: "d76ff8c309ead46af7a4199516df7e4e"
server_key_version: "encryptionkey@0"
I20260807 22:40:43.172467 31070 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:43.175849 31070 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:43.176131 31070 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:43.176298 31070 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:43.176553 31070 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:43.176870 31070 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:43.176924 31070 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:43.176963 31070 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:43.176990 31070 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:43.182886 31070 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.66:45295
I20260807 22:40:43.182924 31271 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.66:45295 every 8 connection(s)
I20260807 22:40:43.183265 31070 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
I20260807 22:40:43.186542 30846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:43.184038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:45811 (local address 127.22.212.126:42707)
0807 22:40:43.184111 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:43.184113 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:43.184445 (+ 332us) server_negotiation.cc:407] Connection header received
0807 22:40:43.184969 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:43.184970 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:43.184979 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:43.185044 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:43.186250 (+ 1206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:43.186252 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:43.186252 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:40:43.186257 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:43.186273 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:40:43.186277 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:43.186352 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:43.186450 (+ 98us) server_negotiation.cc:299] Negotiation successful
0807 22:40:43.186467 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260807 22:40:43.186796 31276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:43.184035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:42707 (local address 127.22.212.66:45811)
0807 22:40:43.184303 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:43.184349 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:43.184847 (+ 498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:43.185119 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:43.185123 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:43.185139 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:43.186086 (+ 947us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:40:43.186086 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:43.186116 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:40:43.186145 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:43.186352 (+ 207us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:43.186358 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:43.186362 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 22:40:43.186463 (+ 101us) client_negotiation.cc:240] Negotiation successful
0807 22:40:43.186535 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":74,"threads_started":1}
I20260807 22:40:43.186980 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 31070
I20260807 22:40:43.187086 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance
I20260807 22:40:43.187239 31273 heartbeater.cc:347] Connected to a master server at 127.22.212.126:42707
I20260807 22:40:43.187286 23377 external_mini_cluster.cc:1428] Setting key d729e5cbc04d16bb9f7f1c18b4ae6b8a
I20260807 22:40:43.187353 31273 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:43.187510 31273 heartbeater.cc:511] Master 127.22.212.126:42707 requested a full tablet report, sending...
I20260807 22:40:43.187929 30789 ts_manager.cc:194] Registered new tserver with Master: f276c2a76fac4e989c026e89aeadd4c4 (127.22.212.66:45295)
I20260807 22:40:43.188470 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.67:0
--local_ip_for_outbound_sockets=127.22.212.67
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:42707
--builtin_ntp_servers=127.22.212.84:44807
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 22:40:43.274302 31277 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:43.274500 31277 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:43.274521 31277 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:43.275739 31277 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:43.275785 31277 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:43.275811 31277 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.67
I20260807 22:40:43.277271 31277 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:44807
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:42707
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31277
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.67
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:43.277540 31277 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:43.277926 31277 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:43.283346 31285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:43.283389 31277 server_base.cc:1034] running on GCE node
W20260807 22:40:43.283356 31286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:43.283350 31288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:43.283803 31277 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:43.284045 31277 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:43.285187 31277 hybrid_clock.cc:648] HybridClock initialized: now 1786142443285146 us; error 56 us; skew 500 ppm
I20260807 22:40:43.286475 31277 webserver.cc:460] Webserver started at http://127.22.212.67:43675/ using document root <none> and password file <none>
I20260807 22:40:43.286751 31277 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:43.286798 31277 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:43.286970 31277 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:43.288053 31277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-2/data/instance:
uuid: "9a6afa8a883f4bce8ad6b71d28aa4e5e"
format_stamp: "Formatted at 2026-08-07 22:40:43 on dist-test-slave-2d19"
server_key: "13990f1eeb2531ea51dd87cd5d18b0fa"
server_key_iv: "57dbb53ec764698b976585f1be259ce7"
server_key_version: "encryptionkey@0"
I20260807 22:40:43.288435 31277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance:
uuid: "9a6afa8a883f4bce8ad6b71d28aa4e5e"
format_stamp: "Formatted at 2026-08-07 22:40:43 on dist-test-slave-2d19"
server_key: "13990f1eeb2531ea51dd87cd5d18b0fa"
server_key_iv: "57dbb53ec764698b976585f1be259ce7"
server_key_version: "encryptionkey@0"
I20260807 22:40:43.289726 31277 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 22:40:43.290409 31297 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:43.290572 31277 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 22:40:43.290679 31277 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-2/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-2/wal
uuid: "9a6afa8a883f4bce8ad6b71d28aa4e5e"
format_stamp: "Formatted at 2026-08-07 22:40:43 on dist-test-slave-2d19"
server_key: "13990f1eeb2531ea51dd87cd5d18b0fa"
server_key_iv: "57dbb53ec764698b976585f1be259ce7"
server_key_version: "encryptionkey@0"
I20260807 22:40:43.290753 31277 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:43.294209 31277 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:43.294454 31277 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:43.294598 31277 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:43.294797 31277 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:43.295102 31277 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:43.295156 31277 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:43.295195 31277 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:43.295241 31277 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:43.301194 31277 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.67:43349
I20260807 22:40:43.301232 31463 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.67:43349 every 8 connection(s)
I20260807 22:40:43.301568 31277 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
I20260807 22:40:43.304067 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 31277
I20260807 22:40:43.304175 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance
I20260807 22:40:43.304406 23377 external_mini_cluster.cc:1428] Setting key 39b32534c10f1bc07bf7ade777329ad0
I20260807 22:40:43.304797 30846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:43.302285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:48673 (local address 127.22.212.126:42707)
0807 22:40:43.302367 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:43.302369 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:43.302574 (+ 205us) server_negotiation.cc:407] Connection header received
0807 22:40:43.302998 (+ 424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:43.302999 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:43.303005 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:43.303059 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:43.304371 (+ 1312us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:43.304373 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:43.304373 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:40:43.304377 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:43.304393 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:40:43.304397 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:43.304445 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:43.304704 (+ 259us) server_negotiation.cc:299] Negotiation successful
0807 22:40:43.304721 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 22:40:43.304848 31467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:43.302249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:42707 (local address 127.22.212.67:48673)
0807 22:40:43.302453 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:43.302487 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:43.302913 (+ 426us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:43.303122 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:43.303125 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:43.303133 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:43.304162 (+ 1029us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:40:43.304163 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:43.304204 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:40:43.304240 (+ 36us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:43.304461 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:43.304468 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:43.304471 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:40:43.304587 (+ 116us) client_negotiation.cc:240] Negotiation successful
0807 22:40:43.304653 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":102,"threads_started":1}
I20260807 22:40:43.305377 31464 heartbeater.cc:347] Connected to a master server at 127.22.212.126:42707
I20260807 22:40:43.305481 31464 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:43.305639 31464 heartbeater.cc:511] Master 127.22.212.126:42707 requested a full tablet report, sending...
I20260807 22:40:43.305975 30790 ts_manager.cc:194] Registered new tserver with Master: 9a6afa8a883f4bce8ad6b71d28aa4e5e (127.22.212.67:43349)
I20260807 22:40:43.316461 23377 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:40:43.318663 30846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:43.317759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52954 (local address 127.22.212.126:42707)
0807 22:40:43.317800 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:43.317802 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:43.317910 (+ 108us) server_negotiation.cc:407] Connection header received
0807 22:40:43.317967 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:43.317967 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:43.317973 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:43.318028 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:43.318510 (+ 482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:43.318511 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:43.318511 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:40:43.318514 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:43.318527 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:40:43.318531 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:43.318570 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:43.318602 (+ 32us) server_negotiation.cc:299] Negotiation successful
0807 22:40:43.318613 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260807 22:40:43.320159 30790 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52954:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:40:43.321741 30790 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:40:43.325659 31475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:43.324113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.66:45295 (local address 127.0.0.1:39168)
0807 22:40:43.324331 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:43.324377 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:43.324438 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:43.324587 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:43.324590 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:43.324596 (+ 6us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:43.325231 (+ 635us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:40:43.325232 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:43.325249 (+ 17us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:40:43.325275 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:43.325485 (+ 210us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:43.325491 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:43.325495 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 22:40:43.325573 (+ 78us) client_negotiation.cc:240] Negotiation successful
0807 22:40:43.325588 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":102,"threads_started":1}
I20260807 22:40:43.325677 31476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:43.324208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39168 (local address 127.22.212.66:45295)
0807 22:40:43.324423 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:43.324428 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:43.324440 (+ 12us) server_negotiation.cc:407] Connection header received
0807 22:40:43.324505 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:43.324508 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:43.324517 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:43.324587 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:43.325342 (+ 755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:43.325349 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:43.325350 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:40:43.325354 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:43.325393 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:40:43.325420 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:43.325491 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:43.325584 (+ 93us) server_negotiation.cc:299] Negotiation successful
0807 22:40:43.325601 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":129,"threads_started":1}
I20260807 22:40:43.326315 31477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:43.324121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.67:43349 (local address 127.0.0.1:58756)
0807 22:40:43.324544 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:43.324555 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:43.324605 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:43.325477 (+ 872us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:43.325478 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:43.325481 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:43.325909 (+ 428us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:40:43.325910 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:43.325916 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:40:43.325928 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:43.326179 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:43.326179 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:43.326180 (+ 1us) client_negotiation.cc:769] Sending connection context
0807 22:40:43.326238 (+ 58us) client_negotiation.cc:240] Negotiation successful
0807 22:40:43.326252 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":81,"threads_started":1}
I20260807 22:40:43.326339 31479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:43.324543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58756 (local address 127.22.212.67:43349)
0807 22:40:43.325067 (+ 524us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:43.325071 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:43.325082 (+ 11us) server_negotiation.cc:407] Connection header received
0807 22:40:43.325107 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:43.325109 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:43.325118 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:43.325199 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:43.326017 (+ 818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:43.326026 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:43.326026 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:40:43.326042 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:43.326076 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:40:43.326101 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:43.326181 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:43.326247 (+ 66us) server_negotiation.cc:299] Negotiation successful
0807 22:40:43.326261 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":485,"thread_start_us":101,"threads_started":1}
I20260807 22:40:43.327013 31474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:43.324392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:43709 (local address 127.0.0.1:40268)
0807 22:40:43.325673 (+ 1281us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:43.325683 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:43.325729 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:43.326233 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:43.326234 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:43.326237 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:43.326624 (+ 387us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:40:43.326625 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:43.326633 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:40:43.326646 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:43.326879 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:43.326880 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:43.326880 (+ 0us) client_negotiation.cc:769] Sending connection context
0807 22:40:43.326933 (+ 53us) client_negotiation.cc:240] Negotiation successful
0807 22:40:43.326947 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1268,"thread_start_us":75,"threads_started":1}
I20260807 22:40:43.327114 31170 tablet_service.cc:1467] Processing CreateTablet for tablet 53110fb5ea6549b686d126189c1d9a51 (DEFAULT_TABLE table=test-table [id=0bae4a1f64a24da0ad26a1fc23621cc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:43.327279 31480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:43.324843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40268 (local address 127.22.212.65:43709)
0807 22:40:43.325088 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:43.325091 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:43.325805 (+ 714us) server_negotiation.cc:407] Connection header received
0807 22:40:43.325836 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:43.325838 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:43.325849 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:43.325933 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:43.326732 (+ 799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:43.326739 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:43.326740 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:40:43.326744 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:43.326777 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:40:43.326802 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:43.326852 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:43.326961 (+ 109us) server_negotiation.cc:299] Negotiation successful
0807 22:40:43.326978 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":204,"thread_start_us":91,"threads_started":1}
I20260807 22:40:43.327243 31366 tablet_service.cc:1467] Processing CreateTablet for tablet 53110fb5ea6549b686d126189c1d9a51 (DEFAULT_TABLE table=test-table [id=0bae4a1f64a24da0ad26a1fc23621cc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:43.327495 31170 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53110fb5ea6549b686d126189c1d9a51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:43.327612 31366 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53110fb5ea6549b686d126189c1d9a51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:43.328089 30963 tablet_service.cc:1467] Processing CreateTablet for tablet 53110fb5ea6549b686d126189c1d9a51 (DEFAULT_TABLE table=test-table [id=0bae4a1f64a24da0ad26a1fc23621cc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:43.328418 30963 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53110fb5ea6549b686d126189c1d9a51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:43.330298 31481 tablet_bootstrap.cc:492] T 53110fb5ea6549b686d126189c1d9a51 P f276c2a76fac4e989c026e89aeadd4c4: Bootstrap starting.
I20260807 22:40:43.331055 31481 tablet_bootstrap.cc:654] T 53110fb5ea6549b686d126189c1d9a51 P f276c2a76fac4e989c026e89aeadd4c4: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:43.331061 31484 tablet_bootstrap.cc:492] T 53110fb5ea6549b686d126189c1d9a51 P 9a6afa8a883f4bce8ad6b71d28aa4e5e: Bootstrap starting.
I20260807 22:40:43.331416 31481 log.cc:824] T 53110fb5ea6549b686d126189c1d9a51 P f276c2a76fac4e989c026e89aeadd4c4: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:43.331750 31484 tablet_bootstrap.cc:654] T 53110fb5ea6549b686d126189c1d9a51 P 9a6afa8a883f4bce8ad6b71d28aa4e5e: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:43.331854 31486 tablet_bootstrap.cc:492] T 53110fb5ea6549b686d126189c1d9a51 P 6fa75e1676a3448a84ce6f76f34b78da: Bootstrap starting.
I20260807 22:40:43.332134 31484 log.cc:824] T 53110fb5ea6549b686d126189c1d9a51 P 9a6afa8a883f4bce8ad6b71d28aa4e5e: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:43.332454 31481 tablet_bootstrap.cc:492] T 53110fb5ea6549b686d126189c1d9a51 P f276c2a76fac4e989c026e89aeadd4c4: No bootstrap required, opened a new log
I20260807 22:40:43.332542 31481 ts_tablet_manager.cc:1397] T 53110fb5ea6549b686d126189c1d9a51 P f276c2a76fac4e989c026e89aeadd4c4: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 22:40:43.332553 31486 tablet_bootstrap.cc:654] T 53110fb5ea6549b686d126189c1d9a51 P 6fa75e1676a3448a84ce6f76f34b78da: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:43.332839 31486 log.cc:824] T 53110fb5ea6549b686d126189c1d9a51 P 6fa75e1676a3448a84ce6f76f34b78da: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:43.333109 31484 tablet_bootstrap.cc:492] T 53110fb5ea6549b686d126189c1d9a51 P 9a6afa8a883f4bce8ad6b71d28aa4e5e: No bootstrap required, opened a new log
I20260807 22:40:43.333194 31484 ts_tablet_manager.cc:1397] T 53110fb5ea6549b686d126189c1d9a51 P 9a6afa8a883f4bce8ad6b71d28aa4e5e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 22:40:43.333619 31486 tablet_bootstrap.cc:492] T 53110fb5ea6549b686d126189c1d9a51 P 6fa75e1676a3448a84ce6f76f34b78da: No bootstrap required, opened a new log
I20260807 22:40:43.333738 31486 ts_tablet_manager.cc:1397] T 53110fb5ea6549b686d126189c1d9a51 P 6fa75e1676a3448a84ce6f76f34b78da: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 22:40:43.334838 31481 raft_consensus.cc:348] T 53110fb5ea6549b686d126189c1d9a51 P f276c2a76fac4e989c026e89aeadd4c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f276c2a76fac4e989c026e89aeadd4c4" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 45295 } } peers { permanent_uuid: "9a6afa8a883f4bce8ad6b71d28aa4e5e" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 43349 } } peers { permanent_uuid: "6fa75e1676a3448a84ce6f76f34b78da" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 43709 } }
I20260807 22:40:43.334972 31481 raft_consensus.cc:374] T 53110fb5ea6549b686d126189c1d9a51 P f276c2a76fac4e989c026e89aeadd4c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:43.334995 31481 raft_consensus.cc:729] T 53110fb5ea6549b686d126189c1d9a51 P f276c2a76fac4e989c026e89aeadd4c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f276c2a76fac4e989c026e89aeadd4c4, State: Initialized, Role: FOLLOWER
I20260807 22:40:43.335137 31481 consensus_queue.cc:260] T 53110fb5ea6549b686d126189c1d9a51 P f276c2a76fac4e989c026e89aeadd4c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f276c2a76fac4e989c026e89aeadd4c4" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 45295 } } peers { permanent_uuid: "9a6afa8a883f4bce8ad6b71d28aa4e5e" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 43349 } } peers { permanent_uuid: "6fa75e1676a3448a84ce6f76f34b78da" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 43709 } }
I20260807 22:40:43.335392 31481 ts_tablet_manager.cc:1428] T 53110fb5ea6549b686d126189c1d9a51 P f276c2a76fac4e989c026e89aeadd4c4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 22:40:43.335527 31273 heartbeater.cc:503] Master 127.22.212.126:42707 was elected leader, sending a full tablet report...
I20260807 22:40:43.336318 31484 raft_consensus.cc:348] T 53110fb5ea6549b686d126189c1d9a51 P 9a6afa8a883f4bce8ad6b71d28aa4e5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f276c2a76fac4e989c026e89aeadd4c4" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 45295 } } peers { permanent_uuid: "9a6afa8a883f4bce8ad6b71d28aa4e5e" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 43349 } } peers { permanent_uuid: "6fa75e1676a3448a84ce6f76f34b78da" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 43709 } }
I20260807 22:40:43.336483 31484 raft_consensus.cc:374] T 53110fb5ea6549b686d126189c1d9a51 P 9a6afa8a883f4bce8ad6b71d28aa4e5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:43.336520 31484 raft_consensus.cc:729] T 53110fb5ea6549b686d126189c1d9a51 P 9a6afa8a883f4bce8ad6b71d28aa4e5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a6afa8a883f4bce8ad6b71d28aa4e5e, State: Initialized, Role: FOLLOWER
I20260807 22:40:43.336635 31484 consensus_queue.cc:260] T 53110fb5ea6549b686d126189c1d9a51 P 9a6afa8a883f4bce8ad6b71d28aa4e5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f276c2a76fac4e989c026e89aeadd4c4" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 45295 } } peers { permanent_uuid: "9a6afa8a883f4bce8ad6b71d28aa4e5e" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 43349 } } peers { permanent_uuid: "6fa75e1676a3448a84ce6f76f34b78da" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 43709 } }
I20260807 22:40:43.336615 31486 raft_consensus.cc:348] T 53110fb5ea6549b686d126189c1d9a51 P 6fa75e1676a3448a84ce6f76f34b78da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f276c2a76fac4e989c026e89aeadd4c4" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 45295 } } peers { permanent_uuid: "9a6afa8a883f4bce8ad6b71d28aa4e5e" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 43349 } } peers { permanent_uuid: "6fa75e1676a3448a84ce6f76f34b78da" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 43709 } }
I20260807 22:40:43.336766 31486 raft_consensus.cc:374] T 53110fb5ea6549b686d126189c1d9a51 P 6fa75e1676a3448a84ce6f76f34b78da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:43.336817 31486 raft_consensus.cc:729] T 53110fb5ea6549b686d126189c1d9a51 P 6fa75e1676a3448a84ce6f76f34b78da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fa75e1676a3448a84ce6f76f34b78da, State: Initialized, Role: FOLLOWER
I20260807 22:40:43.336917 31484 ts_tablet_manager.cc:1428] T 53110fb5ea6549b686d126189c1d9a51 P 9a6afa8a883f4bce8ad6b71d28aa4e5e: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260807 22:40:43.336930 31486 consensus_queue.cc:260] T 53110fb5ea6549b686d126189c1d9a51 P 6fa75e1676a3448a84ce6f76f34b78da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f276c2a76fac4e989c026e89aeadd4c4" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 45295 } } peers { permanent_uuid: "9a6afa8a883f4bce8ad6b71d28aa4e5e" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 43349 } } peers { permanent_uuid: "6fa75e1676a3448a84ce6f76f34b78da" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 43709 } }
I20260807 22:40:43.337069 31464 heartbeater.cc:503] Master 127.22.212.126:42707 was elected leader, sending a full tablet report...
I20260807 22:40:43.337235 31067 heartbeater.cc:503] Master 127.22.212.126:42707 was elected leader, sending a full tablet report...
I20260807 22:40:43.337179 31486 ts_tablet_manager.cc:1428] T 53110fb5ea6549b686d126189c1d9a51 P 6fa75e1676a3448a84ce6f76f34b78da: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
W20260807 22:40:43.433828 31275 tablet.cc:2369] T 53110fb5ea6549b686d126189c1d9a51 P f276c2a76fac4e989c026e89aeadd4c4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 22:40:43.552151 31465 tablet.cc:2369] T 53110fb5ea6549b686d126189c1d9a51 P 9a6afa8a883f4bce8ad6b71d28aa4e5e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:40:43.552728 31489 raft_consensus.cc:482] T 53110fb5ea6549b686d126189c1d9a51 P f276c2a76fac4e989c026e89aeadd4c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:40:43.552834 31489 raft_consensus.cc:504] T 53110fb5ea6549b686d126189c1d9a51 P f276c2a76fac4e989c026e89aeadd4c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f276c2a76fac4e989c026e89aeadd4c4" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 45295 } } peers { permanent_uuid: "9a6afa8a883f4bce8ad6b71d28aa4e5e" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 43349 } } peers { permanent_uuid: "6fa75e1676a3448a84ce6f76f34b78da" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 43709 } }
I20260807 22:40:43.553180 31489 leader_election.cc:288] T 53110fb5ea6549b686d126189c1d9a51 P f276c2a76fac4e989c026e89aeadd4c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a6afa8a883f4bce8ad6b71d28aa4e5e (127.22.212.67:43349), 6fa75e1676a3448a84ce6f76f34b78da (127.22.212.65:43709)
I20260807 22:40:43.554574 31276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:43.553390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.67:43349 (local address 127.22.212.66:55079)
0807 22:40:43.553457 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:43.553473 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:43.553534 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:43.553706 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:43.553707 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:43.553710 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:43.554243 (+ 533us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:40:43.554244 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:43.554251 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:40:43.554264 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:43.554438 (+ 174us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:43.554439 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:43.554440 (+ 1us) client_negotiation.cc:769] Sending connection context
0807 22:40:43.554490 (+ 50us) client_negotiation.cc:240] Negotiation successful
0807 22:40:43.554505 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260807 22:40:43.554584 31479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:43.553478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:55079 (local address 127.22.212.67:43349)
0807 22:40:43.553560 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:43.553563 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:43.553572 (+ 9us) server_negotiation.cc:407] Connection header received
0807 22:40:43.553604 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:43.553606 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:43.553613 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:43.553672 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:43.554346 (+ 674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:43.554348 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:43.554348 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:40:43.554353 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:43.554373 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:40:43.554377 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:43.554440 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:43.554488 (+ 48us) server_negotiation.cc:299] Negotiation successful
0807 22:40:43.554505 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 22:40:43.554935 31494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:43.553532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:43709 (local address 127.22.212.66:55339)
0807 22:40:43.553730 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:43.553740 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:43.553785 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:43.553900 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:43.553900 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:43.553903 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:43.554392 (+ 489us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:40:43.554392 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:43.554400 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:40:43.554415 (+ 15us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:43.554763 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:43.554764 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:43.554765 (+ 1us) client_negotiation.cc:769] Sending connection context
0807 22:40:43.554840 (+ 75us) client_negotiation.cc:240] Negotiation successful
0807 22:40:43.554855 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":113,"threads_started":1}
I20260807 22:40:43.554924 31480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:43.553727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:55339 (local address 127.22.212.65:43709)
0807 22:40:43.553786 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:43.553788 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:43.553797 (+ 9us) server_negotiation.cc:407] Connection header received
0807 22:40:43.553830 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:43.553832 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:43.553836 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:43.553897 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:43.554511 (+ 614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:43.554525 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:43.554526 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:40:43.554531 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:43.554549 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:40:43.554554 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:43.554632 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:43.554847 (+ 215us) server_negotiation.cc:299] Negotiation successful
0807 22:40:43.554862 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260807 22:40:43.554925 31395 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53110fb5ea6549b686d126189c1d9a51" candidate_uuid: "f276c2a76fac4e989c026e89aeadd4c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a6afa8a883f4bce8ad6b71d28aa4e5e" is_pre_election: true
I20260807 22:40:43.555128 31395 raft_consensus.cc:2454] T 53110fb5ea6549b686d126189c1d9a51 P 9a6afa8a883f4bce8ad6b71d28aa4e5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f276c2a76fac4e989c026e89aeadd4c4 in term 0.
I20260807 22:40:43.555410 31093 leader_election.cc:302] T 53110fb5ea6549b686d126189c1d9a51 P f276c2a76fac4e989c026e89aeadd4c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a6afa8a883f4bce8ad6b71d28aa4e5e, f276c2a76fac4e989c026e89aeadd4c4; no voters:
I20260807 22:40:43.555563 31489 raft_consensus.cc:2781] T 53110fb5ea6549b686d126189c1d9a51 P f276c2a76fac4e989c026e89aeadd4c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:40:43.555624 31489 raft_consensus.cc:482] T 53110fb5ea6549b686d126189c1d9a51 P f276c2a76fac4e989c026e89aeadd4c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:40:43.555589 30994 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53110fb5ea6549b686d126189c1d9a51" candidate_uuid: "f276c2a76fac4e989c026e89aeadd4c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fa75e1676a3448a84ce6f76f34b78da" is_pre_election: true
I20260807 22:40:43.555644 31489 raft_consensus.cc:3037] T 53110fb5ea6549b686d126189c1d9a51 P f276c2a76fac4e989c026e89aeadd4c4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:43.555747 30994 raft_consensus.cc:2454] T 53110fb5ea6549b686d126189c1d9a51 P 6fa75e1676a3448a84ce6f76f34b78da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f276c2a76fac4e989c026e89aeadd4c4 in term 0.
I20260807 22:40:43.556667 31489 raft_consensus.cc:504] T 53110fb5ea6549b686d126189c1d9a51 P f276c2a76fac4e989c026e89aeadd4c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f276c2a76fac4e989c026e89aeadd4c4" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 45295 } } peers { permanent_uuid: "9a6afa8a883f4bce8ad6b71d28aa4e5e" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 43349 } } peers { permanent_uuid: "6fa75e1676a3448a84ce6f76f34b78da" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 43709 } }
I20260807 22:40:43.556802 31489 leader_election.cc:288] T 53110fb5ea6549b686d126189c1d9a51 P f276c2a76fac4e989c026e89aeadd4c4 [CANDIDATE]: Term 1 election: Requested vote from peers 9a6afa8a883f4bce8ad6b71d28aa4e5e (127.22.212.67:43349), 6fa75e1676a3448a84ce6f76f34b78da (127.22.212.65:43709)
I20260807 22:40:43.556968 31395 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53110fb5ea6549b686d126189c1d9a51" candidate_uuid: "f276c2a76fac4e989c026e89aeadd4c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a6afa8a883f4bce8ad6b71d28aa4e5e"
I20260807 22:40:43.556990 30994 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53110fb5ea6549b686d126189c1d9a51" candidate_uuid: "f276c2a76fac4e989c026e89aeadd4c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fa75e1676a3448a84ce6f76f34b78da"
I20260807 22:40:43.557070 31395 raft_consensus.cc:3037] T 53110fb5ea6549b686d126189c1d9a51 P 9a6afa8a883f4bce8ad6b71d28aa4e5e [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:43.557065 30994 raft_consensus.cc:3037] T 53110fb5ea6549b686d126189c1d9a51 P 6fa75e1676a3448a84ce6f76f34b78da [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:43.557830 31395 raft_consensus.cc:2454] T 53110fb5ea6549b686d126189c1d9a51 P 9a6afa8a883f4bce8ad6b71d28aa4e5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f276c2a76fac4e989c026e89aeadd4c4 in term 1.
I20260807 22:40:43.557943 30994 raft_consensus.cc:2454] T 53110fb5ea6549b686d126189c1d9a51 P 6fa75e1676a3448a84ce6f76f34b78da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f276c2a76fac4e989c026e89aeadd4c4 in term 1.
I20260807 22:40:43.558092 31093 leader_election.cc:302] T 53110fb5ea6549b686d126189c1d9a51 P f276c2a76fac4e989c026e89aeadd4c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a6afa8a883f4bce8ad6b71d28aa4e5e, f276c2a76fac4e989c026e89aeadd4c4; no voters:
I20260807 22:40:43.558183 31489 raft_consensus.cc:2781] T 53110fb5ea6549b686d126189c1d9a51 P f276c2a76fac4e989c026e89aeadd4c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:40:43.558333 31489 raft_consensus.cc:686] T 53110fb5ea6549b686d126189c1d9a51 P f276c2a76fac4e989c026e89aeadd4c4 [term 1 LEADER]: Becoming Leader. State: Replica: f276c2a76fac4e989c026e89aeadd4c4, State: Running, Role: LEADER
I20260807 22:40:43.558410 31489 consensus_queue.cc:237] T 53110fb5ea6549b686d126189c1d9a51 P f276c2a76fac4e989c026e89aeadd4c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f276c2a76fac4e989c026e89aeadd4c4" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 45295 } } peers { permanent_uuid: "9a6afa8a883f4bce8ad6b71d28aa4e5e" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 43349 } } peers { permanent_uuid: "6fa75e1676a3448a84ce6f76f34b78da" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 43709 } }
I20260807 22:40:43.559244 30789 catalog_manager.cc:5495] T 53110fb5ea6549b686d126189c1d9a51 P f276c2a76fac4e989c026e89aeadd4c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f276c2a76fac4e989c026e89aeadd4c4 (127.22.212.66). New cstate: current_term: 1 leader_uuid: "f276c2a76fac4e989c026e89aeadd4c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f276c2a76fac4e989c026e89aeadd4c4" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 45295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a6afa8a883f4bce8ad6b71d28aa4e5e" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 43349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fa75e1676a3448a84ce6f76f34b78da" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 43709 } health_report { overall_health: UNKNOWN } } }
W20260807 22:40:43.565809 31068 tablet.cc:2369] T 53110fb5ea6549b686d126189c1d9a51 P 6fa75e1676a3448a84ce6f76f34b78da: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:40:43.611364 31476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:43.610353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39178 (local address 127.22.212.66:45295)
0807 22:40:43.610419 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:43.610422 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:43.610443 (+ 21us) server_negotiation.cc:407] Connection header received
0807 22:40:43.610488 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:43.610489 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:43.610511 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:43.610573 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:43.611124 (+ 551us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:43.611125 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:43.611126 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:40:43.611131 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:43.611148 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:40:43.611152 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:43.611214 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:43.611270 (+ 56us) server_negotiation.cc:299] Negotiation successful
0807 22:40:43.611285 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260807 22:40:43.613386 31395 raft_consensus.cc:1261] T 53110fb5ea6549b686d126189c1d9a51 P 9a6afa8a883f4bce8ad6b71d28aa4e5e [term 1 FOLLOWER]: Refusing update from remote peer f276c2a76fac4e989c026e89aeadd4c4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:40:43.613405 30994 raft_consensus.cc:1261] T 53110fb5ea6549b686d126189c1d9a51 P 6fa75e1676a3448a84ce6f76f34b78da [term 1 FOLLOWER]: Refusing update from remote peer f276c2a76fac4e989c026e89aeadd4c4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:40:43.613807 31495 consensus_queue.cc:1035] T 53110fb5ea6549b686d126189c1d9a51 P f276c2a76fac4e989c026e89aeadd4c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fa75e1676a3448a84ce6f76f34b78da" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 43709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:40:43.613986 31489 consensus_queue.cc:1035] T 53110fb5ea6549b686d126189c1d9a51 P f276c2a76fac4e989c026e89aeadd4c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a6afa8a883f4bce8ad6b71d28aa4e5e" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 43349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:40:43.618889 30789 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52954:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:40:43.618994 30789 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52954:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:40:43.619769 30789 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4adab0f583424e91987cee49ec10c9f0: Sending DeleteTablet for 3 replicas of tablet 53110fb5ea6549b686d126189c1d9a51
I20260807 22:40:43.620112 31366 tablet_service.cc:1514] Processing DeleteTablet for tablet 53110fb5ea6549b686d126189c1d9a51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:43 UTC) from {username='slave'} at 127.0.0.1:58756
I20260807 22:40:43.620144 31170 tablet_service.cc:1514] Processing DeleteTablet for tablet 53110fb5ea6549b686d126189c1d9a51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:43 UTC) from {username='slave'} at 127.0.0.1:39168
I20260807 22:40:43.620174 30963 tablet_service.cc:1514] Processing DeleteTablet for tablet 53110fb5ea6549b686d126189c1d9a51 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:43 UTC) from {username='slave'} at 127.0.0.1:40268
I20260807 22:40:43.620347 31524 tablet_replica.cc:330] T 53110fb5ea6549b686d126189c1d9a51 P 9a6afa8a883f4bce8ad6b71d28aa4e5e: stopping tablet replica
I20260807 22:40:43.620443 31524 raft_consensus.cc:2229] T 53110fb5ea6549b686d126189c1d9a51 P 9a6afa8a883f4bce8ad6b71d28aa4e5e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:40:43.620550 31524 raft_consensus.cc:2258] T 53110fb5ea6549b686d126189c1d9a51 P 9a6afa8a883f4bce8ad6b71d28aa4e5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:43.620663 31525 tablet_replica.cc:330] T 53110fb5ea6549b686d126189c1d9a51 P 6fa75e1676a3448a84ce6f76f34b78da: stopping tablet replica
I20260807 22:40:43.620721 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 30871
I20260807 22:40:43.620807 31525 raft_consensus.cc:2229] T 53110fb5ea6549b686d126189c1d9a51 P 6fa75e1676a3448a84ce6f76f34b78da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:40:43.620931 31525 raft_consensus.cc:2258] T 53110fb5ea6549b686d126189c1d9a51 P 6fa75e1676a3448a84ce6f76f34b78da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:43.621112 31526 tablet_replica.cc:330] T 53110fb5ea6549b686d126189c1d9a51 P f276c2a76fac4e989c026e89aeadd4c4: stopping tablet replica
I20260807 22:40:43.621218 31526 raft_consensus.cc:2229] T 53110fb5ea6549b686d126189c1d9a51 P f276c2a76fac4e989c026e89aeadd4c4 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:40:43.621006 31524 ts_tablet_manager.cc:1905] T 53110fb5ea6549b686d126189c1d9a51 P 9a6afa8a883f4bce8ad6b71d28aa4e5e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:43.621347 31526 raft_consensus.cc:2258] T 53110fb5ea6549b686d126189c1d9a51 P f276c2a76fac4e989c026e89aeadd4c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:43.623974 31526 ts_tablet_manager.cc:1905] T 53110fb5ea6549b686d126189c1d9a51 P f276c2a76fac4e989c026e89aeadd4c4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:43.625272 31524 ts_tablet_manager.cc:1918] T 53110fb5ea6549b686d126189c1d9a51 P 9a6afa8a883f4bce8ad6b71d28aa4e5e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:40:43.625356 31524 log.cc:1196] T 53110fb5ea6549b686d126189c1d9a51 P 9a6afa8a883f4bce8ad6b71d28aa4e5e: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-2/wal/wals/53110fb5ea6549b686d126189c1d9a51
I20260807 22:40:43.625653 31524 ts_tablet_manager.cc:1939] T 53110fb5ea6549b686d126189c1d9a51 P 9a6afa8a883f4bce8ad6b71d28aa4e5e: Deleting consensus metadata
I20260807 22:40:43.626093 30767 catalog_manager.cc:4841] TS 9a6afa8a883f4bce8ad6b71d28aa4e5e (127.22.212.67:43349): tablet 53110fb5ea6549b686d126189c1d9a51 (table test-table [id=0bae4a1f64a24da0ad26a1fc23621cc5]) successfully deleted
I20260807 22:40:43.626437 31526 ts_tablet_manager.cc:1918] T 53110fb5ea6549b686d126189c1d9a51 P f276c2a76fac4e989c026e89aeadd4c4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:40:43.626554 31526 log.cc:1196] T 53110fb5ea6549b686d126189c1d9a51 P f276c2a76fac4e989c026e89aeadd4c4: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786142418640232-23377-0/minicluster-data/ts-1/wal/wals/53110fb5ea6549b686d126189c1d9a51
I20260807 22:40:43.626916 31526 ts_tablet_manager.cc:1939] T 53110fb5ea6549b686d126189c1d9a51 P f276c2a76fac4e989c026e89aeadd4c4: Deleting consensus metadata
I20260807 22:40:43.627492 30771 catalog_manager.cc:4841] TS f276c2a76fac4e989c026e89aeadd4c4 (127.22.212.66:45295): tablet 53110fb5ea6549b686d126189c1d9a51 (table test-table [id=0bae4a1f64a24da0ad26a1fc23621cc5]) successfully deleted
W20260807 22:40:43.636540 30767 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.212.65:43709 (error 108)
I20260807 22:40:43.636802 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 31070
I20260807 22:40:43.643807 31474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:43.636999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:43709 (local address 127.0.0.1:40272)
0807 22:40:43.643700 (+ 6701us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:43.643759 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.65:43709: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":6675}
W20260807 22:40:43.645699 30767 catalog_manager.cc:4584] TS 6fa75e1676a3448a84ce6f76f34b78da (127.22.212.65:43709): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 53110fb5ea6549b686d126189c1d9a51: Network error: Client connection negotiation failed: client connection to 127.22.212.65:43709: connect: Connection refused (error 111)
I20260807 22:40:43.650560 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 31277
I20260807 22:40:43.659513 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 30737
2026-08-07T22:40:43Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (900 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260807 22:40:43.685281 23377 mini_oidc.cc:152] Starting JWKS server
I20260807 22:40:43.686434 23377 webserver.cc:460] Webserver started at https://127.0.0.1:36379/ using document root <none> and password file <none>
I20260807 22:40:43.686566 23377 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 22:40:43.686759 23377 webserver.cc:460] Webserver started at http://127.0.0.1:37353/ using document root <none> and password file <none>
2026-08-07T22:40:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:40:43Z Disabled control of system clock
I20260807 22:40:43.696086 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:44865
--webserver_interface=127.22.212.126
--webserver_port=0
--builtin_ntp_servers=127.22.212.84:35535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:44865
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36379/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142418640232-23377-0/testchainca.cert with env {}
W20260807 22:40:43.781361 31539 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:43.781597 31539 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:43.781621 31539 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:43.782763 31539 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:40:43.782800 31539 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:43.782814 31539 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:43.782825 31539 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:40:43.782837 31539 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 22:40:43.782850 31539 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 22:40:43.782861 31539 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:36379/jwks.json
I20260807 22:40:43.784472 31539 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:35535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:44865
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:44865
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36379/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142418640232-23377-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31539
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:43.784680 31539 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:43.784857 31539 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:43.789835 31547 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:43.789848 31545 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:43.790158 31539 server_base.cc:1034] running on GCE node
W20260807 22:40:43.789844 31550 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:43.791303 31539 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:43.791603 31539 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:43.792747 31539 hybrid_clock.cc:648] HybridClock initialized: now 1786142443792722 us; error 35 us; skew 500 ppm
I20260807 22:40:43.793972 31539 webserver.cc:460] Webserver started at http://127.22.212.126:41895/ using document root <none> and password file <none>
I20260807 22:40:43.794247 31539 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:43.794296 31539 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:43.794468 31539 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:43.795506 31539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "be9a18d8e9dd4598ae0d1298ab994fa4"
format_stamp: "Formatted at 2026-08-07 22:40:43 on dist-test-slave-2d19"
server_key: "d38887d6c3041613117b565229a68ceb"
server_key_iv: "1b7eb187ad87afb85cd8849b7800ea03"
server_key_version: "encryptionkey@0"
I20260807 22:40:43.795868 31539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "be9a18d8e9dd4598ae0d1298ab994fa4"
format_stamp: "Formatted at 2026-08-07 22:40:43 on dist-test-slave-2d19"
server_key: "d38887d6c3041613117b565229a68ceb"
server_key_iv: "1b7eb187ad87afb85cd8849b7800ea03"
server_key_version: "encryptionkey@0"
I20260807 22:40:43.797236 31539 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 22:40:43.798012 31561 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:43.798205 31539 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 22:40:43.798316 31539 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "be9a18d8e9dd4598ae0d1298ab994fa4"
format_stamp: "Formatted at 2026-08-07 22:40:43 on dist-test-slave-2d19"
server_key: "d38887d6c3041613117b565229a68ceb"
server_key_iv: "1b7eb187ad87afb85cd8849b7800ea03"
server_key_version: "encryptionkey@0"
I20260807 22:40:43.798393 31539 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:43.820959 31539 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:43.821337 31539 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:43.821509 31539 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:43.825642 31539 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:44865
I20260807 22:40:43.825682 31633 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:44865 every 8 connection(s)
I20260807 22:40:43.826053 31539 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:40:43.827065 31634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:43.829416 31634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be9a18d8e9dd4598ae0d1298ab994fa4: Bootstrap starting.
I20260807 22:40:43.830116 31634 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P be9a18d8e9dd4598ae0d1298ab994fa4: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:43.830422 31634 log.cc:824] T 00000000000000000000000000000000 P be9a18d8e9dd4598ae0d1298ab994fa4: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:43.830793 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 31539
I20260807 22:40:43.830909 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:40:43.831105 23377 external_mini_cluster.cc:1428] Setting key f9a2adfce92e3c393b517c78038ca6c1
I20260807 22:40:43.831235 31634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be9a18d8e9dd4598ae0d1298ab994fa4: No bootstrap required, opened a new log
I20260807 22:40:43.833827 31634 raft_consensus.cc:348] T 00000000000000000000000000000000 P be9a18d8e9dd4598ae0d1298ab994fa4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be9a18d8e9dd4598ae0d1298ab994fa4" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 44865 } }
I20260807 22:40:43.834028 31634 raft_consensus.cc:374] T 00000000000000000000000000000000 P be9a18d8e9dd4598ae0d1298ab994fa4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:43.834123 31634 raft_consensus.cc:729] T 00000000000000000000000000000000 P be9a18d8e9dd4598ae0d1298ab994fa4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be9a18d8e9dd4598ae0d1298ab994fa4, State: Initialized, Role: FOLLOWER
I20260807 22:40:43.834266 31634 consensus_queue.cc:260] T 00000000000000000000000000000000 P be9a18d8e9dd4598ae0d1298ab994fa4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be9a18d8e9dd4598ae0d1298ab994fa4" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 44865 } }
I20260807 22:40:43.834348 31634 raft_consensus.cc:388] T 00000000000000000000000000000000 P be9a18d8e9dd4598ae0d1298ab994fa4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:40:43.834378 31634 raft_consensus.cc:482] T 00000000000000000000000000000000 P be9a18d8e9dd4598ae0d1298ab994fa4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:40:43.834416 31634 raft_consensus.cc:3037] T 00000000000000000000000000000000 P be9a18d8e9dd4598ae0d1298ab994fa4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:43.835135 31634 raft_consensus.cc:504] T 00000000000000000000000000000000 P be9a18d8e9dd4598ae0d1298ab994fa4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be9a18d8e9dd4598ae0d1298ab994fa4" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 44865 } }
I20260807 22:40:43.835229 31634 leader_election.cc:302] T 00000000000000000000000000000000 P be9a18d8e9dd4598ae0d1298ab994fa4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: be9a18d8e9dd4598ae0d1298ab994fa4; no voters:
I20260807 22:40:43.835460 31634 leader_election.cc:288] T 00000000000000000000000000000000 P be9a18d8e9dd4598ae0d1298ab994fa4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:40:43.835484 31643 raft_consensus.cc:2781] T 00000000000000000000000000000000 P be9a18d8e9dd4598ae0d1298ab994fa4 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:40:43.835601 31643 raft_consensus.cc:686] T 00000000000000000000000000000000 P be9a18d8e9dd4598ae0d1298ab994fa4 [term 1 LEADER]: Becoming Leader. State: Replica: be9a18d8e9dd4598ae0d1298ab994fa4, State: Running, Role: LEADER
I20260807 22:40:43.835680 31643 consensus_queue.cc:237] T 00000000000000000000000000000000 P be9a18d8e9dd4598ae0d1298ab994fa4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be9a18d8e9dd4598ae0d1298ab994fa4" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 44865 } }
I20260807 22:40:43.835760 31634 sys_catalog.cc:564] T 00000000000000000000000000000000 P be9a18d8e9dd4598ae0d1298ab994fa4 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:40:43.836009 31643 sys_catalog.cc:455] T 00000000000000000000000000000000 P be9a18d8e9dd4598ae0d1298ab994fa4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "be9a18d8e9dd4598ae0d1298ab994fa4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be9a18d8e9dd4598ae0d1298ab994fa4" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 44865 } } }
I20260807 22:40:43.836078 31643 sys_catalog.cc:458] T 00000000000000000000000000000000 P be9a18d8e9dd4598ae0d1298ab994fa4 [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:43.836207 31643 sys_catalog.cc:455] T 00000000000000000000000000000000 P be9a18d8e9dd4598ae0d1298ab994fa4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader be9a18d8e9dd4598ae0d1298ab994fa4. Latest consensus state: current_term: 1 leader_uuid: "be9a18d8e9dd4598ae0d1298ab994fa4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be9a18d8e9dd4598ae0d1298ab994fa4" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 44865 } } }
I20260807 22:40:43.836304 31643 sys_catalog.cc:458] T 00000000000000000000000000000000 P be9a18d8e9dd4598ae0d1298ab994fa4 [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:43.837252 31640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:43.831672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41226 (local address 127.22.212.126:44865)
0807 22:40:43.831898 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:43.831905 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:43.831929 (+ 24us) server_negotiation.cc:407] Connection header received
0807 22:40:43.832587 (+ 658us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:43.832594 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:43.832655 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:43.832770 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:43.832998 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:43.833841 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:43.834938 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:43.835470 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:43.835627 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:43.836387 (+ 760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:43.836392 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:43.836392 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:40:43.836617 (+ 225us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:43.836659 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:40:43.836674 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:43.836739 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:43.836952 (+ 213us) server_negotiation.cc:299] Negotiation successful
0807 22:40:43.837041 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":96,"threads_started":1}
W20260807 22:40:43.837605 31667 catalog_manager.cc:1558] T 00000000000000000000000000000000 P be9a18d8e9dd4598ae0d1298ab994fa4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:40:43.837682 31667 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:40:43.837747 31649 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:40:43.837917 31649 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:40:43.838227 23377 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:40:43.839582 31649 catalog_manager.cc:1347] Generated new cluster ID: b11e2cbb3d934dec8f4b4c0106995beb
I20260807 22:40:43.839648 31649 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:40:43.861153 31649 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:40:43.861730 31649 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:40:43.864259 31649 catalog_manager.cc:5868] T 00000000000000000000000000000000 P be9a18d8e9dd4598ae0d1298ab994fa4: Generated new TSK 0
I20260807 22:40:43.864477 31649 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260807 22:40:43.896371 31684 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260807 22:40:43.896489 31684 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
W20260807 22:40:43.897004 31682 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:40:43.872730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:44865 (local address 127.0.0.1:41234)
0807 22:40:43.872936 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:43.872949 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:43.873026 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:43.873234 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:43.873235 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:43.873237 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0807 22:40:43.873314 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:43.873316 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:43.873962 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:43.873963 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:43.874910 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:43.874913 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:43.875278 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:43.875279 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:43.875349 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:43.875372 (+ 23us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 22:40:43.896631 (+ 21259us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36379/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0807 22:40:43.896740 (+ 109us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.22.212.126:44865: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36379/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":98,"threads_started":1}
I20260807 22:40:43.897336 31640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:43.872796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41234 (local address 127.22.212.126:44865)
0807 22:40:43.872864 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:43.872867 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:43.873013 (+ 146us) server_negotiation.cc:407] Connection header received
0807 22:40:43.873123 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:43.873124 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:43.873136 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:43.873197 (+ 61us) server_negotiation.cc:226] Negotiated authn=JWT
0807 22:40:43.873382 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:43.873857 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:43.874997 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:43.875185 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:43.875233 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:43.875497 (+ 264us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 22:40:43.896428 (+ 20931us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36379/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0807 22:40:43.897269 (+ 841us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:41234: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36379/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":43}
W20260807 22:40:43.897411 31640 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:41234: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36379/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.22.212.126:44865: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36379/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260807 22:40:43.897634 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 31539
2026-08-07T22:40:43Z chronyd exiting
I20260807 22:40:43.941440 23377 test_util.cc:175] -----------------------------------------------
I20260807 22:40:43.941560 23377 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786142418640232-23377-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (257 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260807 22:40:43.942324 23377 mini_oidc.cc:152] Starting JWKS server
I20260807 22:40:43.943024 23377 webserver.cc:460] Webserver started at https://127.0.0.1:46377/ using document root <none> and password file <none>
I20260807 22:40:43.943096 23377 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 22:40:43.943290 23377 webserver.cc:460] Webserver started at http://127.0.0.1:43251/ using document root <none> and password file <none>
2026-08-07T22:40:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:40:43Z Disabled control of system clock
I20260807 22:40:43.952232 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:46709
--webserver_interface=127.22.212.126
--webserver_port=0
--builtin_ntp_servers=127.22.212.84:33869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:46709
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46377/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142418640232-23377-0/testchainca.cert with env {}
W20260807 22:40:44.040375 31693 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:44.040640 31693 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:44.040663 31693 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:44.041903 31693 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:40:44.041963 31693 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:44.041982 31693 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:44.042037 31693 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:40:44.042053 31693 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 22:40:44.042078 31693 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 22:40:44.042104 31693 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:46377/jwks.json
I20260807 22:40:44.043756 31693 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:33869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:46709
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:46709
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46377/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142418640232-23377-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31693
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:44.044018 31693 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:44.044202 31693 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 22:40:44.049441 31693 server_base.cc:1034] running on GCE node
W20260807 22:40:44.049374 31705 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:44.049383 31701 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:44.049374 31703 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:44.049958 31693 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:44.050297 31693 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:44.051460 31693 hybrid_clock.cc:648] HybridClock initialized: now 1786142444051455 us; error 37 us; skew 500 ppm
I20260807 22:40:44.052884 31693 webserver.cc:460] Webserver started at http://127.22.212.126:38421/ using document root <none> and password file <none>
I20260807 22:40:44.053154 31693 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:44.053227 31693 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:44.053377 31693 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:44.054481 31693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "e4153f63d0b14cbea23b242b2850107b"
format_stamp: "Formatted at 2026-08-07 22:40:44 on dist-test-slave-2d19"
server_key: "65533c6acad7d73774e00459ddbd3b8f"
server_key_iv: "7b77c507d504f47e0be593f68a749c80"
server_key_version: "encryptionkey@0"
I20260807 22:40:44.054868 31693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "e4153f63d0b14cbea23b242b2850107b"
format_stamp: "Formatted at 2026-08-07 22:40:44 on dist-test-slave-2d19"
server_key: "65533c6acad7d73774e00459ddbd3b8f"
server_key_iv: "7b77c507d504f47e0be593f68a749c80"
server_key_version: "encryptionkey@0"
I20260807 22:40:44.056185 31693 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 22:40:44.057123 31715 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:44.057317 31693 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 22:40:44.057420 31693 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "e4153f63d0b14cbea23b242b2850107b"
format_stamp: "Formatted at 2026-08-07 22:40:44 on dist-test-slave-2d19"
server_key: "65533c6acad7d73774e00459ddbd3b8f"
server_key_iv: "7b77c507d504f47e0be593f68a749c80"
server_key_version: "encryptionkey@0"
I20260807 22:40:44.057502 31693 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:44.076884 31693 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:44.077245 31693 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:44.077414 31693 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:44.081606 31693 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:46709
I20260807 22:40:44.081679 31794 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:46709 every 8 connection(s)
I20260807 22:40:44.082137 31693 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:40:44.082962 31800 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:44.086020 31800 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4153f63d0b14cbea23b242b2850107b: Bootstrap starting.
I20260807 22:40:44.086599 31800 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e4153f63d0b14cbea23b242b2850107b: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:44.086962 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 31693
I20260807 22:40:44.086959 31800 log.cc:824] T 00000000000000000000000000000000 P e4153f63d0b14cbea23b242b2850107b: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:44.087066 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:40:44.087270 23377 external_mini_cluster.cc:1428] Setting key 4f791640e0fdfd1d5eca2e73f79711a5
I20260807 22:40:44.088126 31800 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4153f63d0b14cbea23b242b2850107b: No bootstrap required, opened a new log
I20260807 22:40:44.090847 31800 raft_consensus.cc:348] T 00000000000000000000000000000000 P e4153f63d0b14cbea23b242b2850107b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4153f63d0b14cbea23b242b2850107b" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 46709 } }
I20260807 22:40:44.090991 31800 raft_consensus.cc:374] T 00000000000000000000000000000000 P e4153f63d0b14cbea23b242b2850107b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:44.091014 31800 raft_consensus.cc:729] T 00000000000000000000000000000000 P e4153f63d0b14cbea23b242b2850107b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4153f63d0b14cbea23b242b2850107b, State: Initialized, Role: FOLLOWER
I20260807 22:40:44.091166 31800 consensus_queue.cc:260] T 00000000000000000000000000000000 P e4153f63d0b14cbea23b242b2850107b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4153f63d0b14cbea23b242b2850107b" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 46709 } }
I20260807 22:40:44.091239 31800 raft_consensus.cc:388] T 00000000000000000000000000000000 P e4153f63d0b14cbea23b242b2850107b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:40:44.091285 31800 raft_consensus.cc:482] T 00000000000000000000000000000000 P e4153f63d0b14cbea23b242b2850107b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:40:44.091337 31800 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e4153f63d0b14cbea23b242b2850107b [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:44.092074 31800 raft_consensus.cc:504] T 00000000000000000000000000000000 P e4153f63d0b14cbea23b242b2850107b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4153f63d0b14cbea23b242b2850107b" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 46709 } }
I20260807 22:40:44.092190 31800 leader_election.cc:302] T 00000000000000000000000000000000 P e4153f63d0b14cbea23b242b2850107b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e4153f63d0b14cbea23b242b2850107b; no voters:
I20260807 22:40:44.092373 31800 leader_election.cc:288] T 00000000000000000000000000000000 P e4153f63d0b14cbea23b242b2850107b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:40:44.092468 31810 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e4153f63d0b14cbea23b242b2850107b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:40:44.092641 31800 sys_catalog.cc:564] T 00000000000000000000000000000000 P e4153f63d0b14cbea23b242b2850107b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:40:44.092655 31810 raft_consensus.cc:686] T 00000000000000000000000000000000 P e4153f63d0b14cbea23b242b2850107b [term 1 LEADER]: Becoming Leader. State: Replica: e4153f63d0b14cbea23b242b2850107b, State: Running, Role: LEADER
I20260807 22:40:44.092780 31810 consensus_queue.cc:237] T 00000000000000000000000000000000 P e4153f63d0b14cbea23b242b2850107b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4153f63d0b14cbea23b242b2850107b" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 46709 } }
I20260807 22:40:44.093675 31814 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4153f63d0b14cbea23b242b2850107b [sys.catalog]: SysCatalogTable state changed. Reason: New leader e4153f63d0b14cbea23b242b2850107b. Latest consensus state: current_term: 1 leader_uuid: "e4153f63d0b14cbea23b242b2850107b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4153f63d0b14cbea23b242b2850107b" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 46709 } } }
I20260807 22:40:44.093820 31814 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4153f63d0b14cbea23b242b2850107b [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:44.093956 31812 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4153f63d0b14cbea23b242b2850107b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e4153f63d0b14cbea23b242b2850107b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4153f63d0b14cbea23b242b2850107b" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 46709 } } }
I20260807 22:40:44.094085 31812 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4153f63d0b14cbea23b242b2850107b [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:44.094290 31806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:44.087829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48642 (local address 127.22.212.126:46709)
0807 22:40:44.088077 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:44.088086 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:44.088120 (+ 34us) server_negotiation.cc:407] Connection header received
0807 22:40:44.088696 (+ 576us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:44.088706 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:44.088787 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:44.088963 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:44.089107 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:44.090547 (+ 1440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:44.091584 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:44.092246 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:44.092404 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:44.093251 (+ 847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:44.093255 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:44.093255 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:40:44.093459 (+ 204us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:44.093492 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:40:44.093503 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:44.093594 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:44.093780 (+ 186us) server_negotiation.cc:299] Negotiation successful
0807 22:40:44.093867 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":97,"threads_started":1}
W20260807 22:40:44.094903 31832 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e4153f63d0b14cbea23b242b2850107b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:40:44.094977 31832 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:40:44.095037 31828 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:40:44.095213 31828 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:40:44.095551 23377 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:40:44.100696 31828 catalog_manager.cc:1347] Generated new cluster ID: f7afb38ee2854f128d575717f0373a05
I20260807 22:40:44.100766 31828 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:40:44.116602 31828 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:40:44.117337 31828 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:40:44.121488 31828 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e4153f63d0b14cbea23b242b2850107b: Generated new TSK 0
I20260807 22:40:44.121667 31828 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260807 22:40:44.148358 31848 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260807 22:40:44.148447 31848 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260807 22:40:44.148788 31806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:44.134331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48656 (local address 127.22.212.126:46709)
0807 22:40:44.134381 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:44.134383 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:44.134477 (+ 94us) server_negotiation.cc:407] Connection header received
0807 22:40:44.134536 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:44.134537 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:44.134551 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:44.134634 (+ 83us) server_negotiation.cc:226] Negotiated authn=JWT
0807 22:40:44.134749 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:44.135549 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:44.136312 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:44.136634 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:44.136694 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:44.136866 (+ 172us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 22:40:44.148555 (+ 11689us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46377/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0807 22:40:44.148709 (+ 154us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:48656: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46377/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":27}
W20260807 22:40:44.148854 31806 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:48656: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46377/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260807 22:40:44.148824 31847 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:40:44.134244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:46709 (local address 127.0.0.1:48656)
0807 22:40:44.134399 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:44.134409 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:44.134475 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:44.134639 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:44.134640 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:44.134642 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0807 22:40:44.134691 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:44.134693 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:44.135621 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:44.135621 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:44.136203 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:44.136205 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:44.136717 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:44.136718 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:44.136768 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:44.136773 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 22:40:44.148665 (+ 11892us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46377/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0807 22:40:44.148754 (+ 89us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.22.212.126:46709: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46377/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":104,"threads_started":1}
I20260807 22:40:44.149399 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 31693
2026-08-07T22:40:44Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (252 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260807 22:40:44.195341 23377 mini_oidc.cc:152] Starting JWKS server
I20260807 22:40:44.196043 23377 webserver.cc:460] Webserver started at https://127.0.0.1:40439/ using document root <none> and password file <none>
I20260807 22:40:44.196086 23377 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 22:40:44.196293 23377 webserver.cc:460] Webserver started at http://127.0.0.1:42801/ using document root <none> and password file <none>
2026-08-07T22:40:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:40:44Z Disabled control of system clock
I20260807 22:40:44.205257 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:38469
--webserver_interface=127.22.212.126
--webserver_port=0
--builtin_ntp_servers=127.22.212.84:39851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:38469
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40439/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260807 22:40:44.289613 31855 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:44.289830 31855 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:44.289855 31855 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:44.291026 31855 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:40:44.291074 31855 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:44.291086 31855 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:44.291100 31855 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:40:44.291111 31855 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 22:40:44.291123 31855 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 22:40:44.291141 31855 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:40439/jwks.json
I20260807 22:40:44.292618 31855 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:39851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:38469
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:38469
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40439/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31855
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:44.292824 31855 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:44.293077 31855 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:44.298144 31865 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:44.298269 31855 server_base.cc:1034] running on GCE node
W20260807 22:40:44.298125 31862 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:44.298110 31868 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:44.298645 31855 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:44.298893 31855 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:44.300030 31855 hybrid_clock.cc:648] HybridClock initialized: now 1786142444300011 us; error 35 us; skew 500 ppm
I20260807 22:40:44.301290 31855 webserver.cc:460] Webserver started at http://127.22.212.126:33133/ using document root <none> and password file <none>
I20260807 22:40:44.301589 31855 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:44.301637 31855 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:44.301810 31855 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:44.302886 31855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "8d10a265e5984148b06c31537d79f90c"
format_stamp: "Formatted at 2026-08-07 22:40:44 on dist-test-slave-2d19"
server_key: "c1c1b932835faa18d2178ddd0fc63d11"
server_key_iv: "3805a2fdb119c3294f0ecd202cf80db6"
server_key_version: "encryptionkey@0"
I20260807 22:40:44.303247 31855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "8d10a265e5984148b06c31537d79f90c"
format_stamp: "Formatted at 2026-08-07 22:40:44 on dist-test-slave-2d19"
server_key: "c1c1b932835faa18d2178ddd0fc63d11"
server_key_iv: "3805a2fdb119c3294f0ecd202cf80db6"
server_key_version: "encryptionkey@0"
I20260807 22:40:44.304682 31855 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 22:40:44.305480 31878 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:44.305727 31855 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 22:40:44.305856 31855 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "8d10a265e5984148b06c31537d79f90c"
format_stamp: "Formatted at 2026-08-07 22:40:44 on dist-test-slave-2d19"
server_key: "c1c1b932835faa18d2178ddd0fc63d11"
server_key_iv: "3805a2fdb119c3294f0ecd202cf80db6"
server_key_version: "encryptionkey@0"
I20260807 22:40:44.305982 31855 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:44.317636 31855 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:44.317888 31855 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:44.317988 31855 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:44.321952 31855 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:38469
I20260807 22:40:44.321985 31960 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:38469 every 8 connection(s)
I20260807 22:40:44.322328 31855 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:40:44.323077 31962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:44.325929 31962 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d10a265e5984148b06c31537d79f90c: Bootstrap starting.
I20260807 22:40:44.326529 31962 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8d10a265e5984148b06c31537d79f90c: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:44.326824 31962 log.cc:824] T 00000000000000000000000000000000 P 8d10a265e5984148b06c31537d79f90c: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:44.327514 31962 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d10a265e5984148b06c31537d79f90c: No bootstrap required, opened a new log
I20260807 22:40:44.329195 31962 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8d10a265e5984148b06c31537d79f90c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d10a265e5984148b06c31537d79f90c" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 38469 } }
I20260807 22:40:44.329356 31962 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8d10a265e5984148b06c31537d79f90c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:44.329443 31962 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8d10a265e5984148b06c31537d79f90c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d10a265e5984148b06c31537d79f90c, State: Initialized, Role: FOLLOWER
I20260807 22:40:44.329644 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 31855
I20260807 22:40:44.329634 31962 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8d10a265e5984148b06c31537d79f90c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d10a265e5984148b06c31537d79f90c" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 38469 } }
I20260807 22:40:44.329715 31962 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8d10a265e5984148b06c31537d79f90c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:40:44.329756 31962 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8d10a265e5984148b06c31537d79f90c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:40:44.329766 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:40:44.329806 31962 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8d10a265e5984148b06c31537d79f90c [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:44.329949 23377 external_mini_cluster.cc:1428] Setting key ebeb9318a9758032f83da7f725ec173b
I20260807 22:40:44.330454 31962 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8d10a265e5984148b06c31537d79f90c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d10a265e5984148b06c31537d79f90c" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 38469 } }
I20260807 22:40:44.330575 31962 leader_election.cc:302] T 00000000000000000000000000000000 P 8d10a265e5984148b06c31537d79f90c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8d10a265e5984148b06c31537d79f90c; no voters:
I20260807 22:40:44.330727 31962 leader_election.cc:288] T 00000000000000000000000000000000 P 8d10a265e5984148b06c31537d79f90c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:40:44.330749 31972 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8d10a265e5984148b06c31537d79f90c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:40:44.330863 31972 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8d10a265e5984148b06c31537d79f90c [term 1 LEADER]: Becoming Leader. State: Replica: 8d10a265e5984148b06c31537d79f90c, State: Running, Role: LEADER
I20260807 22:40:44.330948 31972 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8d10a265e5984148b06c31537d79f90c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d10a265e5984148b06c31537d79f90c" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 38469 } }
I20260807 22:40:44.331008 31962 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8d10a265e5984148b06c31537d79f90c [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:40:44.331312 31975 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d10a265e5984148b06c31537d79f90c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8d10a265e5984148b06c31537d79f90c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d10a265e5984148b06c31537d79f90c" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 38469 } } }
I20260807 22:40:44.331406 31975 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d10a265e5984148b06c31537d79f90c [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:44.331597 31973 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d10a265e5984148b06c31537d79f90c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8d10a265e5984148b06c31537d79f90c. Latest consensus state: current_term: 1 leader_uuid: "8d10a265e5984148b06c31537d79f90c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d10a265e5984148b06c31537d79f90c" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 38469 } } }
I20260807 22:40:44.331670 31973 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d10a265e5984148b06c31537d79f90c [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:44.331795 31980 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:40:44.332342 31980 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:40:44.333936 31980 catalog_manager.cc:1347] Generated new cluster ID: c1c2ddf5026a482bb990bf0e03cbabe7
I20260807 22:40:44.333997 31980 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:40:44.336103 31971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:44.330441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40130 (local address 127.22.212.126:38469)
0807 22:40:44.330721 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:44.330730 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:44.330762 (+ 32us) server_negotiation.cc:407] Connection header received
0807 22:40:44.330907 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:44.330916 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:44.331001 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:44.331380 (+ 379us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:44.331483 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:44.333315 (+ 1832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:44.334396 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:44.334784 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:44.334885 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:44.335527 (+ 642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:44.335530 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:44.335531 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:40:44.335701 (+ 170us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:44.335733 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:40:44.335743 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:44.335796 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:44.335877 (+ 81us) server_negotiation.cc:299] Negotiation successful
0807 22:40:44.335939 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":89,"threads_started":1}
I20260807 22:40:44.337091 23377 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:40:44.348170 31980 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:40:44.348928 31980 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:40:44.351956 31980 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8d10a265e5984148b06c31537d79f90c: Generated new TSK 0
I20260807 22:40:44.352135 31980 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:40:44.367152 31971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:44.363246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40144 (local address 127.22.212.126:38469)
0807 22:40:44.363296 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:44.363299 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:44.363410 (+ 111us) server_negotiation.cc:407] Connection header received
0807 22:40:44.363453 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:44.363454 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:44.363467 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:44.363553 (+ 86us) server_negotiation.cc:226] Negotiated authn=JWT
0807 22:40:44.363701 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:44.364506 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:44.365335 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:44.365663 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:44.365735 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:44.365922 (+ 187us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 22:40:44.366916 (+ 994us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40439/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0807 22:40:44.367071 (+ 155us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:40144: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40439/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":24}
W20260807 22:40:44.367218 31971 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:40144: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40439/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260807 22:40:44.369143 32006 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:40:44.363169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:38469 (local address 127.0.0.1:40144)
0807 22:40:44.363324 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:44.363334 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:44.363402 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:44.363562 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:44.363562 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:44.363564 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0807 22:40:44.363625 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:44.363627 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:44.364643 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:44.364644 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:44.365240 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:44.365242 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:44.365759 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:44.365760 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:44.365806 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:44.365810 (+ 4us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 22:40:44.367041 (+ 1231us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40439/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0807 22:40:44.369041 (+ 2000us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.22.212.126:38469: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40439/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":123,"mutex_wait_us":1780,"thread_start_us":98,"threads_started":1}
I20260807 22:40:44.369302 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 31855
E20260807 22:40:44.386427 32007 webserver.cc:533] Webserver: sslize failed:
E20260807 22:40:44.386507 32007 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-07T22:40:44Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (222 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-07T22:40:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:40:44Z Disabled control of system clock
I20260807 22:40:44.427093 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:37857
--webserver_interface=127.22.212.126
--webserver_port=0
--builtin_ntp_servers=127.22.212.84:40727
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:37857
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142418640232-23377-0/testchainca.cert with env {}
W20260807 22:40:44.510146 32014 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:44.510361 32014 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:44.510383 32014 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:44.511670 32014 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:40:44.511711 32014 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:44.511724 32014 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:44.511736 32014 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:40:44.511785 32014 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 22:40:44.511803 32014 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 22:40:44.511832 32014 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260807 22:40:44.513481 32014 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:40727
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:37857
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:37857
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142418640232-23377-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32014
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:44.513757 32014 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:44.513986 32014 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:44.519061 32021 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:44.519155 32022 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:44.519161 32014 server_base.cc:1034] running on GCE node
W20260807 22:40:44.519073 32026 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:44.519564 32014 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:44.519893 32014 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:44.521049 32014 hybrid_clock.cc:648] HybridClock initialized: now 1786142444521015 us; error 43 us; skew 500 ppm
I20260807 22:40:44.522405 32014 webserver.cc:460] Webserver started at http://127.22.212.126:37475/ using document root <none> and password file <none>
I20260807 22:40:44.522675 32014 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:44.522749 32014 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:44.522902 32014 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:44.523977 32014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "f2680fc1252447639a3a19a15bdfbd70"
format_stamp: "Formatted at 2026-08-07 22:40:44 on dist-test-slave-2d19"
server_key: "0520b126cbdafde773ebb9318957e0b5"
server_key_iv: "96266928b4297587451490e42f161629"
server_key_version: "encryptionkey@0"
I20260807 22:40:44.524413 32014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "f2680fc1252447639a3a19a15bdfbd70"
format_stamp: "Formatted at 2026-08-07 22:40:44 on dist-test-slave-2d19"
server_key: "0520b126cbdafde773ebb9318957e0b5"
server_key_iv: "96266928b4297587451490e42f161629"
server_key_version: "encryptionkey@0"
I20260807 22:40:44.525714 32014 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 22:40:44.526429 32036 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:44.526614 32014 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 22:40:44.526718 32014 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "f2680fc1252447639a3a19a15bdfbd70"
format_stamp: "Formatted at 2026-08-07 22:40:44 on dist-test-slave-2d19"
server_key: "0520b126cbdafde773ebb9318957e0b5"
server_key_iv: "96266928b4297587451490e42f161629"
server_key_version: "encryptionkey@0"
I20260807 22:40:44.526808 32014 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:44.554641 32014 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:44.555008 32014 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:44.555182 32014 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:44.559562 32014 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:37857
I20260807 22:40:44.559609 32115 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:37857 every 8 connection(s)
I20260807 22:40:44.559979 32014 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:40:44.561072 32116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:44.561978 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 32014
I20260807 22:40:44.562099 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:40:44.562299 23377 external_mini_cluster.cc:1428] Setting key 2f0a9b0ce1f0d7cd59c1931ba37dca9f
I20260807 22:40:44.563760 32116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f2680fc1252447639a3a19a15bdfbd70: Bootstrap starting.
I20260807 22:40:44.564476 32116 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f2680fc1252447639a3a19a15bdfbd70: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:44.564778 32116 log.cc:824] T 00000000000000000000000000000000 P f2680fc1252447639a3a19a15bdfbd70: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:44.565570 32116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f2680fc1252447639a3a19a15bdfbd70: No bootstrap required, opened a new log
I20260807 22:40:44.567371 32116 raft_consensus.cc:348] T 00000000000000000000000000000000 P f2680fc1252447639a3a19a15bdfbd70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2680fc1252447639a3a19a15bdfbd70" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 37857 } }
I20260807 22:40:44.567559 32116 raft_consensus.cc:374] T 00000000000000000000000000000000 P f2680fc1252447639a3a19a15bdfbd70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:44.567710 32116 raft_consensus.cc:729] T 00000000000000000000000000000000 P f2680fc1252447639a3a19a15bdfbd70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2680fc1252447639a3a19a15bdfbd70, State: Initialized, Role: FOLLOWER
I20260807 22:40:44.567850 32120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:44.562875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50138 (local address 127.22.212.126:37857)
0807 22:40:44.563100 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:44.563107 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:44.563133 (+ 26us) server_negotiation.cc:407] Connection header received
0807 22:40:44.563551 (+ 418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:44.563557 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:44.563618 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:44.563735 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:44.563983 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:44.564984 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:44.565792 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:44.566208 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:44.566364 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:44.567061 (+ 697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:44.567070 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:44.567070 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:40:44.567235 (+ 165us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:44.567270 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:40:44.567280 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:44.567353 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:44.567431 (+ 78us) server_negotiation.cc:299] Negotiation successful
0807 22:40:44.567522 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":103,"threads_started":1}
I20260807 22:40:44.567852 32116 consensus_queue.cc:260] T 00000000000000000000000000000000 P f2680fc1252447639a3a19a15bdfbd70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2680fc1252447639a3a19a15bdfbd70" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 37857 } }
I20260807 22:40:44.568012 32116 raft_consensus.cc:388] T 00000000000000000000000000000000 P f2680fc1252447639a3a19a15bdfbd70 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:40:44.568050 32116 raft_consensus.cc:482] T 00000000000000000000000000000000 P f2680fc1252447639a3a19a15bdfbd70 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:40:44.568100 32116 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f2680fc1252447639a3a19a15bdfbd70 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:44.568869 23377 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:40:44.568934 32116 raft_consensus.cc:504] T 00000000000000000000000000000000 P f2680fc1252447639a3a19a15bdfbd70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2680fc1252447639a3a19a15bdfbd70" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 37857 } }
I20260807 22:40:44.569067 32116 leader_election.cc:302] T 00000000000000000000000000000000 P f2680fc1252447639a3a19a15bdfbd70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f2680fc1252447639a3a19a15bdfbd70; no voters:
I20260807 22:40:44.569250 32116 leader_election.cc:288] T 00000000000000000000000000000000 P f2680fc1252447639a3a19a15bdfbd70 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:40:44.569279 32123 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f2680fc1252447639a3a19a15bdfbd70 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:40:44.569389 32123 raft_consensus.cc:686] T 00000000000000000000000000000000 P f2680fc1252447639a3a19a15bdfbd70 [term 1 LEADER]: Becoming Leader. State: Replica: f2680fc1252447639a3a19a15bdfbd70, State: Running, Role: LEADER
I20260807 22:40:44.569471 32123 consensus_queue.cc:237] T 00000000000000000000000000000000 P f2680fc1252447639a3a19a15bdfbd70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2680fc1252447639a3a19a15bdfbd70" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 37857 } }
I20260807 22:40:44.569518 32116 sys_catalog.cc:564] T 00000000000000000000000000000000 P f2680fc1252447639a3a19a15bdfbd70 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:40:44.569892 32123 sys_catalog.cc:455] T 00000000000000000000000000000000 P f2680fc1252447639a3a19a15bdfbd70 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f2680fc1252447639a3a19a15bdfbd70. Latest consensus state: current_term: 1 leader_uuid: "f2680fc1252447639a3a19a15bdfbd70" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2680fc1252447639a3a19a15bdfbd70" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 37857 } } }
I20260807 22:40:44.569983 32123 sys_catalog.cc:458] T 00000000000000000000000000000000 P f2680fc1252447639a3a19a15bdfbd70 [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:44.569957 32126 sys_catalog.cc:455] T 00000000000000000000000000000000 P f2680fc1252447639a3a19a15bdfbd70 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f2680fc1252447639a3a19a15bdfbd70" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2680fc1252447639a3a19a15bdfbd70" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 37857 } } }
I20260807 22:40:44.570235 32126 sys_catalog.cc:458] T 00000000000000000000000000000000 P f2680fc1252447639a3a19a15bdfbd70 [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:44.570364 32138 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:40:44.570899 32138 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:40:44.572577 32138 catalog_manager.cc:1347] Generated new cluster ID: b5f64933e55343ee813e81968f0f85ec
I20260807 22:40:44.572634 32138 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:40:44.589254 32138 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:40:44.589802 32138 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:40:44.596125 32138 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f2680fc1252447639a3a19a15bdfbd70: Generated new TSK 0
I20260807 22:40:44.596359 32138 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:40:44.652498 32120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:44.611390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50142 (local address 127.22.212.126:37857)
0807 22:40:44.611461 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:44.611464 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:44.611584 (+ 120us) server_negotiation.cc:407] Connection header received
0807 22:40:44.611657 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:44.611657 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:44.611669 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:44.611731 (+ 62us) server_negotiation.cc:226] Negotiated authn=JWT
0807 22:40:44.611922 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:44.612495 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:44.613667 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:44.613842 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:44.613888 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:44.614091 (+ 203us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 22:40:44.652215 (+ 38124us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0807 22:40:44.652435 (+ 220us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:50142: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":41}
W20260807 22:40:44.652591 32120 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:50142: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260807 22:40:44.652792 32165 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:40:44.611334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:37857 (local address 127.0.0.1:50142)
0807 22:40:44.611497 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:44.611510 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:44.611584 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:44.611753 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:44.611755 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:44.611757 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0807 22:40:44.611836 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:44.611839 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:44.612598 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:44.612599 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:44.613574 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:44.613578 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:44.613922 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:44.613923 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:44.613984 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:44.613991 (+ 7us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 22:40:44.652415 (+ 38424us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0807 22:40:44.652569 (+ 154us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.22.212.126:37857: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":104,"threads_started":1}
I20260807 22:40:44.653246 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 32014
2026-08-07T22:40:44Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (263 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (91 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (91 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:40:44 dist-test-slave-2d19 krb5kdc[32182](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:40:44 dist-test-slave-2d19 krb5kdc[32182](info): set up 2 sockets
Aug 07 22:40:44 dist-test-slave-2d19 krb5kdc[32182](info): commencing operation
krb5kdc: starting...
W20260807 22:40:46.116812 23377 mini_kdc.cc:121] Time spent starting KDC: real 1.251s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Aug 07 22:40:46 dist-test-slave-2d19 krb5kdc[32182](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142446, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:40:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:40:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.212.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
I20260807 22:40:46.247509 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:45863
--webserver_interface=127.22.212.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:38223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:45863
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:46.333753 32200 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:46.333963 32200 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:46.333986 32200 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:46.335067 32200 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:40:46.335101 32200 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:46.335116 32200 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:46.335129 32200 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:40:46.335141 32200 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:40:46.336537 32200 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:38223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:45863
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:45863
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32200
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:46.336742 32200 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:46.336910 32200 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:46.342047 32207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:46.342161 32200 server_base.cc:1034] running on GCE node
W20260807 22:40:46.342113 32213 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:46.342077 32206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:46.342547 32200 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:46.342861 32200 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:46.344005 32200 hybrid_clock.cc:648] HybridClock initialized: now 1786142446343996 us; error 35 us; skew 500 ppm
Aug 07 22:40:46 dist-test-slave-2d19 krb5kdc[32182](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142446, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:46.346808 32200 init.cc:377] Logged in from keytab as kudu/127.22.212.126@KRBTEST.COM (short username kudu)
I20260807 22:40:46.347291 32200 webserver.cc:460] Webserver started at http://127.22.212.126:36751/ using document root <none> and password file <none>
I20260807 22:40:46.347530 32200 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:46.347577 32200 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:46.347733 32200 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:46.348903 32200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "412979963b984ede9fe3592b59cba8a5"
format_stamp: "Formatted at 2026-08-07 22:40:46 on dist-test-slave-2d19"
server_key: "f38563364508048463fb1607915f6511"
server_key_iv: "293b47f5cb064a73cc5eebe2e984fecb"
server_key_version: "encryptionkey@0"
I20260807 22:40:46.349287 32200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "412979963b984ede9fe3592b59cba8a5"
format_stamp: "Formatted at 2026-08-07 22:40:46 on dist-test-slave-2d19"
server_key: "f38563364508048463fb1607915f6511"
server_key_iv: "293b47f5cb064a73cc5eebe2e984fecb"
server_key_version: "encryptionkey@0"
I20260807 22:40:46.350692 32200 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 22:40:46.351447 32224 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:46.351637 32200 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 22:40:46.351729 32200 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "412979963b984ede9fe3592b59cba8a5"
format_stamp: "Formatted at 2026-08-07 22:40:46 on dist-test-slave-2d19"
server_key: "f38563364508048463fb1607915f6511"
server_key_iv: "293b47f5cb064a73cc5eebe2e984fecb"
server_key_version: "encryptionkey@0"
I20260807 22:40:46.351786 32200 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:46.369146 32200 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:46.371136 32200 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:46.371256 32200 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:46.375380 32200 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:45863
I20260807 22:40:46.375463 32302 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:45863 every 8 connection(s)
I20260807 22:40:46.375826 32200 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:40:46.376837 32303 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:46.379201 32303 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 412979963b984ede9fe3592b59cba8a5: Bootstrap starting.
I20260807 22:40:46.379812 32303 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 412979963b984ede9fe3592b59cba8a5: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:46.380118 32303 log.cc:824] T 00000000000000000000000000000000 P 412979963b984ede9fe3592b59cba8a5: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:46.380860 32303 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 412979963b984ede9fe3592b59cba8a5: No bootstrap required, opened a new log
I20260807 22:40:46.382483 32303 raft_consensus.cc:348] T 00000000000000000000000000000000 P 412979963b984ede9fe3592b59cba8a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "412979963b984ede9fe3592b59cba8a5" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 45863 } }
I20260807 22:40:46.382654 32303 raft_consensus.cc:374] T 00000000000000000000000000000000 P 412979963b984ede9fe3592b59cba8a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:46.382709 32303 raft_consensus.cc:729] T 00000000000000000000000000000000 P 412979963b984ede9fe3592b59cba8a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 412979963b984ede9fe3592b59cba8a5, State: Initialized, Role: FOLLOWER
I20260807 22:40:46.382884 32303 consensus_queue.cc:260] T 00000000000000000000000000000000 P 412979963b984ede9fe3592b59cba8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "412979963b984ede9fe3592b59cba8a5" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 45863 } }
I20260807 22:40:46.382988 32303 raft_consensus.cc:388] T 00000000000000000000000000000000 P 412979963b984ede9fe3592b59cba8a5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:40:46.383042 32303 raft_consensus.cc:482] T 00000000000000000000000000000000 P 412979963b984ede9fe3592b59cba8a5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:40:46.383100 32303 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 412979963b984ede9fe3592b59cba8a5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:46.383338 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 32200
I20260807 22:40:46.383426 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:40:46.383639 23377 external_mini_cluster.cc:1428] Setting key d9af491c6f222eae49d13c2dbb754f3b
I20260807 22:40:46.383752 32303 raft_consensus.cc:504] T 00000000000000000000000000000000 P 412979963b984ede9fe3592b59cba8a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "412979963b984ede9fe3592b59cba8a5" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 45863 } }
I20260807 22:40:46.383880 32303 leader_election.cc:302] T 00000000000000000000000000000000 P 412979963b984ede9fe3592b59cba8a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 412979963b984ede9fe3592b59cba8a5; no voters:
I20260807 22:40:46.384136 32306 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 412979963b984ede9fe3592b59cba8a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:40:46.384832 32306 raft_consensus.cc:686] T 00000000000000000000000000000000 P 412979963b984ede9fe3592b59cba8a5 [term 1 LEADER]: Becoming Leader. State: Replica: 412979963b984ede9fe3592b59cba8a5, State: Running, Role: LEADER
I20260807 22:40:46.384933 32306 consensus_queue.cc:237] T 00000000000000000000000000000000 P 412979963b984ede9fe3592b59cba8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "412979963b984ede9fe3592b59cba8a5" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 45863 } }
I20260807 22:40:46.384086 32303 leader_election.cc:288] T 00000000000000000000000000000000 P 412979963b984ede9fe3592b59cba8a5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:40:46.385273 32316 sys_catalog.cc:455] T 00000000000000000000000000000000 P 412979963b984ede9fe3592b59cba8a5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 412979963b984ede9fe3592b59cba8a5. Latest consensus state: current_term: 1 leader_uuid: "412979963b984ede9fe3592b59cba8a5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "412979963b984ede9fe3592b59cba8a5" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 45863 } } }
I20260807 22:40:46.385362 32306 sys_catalog.cc:455] T 00000000000000000000000000000000 P 412979963b984ede9fe3592b59cba8a5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "412979963b984ede9fe3592b59cba8a5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "412979963b984ede9fe3592b59cba8a5" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 45863 } } }
I20260807 22:40:46.385398 32316 sys_catalog.cc:458] T 00000000000000000000000000000000 P 412979963b984ede9fe3592b59cba8a5 [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:46.385484 32306 sys_catalog.cc:458] T 00000000000000000000000000000000 P 412979963b984ede9fe3592b59cba8a5 [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:46.385500 32303 sys_catalog.cc:564] T 00000000000000000000000000000000 P 412979963b984ede9fe3592b59cba8a5 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:40:46.386407 32318 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:40:46.386933 32318 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:40:46.388677 32318 catalog_manager.cc:1347] Generated new cluster ID: 07c93667fab745bda1c6160e1be4fc66
I20260807 22:40:46.388732 32318 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 22:40:46 dist-test-slave-2d19 krb5kdc[32182](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142446, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:40:46.394797 32310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:46.384533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43010 (local address 127.22.212.126:45863)
0807 22:40:46.384771 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:46.384783 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:46.384825 (+ 42us) server_negotiation.cc:407] Connection header received
0807 22:40:46.384953 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:46.384960 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:46.385030 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:46.385182 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:46.386049 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:46.387563 (+ 1514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:46.388349 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:46.388891 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:46.389017 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:46.391490 (+ 2473us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:46.391495 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:46.391495 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:46.391509 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:46.393274 (+ 1765us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:46.393664 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:46.393667 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:46.393668 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:46.393759 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:46.393973 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:46.393974 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:46.393974 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:46.394220 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:46.394370 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:46.394482 (+ 112us) server_negotiation.cc:299] Negotiation successful
0807 22:40:46.394637 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":99,"threads_started":1}
I20260807 22:40:46.407732 32318 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:40:46.408313 32318 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:40:46.423290 32318 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 412979963b984ede9fe3592b59cba8a5: Generated new TSK 0
I20260807 22:40:46.423523 32318 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.212.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab.
Entry for principal kudu/127.22.212.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab.
I20260807 22:40:46.451818 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.65:0
--local_ip_for_outbound_sockets=127.22.212.65
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:45863
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:38223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:46.535599 32339 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:46.535806 32339 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:46.535830 32339 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:46.537081 32339 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:46.537124 32339 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:46.537150 32339 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.65
I20260807 22:40:46.538781 32339 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:38223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:45863
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32339
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.65
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:46.539026 32339 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:46.539258 32339 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:46.544806 32350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:46.544795 32352 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:46.544796 32354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:46.544965 32339 server_base.cc:1034] running on GCE node
I20260807 22:40:46.545315 32339 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:46.545572 32339 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:46.546766 32339 hybrid_clock.cc:648] HybridClock initialized: now 1786142446546745 us; error 43 us; skew 500 ppm
Aug 07 22:40:46 dist-test-slave-2d19 krb5kdc[32182](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142446, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:46.549453 32339 init.cc:377] Logged in from keytab as kudu/127.22.212.65@KRBTEST.COM (short username kudu)
I20260807 22:40:46.549927 32339 webserver.cc:460] Webserver started at http://127.22.212.65:41823/ using document root <none> and password file <none>
I20260807 22:40:46.550190 32339 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:46.550271 32339 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:46.550427 32339 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:46.551684 32339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-0/data/instance:
uuid: "d6f4713a7eda45c0ac9c71615c6eb7c0"
format_stamp: "Formatted at 2026-08-07 22:40:46 on dist-test-slave-2d19"
server_key: "1bb944b980f7ed6319f99f81393ffdc8"
server_key_iv: "8a96010f31293c78e0fb80c23efd5913"
server_key_version: "encryptionkey@0"
I20260807 22:40:46.552161 32339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance:
uuid: "d6f4713a7eda45c0ac9c71615c6eb7c0"
format_stamp: "Formatted at 2026-08-07 22:40:46 on dist-test-slave-2d19"
server_key: "1bb944b980f7ed6319f99f81393ffdc8"
server_key_iv: "8a96010f31293c78e0fb80c23efd5913"
server_key_version: "encryptionkey@0"
I20260807 22:40:46.553634 32339 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 22:40:46.554515 32363 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:46.554699 32339 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 22:40:46.554806 32339 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-0/wal
uuid: "d6f4713a7eda45c0ac9c71615c6eb7c0"
format_stamp: "Formatted at 2026-08-07 22:40:46 on dist-test-slave-2d19"
server_key: "1bb944b980f7ed6319f99f81393ffdc8"
server_key_iv: "8a96010f31293c78e0fb80c23efd5913"
server_key_version: "encryptionkey@0"
I20260807 22:40:46.554893 32339 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:46.572156 32339 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:46.574663 32339 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:46.574836 32339 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:46.575099 32339 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:46.575438 32339 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:46.575500 32339 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:46.575548 32339 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:46.575580 32339 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:46.581683 32339 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.65:35689
I20260807 22:40:46.581725 32557 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.65:35689 every 8 connection(s)
I20260807 22:40:46.582127 32339 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
I20260807 22:40:46.587761 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 32339
I20260807 22:40:46.587880 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance
I20260807 22:40:46.588073 23377 external_mini_cluster.cc:1428] Setting key 31936e93aaddc74933d3b5ab1315d7e2
Aug 07 22:40:46 dist-test-slave-2d19 krb5kdc[32182](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142446, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:40:46.592754 32310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:46.582945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:34853 (local address 127.22.212.126:45863)
0807 22:40:46.583020 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:46.583022 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:46.583256 (+ 234us) server_negotiation.cc:407] Connection header received
0807 22:40:46.584174 (+ 918us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:46.584175 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:46.584188 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:46.584287 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:46.584896 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:46.585561 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:46.586621 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:46.586876 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:46.586930 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:46.589534 (+ 2604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:46.589535 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:46.589536 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:46.589546 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:46.591215 (+ 1669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:46.591624 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:46.591625 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:46.591625 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:46.591703 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:46.591953 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:46.591954 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:46.591955 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:46.592127 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:46.592202 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:46.592516 (+ 314us) server_negotiation.cc:299] Negotiation successful
0807 22:40:46.592617 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 22:40:46.592767 32562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:46.582915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45863 (local address 127.22.212.65:34853)
0807 22:40:46.583121 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:46.583165 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:46.584083 (+ 918us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:46.584370 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:46.584373 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:46.584624 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:46.584815 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:46.584819 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:46.585645 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:46.585646 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:46.586500 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:46.586502 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:46.586940 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:46.586940 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:46.587061 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:46.587625 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:46.587636 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:46.589416 (+ 1780us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:46.591307 (+ 1891us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:46.591314 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:46.591316 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:46.591544 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:46.591772 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:46.591773 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:46.591773 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:46.591885 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:46.592198 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:46.592203 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:46.592380 (+ 177us) client_negotiation.cc:769] Sending connection context
0807 22:40:46.592469 (+ 89us) client_negotiation.cc:240] Negotiation successful
0807 22:40:46.592601 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":93,"threads_started":1}
I20260807 22:40:46.593366 32558 heartbeater.cc:347] Connected to a master server at 127.22.212.126:45863
I20260807 22:40:46.593461 32558 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:46.593662 32558 heartbeater.cc:511] Master 127.22.212.126:45863 requested a full tablet report, sending...
I20260807 22:40:46.594188 32249 ts_manager.cc:194] Registered new tserver with Master: d6f4713a7eda45c0ac9c71615c6eb7c0 (127.22.212.65:35689)
I20260807 22:40:46.594748 32249 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.65@KRBTEST.COM'} at 127.22.212.65:34853
WARNING: no policy specified for kudu/127.22.212.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab.
Entry for principal kudu/127.22.212.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab.
I20260807 22:40:46.614979 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.66:0
--local_ip_for_outbound_sockets=127.22.212.66
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:45863
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:38223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:46.699185 32566 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:46.699422 32566 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:46.699460 32566 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:46.700629 32566 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:46.700697 32566 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:46.700742 32566 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.66
I20260807 22:40:46.702227 32566 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:38223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:45863
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32566
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.66
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:46.702493 32566 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:46.702747 32566 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:46.707839 32576 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:46.707845 32574 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:46.707854 32582 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:46.707993 32566 server_base.cc:1034] running on GCE node
I20260807 22:40:46.708242 32566 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:46.708568 32566 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:46.709761 32566 hybrid_clock.cc:648] HybridClock initialized: now 1786142446709743 us; error 26 us; skew 500 ppm
Aug 07 22:40:46 dist-test-slave-2d19 krb5kdc[32182](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142446, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:46.712242 32566 init.cc:377] Logged in from keytab as kudu/127.22.212.66@KRBTEST.COM (short username kudu)
I20260807 22:40:46.712786 32566 webserver.cc:460] Webserver started at http://127.22.212.66:33731/ using document root <none> and password file <none>
I20260807 22:40:46.713027 32566 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:46.713095 32566 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:46.713238 32566 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:46.714295 32566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-1/data/instance:
uuid: "41453c80cc634c27b7566829ed46420f"
format_stamp: "Formatted at 2026-08-07 22:40:46 on dist-test-slave-2d19"
server_key: "b015d7ba0486b3fc05a742830f873b4e"
server_key_iv: "81082e20924d180387cda8a833b72bf2"
server_key_version: "encryptionkey@0"
I20260807 22:40:46.714674 32566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance:
uuid: "41453c80cc634c27b7566829ed46420f"
format_stamp: "Formatted at 2026-08-07 22:40:46 on dist-test-slave-2d19"
server_key: "b015d7ba0486b3fc05a742830f873b4e"
server_key_iv: "81082e20924d180387cda8a833b72bf2"
server_key_version: "encryptionkey@0"
I20260807 22:40:46.715997 32566 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 22:40:46.716832 32593 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:46.717029 32566 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:46.717133 32566 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-1/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-1/wal
uuid: "41453c80cc634c27b7566829ed46420f"
format_stamp: "Formatted at 2026-08-07 22:40:46 on dist-test-slave-2d19"
server_key: "b015d7ba0486b3fc05a742830f873b4e"
server_key_iv: "81082e20924d180387cda8a833b72bf2"
server_key_version: "encryptionkey@0"
I20260807 22:40:46.717221 32566 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:46.733377 32566 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:46.735351 32566 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:46.735502 32566 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:46.735765 32566 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:46.736088 32566 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:46.736124 32566 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:46.736166 32566 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:46.736193 32566 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:46.742347 32566 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.66:42893
I20260807 22:40:46.742390 314 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.66:42893 every 8 connection(s)
I20260807 22:40:46.742707 32566 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
Aug 07 22:40:46 dist-test-slave-2d19 krb5kdc[32182](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142446, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:40:46.751585 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 32566
I20260807 22:40:46.751705 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance
I20260807 22:40:46.751928 23377 external_mini_cluster.cc:1428] Setting key 9a3ffd902eac99d62f8d68a925ad1164
I20260807 22:40:46.752231 32310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:46.743390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:56035 (local address 127.22.212.126:45863)
0807 22:40:46.743463 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:46.743466 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:46.743737 (+ 271us) server_negotiation.cc:407] Connection header received
0807 22:40:46.744740 (+ 1003us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:46.744741 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:46.744752 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:46.744808 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:46.745394 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:46.745880 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:46.746837 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:46.747015 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:46.747071 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:46.749359 (+ 2288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:46.749361 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:46.749361 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:46.749368 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:46.750695 (+ 1327us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:46.751177 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:46.751178 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:46.751178 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:46.751230 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:46.751530 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:46.751531 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:46.751531 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:46.751632 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:46.751712 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:46.752042 (+ 330us) server_negotiation.cc:299] Negotiation successful
0807 22:40:46.752136 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260807 22:40:46.752456 321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:46.743377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45863 (local address 127.22.212.66:56035)
0807 22:40:46.743576 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:46.743636 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:46.744648 (+ 1012us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:46.744873 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:46.744876 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:46.745131 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:46.745322 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:46.745326 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:46.745964 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:46.745965 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:46.746762 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:46.746764 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:46.747126 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:46.747127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:46.747240 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:46.747832 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:46.747849 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:46.749268 (+ 1419us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:46.750804 (+ 1536us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:46.750810 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:46.750813 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:46.751105 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:46.751292 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:46.751293 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:46.751293 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:46.751456 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:46.751707 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:46.751714 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:46.751895 (+ 181us) client_negotiation.cc:769] Sending connection context
0807 22:40:46.752006 (+ 111us) client_negotiation.cc:240] Negotiation successful
0807 22:40:46.752198 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":118,"threads_started":1}
I20260807 22:40:46.752990 315 heartbeater.cc:347] Connected to a master server at 127.22.212.126:45863
I20260807 22:40:46.753114 315 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:46.753299 315 heartbeater.cc:511] Master 127.22.212.126:45863 requested a full tablet report, sending...
I20260807 22:40:46.753710 32249 ts_manager.cc:194] Registered new tserver with Master: 41453c80cc634c27b7566829ed46420f (127.22.212.66:42893)
I20260807 22:40:46.754139 32249 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.66@KRBTEST.COM'} at 127.22.212.66:56035
WARNING: no policy specified for kudu/127.22.212.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab.
Entry for principal kudu/127.22.212.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab.
I20260807 22:40:46.779917 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.67:0
--local_ip_for_outbound_sockets=127.22.212.67
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:45863
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:38223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:46.863873 324 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:46.864087 324 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:46.864110 324 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:46.865276 324 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:46.865317 324 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:46.865342 324 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.67
I20260807 22:40:46.866745 324 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:38223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:45863
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.324
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.67
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:46.866932 324 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:46.867107 324 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:46.872362 334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:46.872362 336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:46.872465 324 server_base.cc:1034] running on GCE node
W20260807 22:40:46.872608 333 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:46.872816 324 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:46.873028 324 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:46.874171 324 hybrid_clock.cc:648] HybridClock initialized: now 1786142446874157 us; error 29 us; skew 500 ppm
Aug 07 22:40:46 dist-test-slave-2d19 krb5kdc[32182](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142446, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:46.876726 324 init.cc:377] Logged in from keytab as kudu/127.22.212.67@KRBTEST.COM (short username kudu)
I20260807 22:40:46.877128 324 webserver.cc:460] Webserver started at http://127.22.212.67:37257/ using document root <none> and password file <none>
I20260807 22:40:46.877316 324 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:46.877357 324 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:46.877452 324 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:46.878464 324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-2/data/instance:
uuid: "7db92aedc96840d195680c0c53ae89b7"
format_stamp: "Formatted at 2026-08-07 22:40:46 on dist-test-slave-2d19"
server_key: "e0dfac064db01c29f765ea6de592bd52"
server_key_iv: "6d42ce4bf24c18dacf00c54b3df3cbab"
server_key_version: "encryptionkey@0"
I20260807 22:40:46.878782 324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance:
uuid: "7db92aedc96840d195680c0c53ae89b7"
format_stamp: "Formatted at 2026-08-07 22:40:46 on dist-test-slave-2d19"
server_key: "e0dfac064db01c29f765ea6de592bd52"
server_key_iv: "6d42ce4bf24c18dacf00c54b3df3cbab"
server_key_version: "encryptionkey@0"
I20260807 22:40:46.880084 324 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260807 22:40:46.880908 347 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:46.881111 324 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:40:46.881206 324 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-2/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-2/wal
uuid: "7db92aedc96840d195680c0c53ae89b7"
format_stamp: "Formatted at 2026-08-07 22:40:46 on dist-test-slave-2d19"
server_key: "e0dfac064db01c29f765ea6de592bd52"
server_key_iv: "6d42ce4bf24c18dacf00c54b3df3cbab"
server_key_version: "encryptionkey@0"
I20260807 22:40:46.881264 324 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:46.888379 324 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:46.890674 324 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:46.890836 324 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:46.891067 324 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:46.891381 324 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:46.891413 324 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:46.891435 324 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:46.891481 324 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:46.897550 324 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.67:41703
I20260807 22:40:46.897639 517 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.67:41703 every 8 connection(s)
I20260807 22:40:46.897945 324 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
Aug 07 22:40:46 dist-test-slave-2d19 krb5kdc[32182](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142446, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:40:46.905642 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 324
I20260807 22:40:46.905762 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance
I20260807 22:40:46.905974 23377 external_mini_cluster.cc:1428] Setting key caf5862c679a3603dd4fc047cfb89778
I20260807 22:40:46.907614 32310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:46.898707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:49865 (local address 127.22.212.126:45863)
0807 22:40:46.898771 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:46.898774 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:46.898961 (+ 187us) server_negotiation.cc:407] Connection header received
0807 22:40:46.899959 (+ 998us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:46.899961 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:46.899975 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:46.900035 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:46.900757 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:46.901255 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:46.902279 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:46.902476 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:46.902570 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:46.904782 (+ 2212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:46.904783 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:46.904784 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:46.904792 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:46.906200 (+ 1408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:46.906612 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:46.906613 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:46.906614 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:46.906682 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:46.906934 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:46.906935 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:46.906936 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:46.907063 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:46.907138 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:46.907428 (+ 290us) server_negotiation.cc:299] Negotiation successful
0807 22:40:46.907526 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260807 22:40:46.907797 520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:46.898667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45863 (local address 127.22.212.67:49865)
0807 22:40:46.898824 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:46.898873 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:46.899841 (+ 968us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:46.900107 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:46.900111 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:46.900458 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:46.900657 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:46.900661 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:46.901354 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:46.901356 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:46.902184 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:46.902186 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:46.902582 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:46.902583 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:46.902721 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:46.903259 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:46.903268 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:46.904683 (+ 1415us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:46.906293 (+ 1610us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:46.906301 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:46.906303 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:46.906532 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:46.906757 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:46.906758 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:46.906758 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:46.906867 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:46.907140 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:46.907147 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:46.907286 (+ 139us) client_negotiation.cc:769] Sending connection context
0807 22:40:46.907393 (+ 107us) client_negotiation.cc:240] Negotiation successful
0807 22:40:46.907553 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":70,"threads_started":1}
I20260807 22:40:46.908325 518 heartbeater.cc:347] Connected to a master server at 127.22.212.126:45863
I20260807 22:40:46.908420 518 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:46.908574 518 heartbeater.cc:511] Master 127.22.212.126:45863 requested a full tablet report, sending...
I20260807 22:40:46.908921 32249 ts_manager.cc:194] Registered new tserver with Master: 7db92aedc96840d195680c0c53ae89b7 (127.22.212.67:41703)
I20260807 22:40:46.909310 32249 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.67@KRBTEST.COM'} at 127.22.212.67:49865
I20260807 22:40:46.917725 23377 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/krb5kdc/test-admin.keytab.
Aug 07 22:40:46 dist-test-slave-2d19 krb5kdc[32182](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142446, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:46.936671 23377 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260807 22:40:46.938393 531 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:40:46.937583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56150 (local address 127.22.212.65:35689)
0807 22:40:46.937757 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:46.937763 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:46.937774 (+ 11us) server_negotiation.cc:407] Connection header received
0807 22:40:46.937803 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:46.937805 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:46.937819 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:46.937896 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:46.938303 (+ 407us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56150: BlockingRecv error: recv got EOF from 127.0.0.1:56150 (error 108)
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":94,"threads_started":1}
W20260807 22:40:46.938480 23377 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/krb5kdc/krb5cc' of type FILE
Aug 07 22:40:46 dist-test-slave-2d19 krb5kdc[32182](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142446, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:46.939615 23377 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 22:40:46 dist-test-slave-2d19 krb5kdc[32182](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142446, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:46.940600 23377 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 22:40:46 dist-test-slave-2d19 krb5kdc[32182](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142446, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.212.65@KRBTEST.COM
I20260807 22:40:46.948583 531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:46.941150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56152 (local address 127.22.212.65:35689)
0807 22:40:46.941211 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:46.941212 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:46.941223 (+ 11us) server_negotiation.cc:407] Connection header received
0807 22:40:46.941282 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:46.941282 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:46.941292 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:46.941339 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:46.941703 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:46.942471 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:46.943190 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:46.943524 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:46.943592 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:46.945773 (+ 2181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:46.945780 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:46.945781 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:46.945787 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:46.947333 (+ 1546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:46.947690 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:46.947694 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:46.947694 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:46.947758 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:46.947935 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:46.947936 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:46.947936 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:46.948090 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:46.948198 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:46.948346 (+ 148us) server_negotiation.cc:299] Negotiation successful
0807 22:40:46.948445 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
W20260807 22:40:46.950500 531 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:40:46.949977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56160 (local address 127.22.212.65:35689)
0807 22:40:46.950034 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:46.950040 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:46.950073 (+ 33us) server_negotiation.cc:407] Connection header received
0807 22:40:46.950122 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:46.950123 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:46.950132 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:46.950177 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:46.950449 (+ 272us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56160: BlockingRecv error: recv got EOF from 127.0.0.1:56160 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
W20260807 22:40:46.950605 23377 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/krb5kdc/krb5cc' of type FILE
Aug 07 22:40:46 dist-test-slave-2d19 krb5kdc[32182](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142446, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:46.951623 23377 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 22:40:46 dist-test-slave-2d19 krb5kdc[32182](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142446, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:46.952577 23377 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 22:40:46 dist-test-slave-2d19 krb5kdc[32182](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142446, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.212.65@KRBTEST.COM
I20260807 22:40:46.959276 531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:46.953140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56176 (local address 127.22.212.65:35689)
0807 22:40:46.953191 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:46.953192 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:46.953213 (+ 21us) server_negotiation.cc:407] Connection header received
0807 22:40:46.953252 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:46.953252 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:46.953261 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:46.953298 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:46.953602 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:46.954071 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:46.954805 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:46.954996 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:46.955062 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:46.957066 (+ 2004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:46.957083 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:46.957083 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:46.957089 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:46.958288 (+ 1199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:46.958613 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:46.958614 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:46.958614 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:46.958661 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:46.958839 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:46.958839 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:46.958839 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:46.958924 (+ 85us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:46.958992 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:46.959083 (+ 91us) server_negotiation.cc:299] Negotiation successful
0807 22:40:46.959143 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
W20260807 22:40:46.960799 531 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:40:46.960324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56192 (local address 127.22.212.65:35689)
0807 22:40:46.960360 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:46.960362 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:46.960402 (+ 40us) server_negotiation.cc:407] Connection header received
0807 22:40:46.960449 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:46.960450 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:46.960457 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:46.960499 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:46.960751 (+ 252us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56192: BlockingRecv error: recv got EOF from 127.0.0.1:56192 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260807 22:40:46.960851 23377 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786142418640232-23377-0/krb5kdc/krb5cc' of type FILE
Aug 07 22:40:46 dist-test-slave-2d19 krb5kdc[32182](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142446, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:46.961835 23377 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 22:40:46 dist-test-slave-2d19 krb5kdc[32182](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142446, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:46.962769 23377 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 22:40:46 dist-test-slave-2d19 krb5kdc[32182](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142446, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.212.65@KRBTEST.COM
I20260807 22:40:46.969237 531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:46.963300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56200 (local address 127.22.212.65:35689)
0807 22:40:46.963350 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:46.963352 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:46.963383 (+ 31us) server_negotiation.cc:407] Connection header received
0807 22:40:46.963431 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:46.963431 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:46.963438 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:46.963482 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:46.963807 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:46.964248 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:46.964926 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:46.965113 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:46.965163 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:46.967075 (+ 1912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:46.967076 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:46.967077 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:46.967082 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:46.968206 (+ 1124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:46.968583 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:46.968584 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:46.968584 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:46.968632 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:46.968793 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:46.968794 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:46.968794 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:46.968874 (+ 80us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:46.968938 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:46.969049 (+ 111us) server_negotiation.cc:299] Negotiation successful
0807 22:40:46.969123 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260807 22:40:46.969908 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 32339
I20260807 22:40:46.988324 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 32566
I20260807 22:40:47.013862 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 324
I20260807 22:40:47.026510 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 32200
2026-08-07T22:40:47Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2186 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:40:47 dist-test-slave-2d19 krb5kdc[553](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:40:47 dist-test-slave-2d19 krb5kdc[553](info): set up 2 sockets
Aug 07 22:40:47 dist-test-slave-2d19 krb5kdc[553](info): commencing operation
krb5kdc: starting...
W20260807 22:40:48.287917 23377 mini_kdc.cc:121] Time spent starting KDC: real 1.236s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Aug 07 22:40:48 dist-test-slave-2d19 krb5kdc[553](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142448, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:40:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:40:48Z Disabled control of system clock
WARNING: no policy specified for oryx/127.22.212.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.212.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.212.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.126.keytab.
Entry for principal oryx/127.22.212.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.126.keytab.
I20260807 22:40:48.414798 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:43419
--webserver_interface=127.22.212.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.126.keytab
--principal=oryx/127.22.212.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:41831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:43419
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:48.497669 571 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:48.497932 571 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:48.497974 571 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:48.499140 571 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:40:48.499213 571 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:48.499238 571 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:48.499258 571 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:40:48.499289 571 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:40:48.500814 571 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:41831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:43419
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.126.keytab
--principal=oryx/127.22.212.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:43419
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.571
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:48.501109 571 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:48.501344 571 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:48.506574 583 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:48.506608 582 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:48.506876 571 server_base.cc:1034] running on GCE node
W20260807 22:40:48.506593 585 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:48.507215 571 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:48.507654 571 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:48.508847 571 hybrid_clock.cc:648] HybridClock initialized: now 1786142448508822 us; error 43 us; skew 500 ppm
Aug 07 22:40:48 dist-test-slave-2d19 krb5kdc[553](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142448, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.212.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:48.515843 571 init.cc:377] Logged in from keytab as oryx/127.22.212.126@KRBTEST.COM (short username oryx)
I20260807 22:40:48.516413 571 webserver.cc:460] Webserver started at http://127.22.212.126:42783/ using document root <none> and password file <none>
I20260807 22:40:48.516661 571 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:48.516732 571 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:48.516876 571 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:48.517961 571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "23677f8da61b48e59d3faf7ab7da7ea9"
format_stamp: "Formatted at 2026-08-07 22:40:48 on dist-test-slave-2d19"
server_key: "fac8c1da367bd68f886b4bfbdf34a627"
server_key_iv: "6725d4a1f0cea0bfc43e851496558ca4"
server_key_version: "encryptionkey@0"
I20260807 22:40:48.518338 571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "23677f8da61b48e59d3faf7ab7da7ea9"
format_stamp: "Formatted at 2026-08-07 22:40:48 on dist-test-slave-2d19"
server_key: "fac8c1da367bd68f886b4bfbdf34a627"
server_key_iv: "6725d4a1f0cea0bfc43e851496558ca4"
server_key_version: "encryptionkey@0"
I20260807 22:40:48.519683 571 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 22:40:48.520463 593 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:48.520648 571 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:40:48.520756 571 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "23677f8da61b48e59d3faf7ab7da7ea9"
format_stamp: "Formatted at 2026-08-07 22:40:48 on dist-test-slave-2d19"
server_key: "fac8c1da367bd68f886b4bfbdf34a627"
server_key_iv: "6725d4a1f0cea0bfc43e851496558ca4"
server_key_version: "encryptionkey@0"
I20260807 22:40:48.520839 571 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:48.540714 571 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:48.542716 571 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:48.542882 571 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:48.546984 571 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:43419
I20260807 22:40:48.547024 671 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:43419 every 8 connection(s)
I20260807 22:40:48.547385 571 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:40:48.548432 672 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:48.550076 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 571
I20260807 22:40:48.550194 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:40:48.550392 23377 external_mini_cluster.cc:1428] Setting key d0e2ebf01c51fca5a24161d1f51e8c0d
I20260807 22:40:48.551224 672 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9: Bootstrap starting.
I20260807 22:40:48.551988 672 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:48.552376 672 log.cc:824] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:48.553253 672 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9: No bootstrap required, opened a new log
I20260807 22:40:48.555563 672 raft_consensus.cc:348] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } }
I20260807 22:40:48.555743 672 raft_consensus.cc:374] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:48.555790 672 raft_consensus.cc:729] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23677f8da61b48e59d3faf7ab7da7ea9, State: Initialized, Role: FOLLOWER
I20260807 22:40:48.555946 672 consensus_queue.cc:260] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } }
I20260807 22:40:48.556051 672 raft_consensus.cc:388] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:40:48.556103 672 raft_consensus.cc:482] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:40:48.556175 672 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:48.556831 672 raft_consensus.cc:504] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } }
I20260807 22:40:48.556924 672 leader_election.cc:302] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 23677f8da61b48e59d3faf7ab7da7ea9; no voters:
I20260807 22:40:48.557134 672 leader_election.cc:288] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:40:48.557196 678 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:40:48.557348 678 raft_consensus.cc:686] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [term 1 LEADER]: Becoming Leader. State: Replica: 23677f8da61b48e59d3faf7ab7da7ea9, State: Running, Role: LEADER
I20260807 22:40:48.557415 672 sys_catalog.cc:564] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:40:48.557466 678 consensus_queue.cc:237] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } }
I20260807 22:40:48.557817 678 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23677f8da61b48e59d3faf7ab7da7ea9. Latest consensus state: current_term: 1 leader_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } }
I20260807 22:40:48.557890 678 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [sys.catalog]: This master's current role is: LEADER
Aug 07 22:40:48 dist-test-slave-2d19 krb5kdc[553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142448, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM
I20260807 22:40:48.558694 679 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } }
I20260807 22:40:48.558784 679 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:48.558966 690 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:40:48.559576 690 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:40:48.561254 690 catalog_manager.cc:1347] Generated new cluster ID: aa01039e82474ddaafdc8d1334a2a8c8
I20260807 22:40:48.561306 690 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:40:48.563126 676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:48.550971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58382 (local address 127.22.212.126:43419)
0807 22:40:48.551195 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:48.551206 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:48.551242 (+ 36us) server_negotiation.cc:407] Connection header received
0807 22:40:48.551883 (+ 641us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:48.551892 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:48.551965 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:48.552154 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:48.552934 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:48.554318 (+ 1384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:48.555043 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:48.555711 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:48.555827 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:48.558897 (+ 3070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:48.558902 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:48.558902 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:48.558918 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:48.561032 (+ 2114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:48.561463 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:48.561467 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:48.561467 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:48.561592 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:48.561817 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:48.561818 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:48.561818 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:48.562120 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:48.562263 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:48.562751 (+ 488us) server_negotiation.cc:299] Negotiation successful
0807 22:40:48.562898 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":112,"threads_started":1}
I20260807 22:40:48.566602 690 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:40:48.567296 690 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:40:48.576987 690 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9: Generated new TSK 0
I20260807 22:40:48.577206 690 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.22.212.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.212.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.212.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.65.keytab.
Entry for principal oryx/127.22.212.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.65.keytab.
I20260807 22:40:48.607885 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.65:0
--local_ip_for_outbound_sockets=127.22.212.65
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:43419
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.65.keytab
--principal=oryx/127.22.212.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:41831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:48.695678 713 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:48.695885 713 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:48.695909 713 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:48.697103 713 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:48.697150 713 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:48.697176 713 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.65
I20260807 22:40:48.698648 713 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:41831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.65.keytab
--principal=oryx/127.22.212.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:43419
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.713
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.65
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:48.698904 713 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:48.699148 713 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:48.704329 721 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:48.704335 722 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:48.704347 727 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:48.704675 713 server_base.cc:1034] running on GCE node
I20260807 22:40:48.704842 713 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:48.705083 713 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:48.706267 713 hybrid_clock.cc:648] HybridClock initialized: now 1786142448706260 us; error 36 us; skew 500 ppm
Aug 07 22:40:48 dist-test-slave-2d19 krb5kdc[553](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142448, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.212.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:48.708904 713 init.cc:377] Logged in from keytab as oryx/127.22.212.65@KRBTEST.COM (short username oryx)
I20260807 22:40:48.709432 713 webserver.cc:460] Webserver started at http://127.22.212.65:41801/ using document root <none> and password file <none>
I20260807 22:40:48.709667 713 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:48.709736 713 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:48.709892 713 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:48.710985 713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-0/data/instance:
uuid: "71378a822b0244288e2f95ad5e419c9a"
format_stamp: "Formatted at 2026-08-07 22:40:48 on dist-test-slave-2d19"
server_key: "74b6d25780a25116b407ea1c51fb4190"
server_key_iv: "6cadbe17274b25495f4139322aa4b6bb"
server_key_version: "encryptionkey@0"
I20260807 22:40:48.711370 713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance:
uuid: "71378a822b0244288e2f95ad5e419c9a"
format_stamp: "Formatted at 2026-08-07 22:40:48 on dist-test-slave-2d19"
server_key: "74b6d25780a25116b407ea1c51fb4190"
server_key_iv: "6cadbe17274b25495f4139322aa4b6bb"
server_key_version: "encryptionkey@0"
I20260807 22:40:48.712855 713 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 22:40:48.713652 738 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:48.715106 713 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260807 22:40:48.715207 713 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-0/wal
uuid: "71378a822b0244288e2f95ad5e419c9a"
format_stamp: "Formatted at 2026-08-07 22:40:48 on dist-test-slave-2d19"
server_key: "74b6d25780a25116b407ea1c51fb4190"
server_key_iv: "6cadbe17274b25495f4139322aa4b6bb"
server_key_version: "encryptionkey@0"
I20260807 22:40:48.715301 713 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:48.732905 713 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:48.735293 713 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:48.735464 713 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:48.735720 713 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:48.736045 713 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:48.736099 713 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:48.736133 713 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:48.736177 713 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:48.742316 713 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.65:39385
I20260807 22:40:48.742365 908 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.65:39385 every 8 connection(s)
I20260807 22:40:48.742695 713 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
I20260807 22:40:48.743922 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 713
I20260807 22:40:48.744068 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance
I20260807 22:40:48.744292 23377 external_mini_cluster.cc:1428] Setting key 5e9cf87daa887b3c9e2dc0367bd16bba
Aug 07 22:40:48 dist-test-slave-2d19 krb5kdc[553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142448, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.212.65@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM
WARNING: no policy specified for oryx/127.22.212.66@KRBTEST.COM; defaulting to no policy
I20260807 22:40:48.753733 676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:48.743435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:49471 (local address 127.22.212.126:43419)
0807 22:40:48.743502 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:48.743505 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:48.743719 (+ 214us) server_negotiation.cc:407] Connection header received
0807 22:40:48.744375 (+ 656us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:48.744376 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:48.744390 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:48.744470 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:48.745620 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:48.746385 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:48.747886 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:48.748086 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:48.748145 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:48.750758 (+ 2613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:48.750760 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:48.750760 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:48.750769 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:48.752233 (+ 1464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:48.752710 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:48.752711 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:48.752712 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:48.752776 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:48.753053 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:48.753054 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:48.753054 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:48.753173 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:48.753251 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:48.753545 (+ 294us) server_negotiation.cc:299] Negotiation successful
0807 22:40:48.753638 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 22:40:48.753933 913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:48.743418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.22.212.65:49471)
0807 22:40:48.743590 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:48.743633 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:48.744210 (+ 577us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:48.744575 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:48.744580 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:48.745311 (+ 731us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:48.745518 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:48.745524 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:48.746502 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:48.746503 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:48.747791 (+ 1288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:48.747795 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:48.748179 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:48.748180 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:48.748360 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:48.748904 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:48.748915 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:48.750648 (+ 1733us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:48.752385 (+ 1737us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:48.752393 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:48.752395 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:48.752631 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:48.752854 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:48.752854 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:48.752855 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:48.752968 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:48.753242 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:48.753250 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:48.753398 (+ 148us) client_negotiation.cc:769] Sending connection context
0807 22:40:48.753514 (+ 116us) client_negotiation.cc:240] Negotiation successful
0807 22:40:48.753680 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":88,"threads_started":1}
I20260807 22:40:48.754555 911 heartbeater.cc:347] Connected to a master server at 127.22.212.126:43419
I20260807 22:40:48.754695 911 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:48.754899 911 heartbeater.cc:511] Master 127.22.212.126:43419 requested a full tablet report, sending...
I20260807 22:40:48.755461 618 ts_manager.cc:194] Registered new tserver with Master: 71378a822b0244288e2f95ad5e419c9a (127.22.212.65:39385)
I20260807 22:40:48.756233 618 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.22.212.65@KRBTEST.COM'} at 127.22.212.65:49471
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.212.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.212.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.66.keytab.
Entry for principal oryx/127.22.212.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.66.keytab.
I20260807 22:40:48.774858 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.66:0
--local_ip_for_outbound_sockets=127.22.212.66
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:43419
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.66.keytab
--principal=oryx/127.22.212.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:41831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:48.859747 919 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:48.860010 919 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:48.860045 919 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:48.861194 919 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:48.861236 919 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:48.861263 919 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.66
I20260807 22:40:48.862635 919 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:41831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.66.keytab
--principal=oryx/127.22.212.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:43419
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.919
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.66
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:48.862823 919 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:48.863003 919 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:48.868287 929 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:48.868335 931 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:48.868450 934 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:48.868554 919 server_base.cc:1034] running on GCE node
I20260807 22:40:48.868750 919 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:48.868989 919 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:48.870172 919 hybrid_clock.cc:648] HybridClock initialized: now 1786142448870138 us; error 39 us; skew 500 ppm
Aug 07 22:40:48 dist-test-slave-2d19 krb5kdc[553](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142448, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.212.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:48.872699 919 init.cc:377] Logged in from keytab as oryx/127.22.212.66@KRBTEST.COM (short username oryx)
I20260807 22:40:48.873193 919 webserver.cc:460] Webserver started at http://127.22.212.66:44211/ using document root <none> and password file <none>
I20260807 22:40:48.873431 919 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:48.873498 919 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:48.873641 919 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:48.874727 919 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-1/data/instance:
uuid: "bef2621d444d4e0c8c964fd8a5e4a9c9"
format_stamp: "Formatted at 2026-08-07 22:40:48 on dist-test-slave-2d19"
server_key: "9a07b8ff499200f37e2df95b3c053c24"
server_key_iv: "e2e1183c5a1e32eabf25b9b7ce03228b"
server_key_version: "encryptionkey@0"
I20260807 22:40:48.875110 919 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance:
uuid: "bef2621d444d4e0c8c964fd8a5e4a9c9"
format_stamp: "Formatted at 2026-08-07 22:40:48 on dist-test-slave-2d19"
server_key: "9a07b8ff499200f37e2df95b3c053c24"
server_key_iv: "e2e1183c5a1e32eabf25b9b7ce03228b"
server_key_version: "encryptionkey@0"
I20260807 22:40:48.876531 919 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260807 22:40:48.877298 949 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:48.877483 919 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 22:40:48.877597 919 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-1/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-1/wal
uuid: "bef2621d444d4e0c8c964fd8a5e4a9c9"
format_stamp: "Formatted at 2026-08-07 22:40:48 on dist-test-slave-2d19"
server_key: "9a07b8ff499200f37e2df95b3c053c24"
server_key_iv: "e2e1183c5a1e32eabf25b9b7ce03228b"
server_key_version: "encryptionkey@0"
I20260807 22:40:48.877677 919 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:48.891387 919 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:48.893558 919 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:48.893676 919 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:48.893854 919 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:48.894184 919 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:48.894243 919 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:48.894287 919 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:48.894306 919 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:48.900170 919 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.66:38741
I20260807 22:40:48.900249 1114 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.66:38741 every 8 connection(s)
I20260807 22:40:48.900614 919 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
Aug 07 22:40:48 dist-test-slave-2d19 krb5kdc[553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142448, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.212.66@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM
I20260807 22:40:48.909303 676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:48.901363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:59105 (local address 127.22.212.126:43419)
0807 22:40:48.901445 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:48.901448 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:48.901630 (+ 182us) server_negotiation.cc:407] Connection header received
0807 22:40:48.902129 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:48.902130 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:48.902140 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:48.902194 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:48.903111 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:48.903604 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:48.904632 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:48.904811 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:48.904867 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:48.906937 (+ 2070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:48.906938 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:48.906939 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:48.906945 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:48.908124 (+ 1179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:48.908542 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:48.908543 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:48.908543 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:48.908595 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:48.908797 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:48.908798 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:48.908798 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:48.908887 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:48.908932 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:48.909179 (+ 247us) server_negotiation.cc:299] Negotiation successful
0807 22:40:48.909238 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 22:40:48.909449 1118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:48.901321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.22.212.66:59105)
0807 22:40:48.901505 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:48.901544 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:48.902016 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:48.902249 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:48.902252 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:48.902814 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:48.903004 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:48.903009 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:48.903685 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:48.903686 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:48.904559 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:48.904561 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:48.904885 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:48.904885 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:48.904980 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:48.905439 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:48.905448 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:48.906829 (+ 1381us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:48.908196 (+ 1367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:48.908201 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:48.908203 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:48.908471 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:48.908656 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:48.908657 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:48.908657 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:48.908757 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:48.908938 (+ 181us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:48.908942 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:48.909055 (+ 113us) client_negotiation.cc:769] Sending connection context
0807 22:40:48.909138 (+ 83us) client_negotiation.cc:240] Negotiation successful
0807 22:40:48.909257 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":107,"threads_started":1}
I20260807 22:40:48.909956 1116 heartbeater.cc:347] Connected to a master server at 127.22.212.126:43419
I20260807 22:40:48.910048 1116 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:48.910187 1116 heartbeater.cc:511] Master 127.22.212.126:43419 requested a full tablet report, sending...
I20260807 22:40:48.910594 618 ts_manager.cc:194] Registered new tserver with Master: bef2621d444d4e0c8c964fd8a5e4a9c9 (127.22.212.66:38741)
I20260807 22:40:48.910734 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 919
I20260807 22:40:48.910833 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance
I20260807 22:40:48.911044 23377 external_mini_cluster.cc:1428] Setting key b02d92d563b82ad95407d371162f160e
I20260807 22:40:48.911103 618 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.22.212.66@KRBTEST.COM'} at 127.22.212.66:59105
WARNING: no policy specified for oryx/127.22.212.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.212.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.212.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.67.keytab.
Entry for principal oryx/127.22.212.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.67.keytab.
I20260807 22:40:48.938796 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.67:0
--local_ip_for_outbound_sockets=127.22.212.67
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:43419
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.67.keytab
--principal=oryx/127.22.212.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:41831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:49.023835 1121 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:49.024057 1121 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:49.024083 1121 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:49.025300 1121 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:49.025345 1121 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:49.025375 1121 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.67
I20260807 22:40:49.026906 1121 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:41831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.67.keytab
--principal=oryx/127.22.212.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:43419
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1121
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.67
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:49.027165 1121 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:49.027415 1121 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:49.032963 1131 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:49.033047 1133 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:49.032958 1121 server_base.cc:1034] running on GCE node
W20260807 22:40:49.032961 1130 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:49.033439 1121 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:49.033727 1121 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:49.034927 1121 hybrid_clock.cc:648] HybridClock initialized: now 1786142449034899 us; error 43 us; skew 500 ppm
Aug 07 22:40:49 dist-test-slave-2d19 krb5kdc[553](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142449, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.212.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:49.037611 1121 init.cc:377] Logged in from keytab as oryx/127.22.212.67@KRBTEST.COM (short username oryx)
I20260807 22:40:49.038082 1121 webserver.cc:460] Webserver started at http://127.22.212.67:43719/ using document root <none> and password file <none>
I20260807 22:40:49.038326 1121 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:49.038398 1121 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:49.038589 1121 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:49.039688 1121 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-2/data/instance:
uuid: "75c56dc41c8f4599b49f3c31d0ef1d44"
format_stamp: "Formatted at 2026-08-07 22:40:49 on dist-test-slave-2d19"
server_key: "f50153b9713916c475f4da1faf8268cb"
server_key_iv: "03000dda46ddc4558bc0d128152fa78e"
server_key_version: "encryptionkey@0"
I20260807 22:40:49.040077 1121 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance:
uuid: "75c56dc41c8f4599b49f3c31d0ef1d44"
format_stamp: "Formatted at 2026-08-07 22:40:49 on dist-test-slave-2d19"
server_key: "f50153b9713916c475f4da1faf8268cb"
server_key_iv: "03000dda46ddc4558bc0d128152fa78e"
server_key_version: "encryptionkey@0"
I20260807 22:40:49.041563 1121 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 22:40:49.042328 1150 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:49.042503 1121 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 22:40:49.042619 1121 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-2/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-2/wal
uuid: "75c56dc41c8f4599b49f3c31d0ef1d44"
format_stamp: "Formatted at 2026-08-07 22:40:49 on dist-test-slave-2d19"
server_key: "f50153b9713916c475f4da1faf8268cb"
server_key_iv: "03000dda46ddc4558bc0d128152fa78e"
server_key_version: "encryptionkey@0"
I20260807 22:40:49.042704 1121 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:49.067948 1121 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:49.070165 1121 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:49.070366 1121 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:49.070662 1121 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:49.071020 1121 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:49.071084 1121 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:49.071131 1121 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:49.071161 1121 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:49.077932 1121 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.67:38195
I20260807 22:40:49.077966 1321 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.67:38195 every 8 connection(s)
I20260807 22:40:49.078329 1121 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
I20260807 22:40:49.084576 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 1121
I20260807 22:40:49.084682 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance
I20260807 22:40:49.084870 23377 external_mini_cluster.cc:1428] Setting key df2b79935b133cee5fdef03585a842e1
Aug 07 22:40:49 dist-test-slave-2d19 krb5kdc[553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142449, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.212.67@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM
I20260807 22:40:49.088902 676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.079097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:54639 (local address 127.22.212.126:43419)
0807 22:40:49.079145 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:49.079147 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:49.079368 (+ 221us) server_negotiation.cc:407] Connection header received
0807 22:40:49.079947 (+ 579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:49.079948 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:49.079957 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:49.080018 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:49.081221 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.081764 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.082842 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.083018 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.083261 (+ 243us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.085825 (+ 2564us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:49.085826 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:49.085827 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:49.085835 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:49.087388 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.087855 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.087857 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.087857 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.087921 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.088194 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.088195 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.088195 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.088369 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:49.088445 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:49.088726 (+ 281us) server_negotiation.cc:299] Negotiation successful
0807 22:40:49.088808 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 22:40:49.089103 1329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.079063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.22.212.67:54639)
0807 22:40:49.079239 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:49.079285 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:49.079851 (+ 566us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:49.080110 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:49.080114 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:49.080840 (+ 726us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:49.081131 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.081138 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.081843 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.081844 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.082763 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.082766 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.083283 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.083284 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.083397 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.083905 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:49.083914 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:49.085733 (+ 1819us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:49.087500 (+ 1767us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:49.087507 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:49.087510 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:49.087765 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:49.087997 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:49.087998 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:49.087998 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:49.088117 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:49.088442 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:49.088450 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:49.088590 (+ 140us) client_negotiation.cc:769] Sending connection context
0807 22:40:49.088704 (+ 114us) client_negotiation.cc:240] Negotiation successful
0807 22:40:49.088864 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":99,"threads_started":1}
I20260807 22:40:49.089587 1327 heartbeater.cc:347] Connected to a master server at 127.22.212.126:43419
I20260807 22:40:49.089671 1327 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:49.089875 1327 heartbeater.cc:511] Master 127.22.212.126:43419 requested a full tablet report, sending...
I20260807 22:40:49.090251 618 ts_manager.cc:194] Registered new tserver with Master: 75c56dc41c8f4599b49f3c31d0ef1d44 (127.22.212.67:38195)
I20260807 22:40:49.090710 618 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.22.212.67@KRBTEST.COM'} at 127.22.212.67:54639
I20260807 22:40:49.096711 23377 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.22.212.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.212.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.212.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.125.keytab.
Entry for principal oryx/127.22.212.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.125.keytab.
I20260807 22:40:49.123605 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.125:41083
--webserver_interface=127.22.212.125
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.125.keytab
--principal=oryx/127.22.212.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:41831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:43419,127.22.212.125:41083
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:49.210718 1334 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:49.210920 1334 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:49.210942 1334 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:49.212118 1334 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:40:49.212163 1334 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:49.212178 1334 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:49.212191 1334 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:40:49.212245 1334 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:40:49.213743 1334 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:41831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:43419,127.22.212.125:41083
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.125.keytab
--principal=oryx/127.22.212.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.125:41083
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.22.212.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1334
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
W20260807 22:40:49.213878 1334 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.22.212.126:43419,127.22.212.125:41083'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260807 22:40:49.214028 1334 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:49.214264 1334 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:49.219316 1348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:49.219348 1346 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:49.219316 1345 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:49.219691 1334 server_base.cc:1034] running on GCE node
I20260807 22:40:49.219985 1334 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:49.220324 1334 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:49.221491 1334 hybrid_clock.cc:648] HybridClock initialized: now 1786142449221467 us; error 37 us; skew 500 ppm
Aug 07 22:40:49 dist-test-slave-2d19 krb5kdc[553](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142449, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.212.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:49.224179 1334 init.cc:377] Logged in from keytab as oryx/127.22.212.125@KRBTEST.COM (short username oryx)
I20260807 22:40:49.224653 1334 webserver.cc:460] Webserver started at http://127.22.212.125:35299/ using document root <none> and password file <none>
I20260807 22:40:49.224879 1334 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:49.224922 1334 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:49.225019 1334 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:49.226033 1334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-1/data/instance:
uuid: "940825a01cf04921b576d61a33cb13dc"
format_stamp: "Formatted at 2026-08-07 22:40:49 on dist-test-slave-2d19"
server_key: "a03502ebf65dd0f56c370ef5011389aa"
server_key_iv: "0dad2b974cc23ec1c7efde0c823cce0f"
server_key_version: "encryptionkey@0"
I20260807 22:40:49.226330 1334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-1/wal/instance:
uuid: "940825a01cf04921b576d61a33cb13dc"
format_stamp: "Formatted at 2026-08-07 22:40:49 on dist-test-slave-2d19"
server_key: "a03502ebf65dd0f56c370ef5011389aa"
server_key_iv: "0dad2b974cc23ec1c7efde0c823cce0f"
server_key_version: "encryptionkey@0"
I20260807 22:40:49.227627 1334 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260807 22:40:49.228410 1365 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:49.228564 1334 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260807 22:40:49.228662 1334 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-1/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-1/wal
uuid: "940825a01cf04921b576d61a33cb13dc"
format_stamp: "Formatted at 2026-08-07 22:40:49 on dist-test-slave-2d19"
server_key: "a03502ebf65dd0f56c370ef5011389aa"
server_key_iv: "0dad2b974cc23ec1c7efde0c823cce0f"
server_key_version: "encryptionkey@0"
I20260807 22:40:49.228717 1334 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:49.245332 1334 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:49.247488 1334 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:49.247653 1334 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:49.251942 1334 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.125:41083
I20260807 22:40:49.252000 1441 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.125:41083 every 8 connection(s)
I20260807 22:40:49.252440 1334 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-1/data/info.pb
I20260807 22:40:49.253516 1442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:49.255085 1442 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:40:49.259420 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 1334
Aug 07 22:40:49 dist-test-slave-2d19 krb5kdc[553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142449, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.212.125@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM
I20260807 22:40:49.265205 676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.255834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58396 (local address 127.22.212.126:43419)
0807 22:40:49.255905 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:49.255907 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:49.256112 (+ 205us) server_negotiation.cc:407] Connection header received
0807 22:40:49.256628 (+ 516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:49.256629 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:49.256638 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:49.256731 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:49.257309 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.257880 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.258949 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.259207 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.259291 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.261852 (+ 2561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:49.261854 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:49.261854 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:49.261862 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:49.263476 (+ 1614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.264004 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.264005 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.264006 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.264090 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.264431 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.264432 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.264432 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.264577 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:49.264632 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:49.265051 (+ 419us) server_negotiation.cc:299] Negotiation successful
0807 22:40:49.265137 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 22:40:49.265431 1445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.255793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.0.0.1:58396)
0807 22:40:49.255967 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:49.256009 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:49.256534 (+ 525us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:49.256780 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:49.256784 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:49.257032 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:49.257233 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.257236 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.257958 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.257959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.258878 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.258881 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.259313 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.259314 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.259445 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.260285 (+ 840us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:49.260296 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:49.261753 (+ 1457us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:49.263582 (+ 1829us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:49.263592 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:49.263594 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:49.263927 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:49.264167 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:49.264168 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:49.264169 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:49.264351 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:49.264675 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:49.264684 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:49.264869 (+ 185us) client_negotiation.cc:769] Sending connection context
0807 22:40:49.264995 (+ 126us) client_negotiation.cc:240] Negotiation successful
0807 22:40:49.265168 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":102,"threads_started":1}
Aug 07 22:40:49 dist-test-slave-2d19 krb5kdc[553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142448, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.22.212.125@KRBTEST.COM
I20260807 22:40:49.266211 1442 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.212.125" port: 41083 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:40:49.269528 1447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.260016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44838 (local address 127.22.212.125:41083)
0807 22:40:49.260215 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:49.260219 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:49.260297 (+ 78us) server_negotiation.cc:407] Connection header received
0807 22:40:49.260370 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:49.260373 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:49.260395 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:49.260486 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:49.261187 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.262002 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.262994 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.263502 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.263569 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.266455 (+ 2886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:49.266477 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:49.266477 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:49.266485 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:49.268133 (+ 1648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.268536 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.268540 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.268540 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.268600 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.268806 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.268807 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.268808 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.268943 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:49.269116 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:49.269170 (+ 54us) server_negotiation.cc:299] Negotiation successful
0807 22:40:49.269272 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":119,"threads_started":1}
Aug 07 22:40:49 dist-test-slave-2d19 krb5kdc[553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142449, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.212.125@KRBTEST.COM for oryx/127.22.212.125@KRBTEST.COM
I20260807 22:40:49.272836 1445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.266482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.125:41083 (local address 127.0.0.1:44846)
0807 22:40:49.266518 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:49.266528 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:49.266569 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:49.266816 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:49.266817 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:49.266964 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:49.267006 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.267007 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.267659 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.267660 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.268135 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.268137 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.268548 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.268549 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.268620 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.269017 (+ 397us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:49.269022 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:49.270400 (+ 1378us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:49.271743 (+ 1343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:49.271744 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:49.271744 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:49.271921 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:49.272149 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:49.272150 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:49.272150 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:49.272204 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:49.272480 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:49.272481 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:49.272535 (+ 54us) client_negotiation.cc:769] Sending connection context
0807 22:40:49.272629 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 22:40:49.272727 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18}
I20260807 22:40:49.272928 1448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.266546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44846 (local address 127.22.212.125:41083)
0807 22:40:49.266708 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:49.266710 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:49.266715 (+ 5us) server_negotiation.cc:407] Connection header received
0807 22:40:49.266729 (+ 14us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:49.266730 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:49.266737 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:49.266815 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:49.267095 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.267578 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.268218 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.268461 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.268549 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.270493 (+ 1944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:49.270494 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:49.270494 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:49.270500 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:49.271659 (+ 1159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.272008 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.272009 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.272010 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.272079 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.272298 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.272299 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.272300 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.272409 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:49.272489 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:49.272653 (+ 164us) server_negotiation.cc:299] Negotiation successful
0807 22:40:49.272779 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":62,"server-negotiator.queue_time_us":145,"thread_start_us":92,"threads_started":1}
I20260807 22:40:49.274300 1442 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc: Bootstrap starting.
I20260807 22:40:49.274976 1442 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:49.275272 1442 log.cc:824] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:49.276111 1442 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc: No bootstrap required, opened a new log
I20260807 22:40:49.277542 1442 raft_consensus.cc:348] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 41083 } }
I20260807 22:40:49.277666 1442 raft_consensus.cc:374] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:49.277690 1442 raft_consensus.cc:729] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 940825a01cf04921b576d61a33cb13dc, State: Initialized, Role: FOLLOWER
I20260807 22:40:49.277848 1442 consensus_queue.cc:260] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 41083 } }
I20260807 22:40:49.278173 1442 sys_catalog.cc:564] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:40:49.278139 1451 sys_catalog.cc:455] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 41083 } } }
I20260807 22:40:49.278254 1451 sys_catalog.cc:458] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [sys.catalog]: This master's current role is: FOLLOWER
W20260807 22:40:49.279882 1463 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:40:49.279950 1463 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:40:49.281853 1334 master_runner.cc:428] Detected that this master 940825a01cf04921b576d61a33cb13dc is joining an existing cluster
I20260807 22:40:49.281920 1334 master_runner.cc:432] Initiating AddMaster RPC to add 127.22.212.125:41083
I20260807 22:40:49.289503 676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.283043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58408 (local address 127.22.212.126:43419)
0807 22:40:49.283109 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:49.283111 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:49.283222 (+ 111us) server_negotiation.cc:407] Connection header received
0807 22:40:49.283279 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:49.283280 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:49.283292 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:49.283359 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:49.283752 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.284400 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.285127 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.285328 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.285404 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.286632 (+ 1228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:49.286634 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:49.286634 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:49.286641 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:49.288331 (+ 1690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.288727 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.288728 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.288729 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.288785 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.288987 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.288988 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.288988 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.289107 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:49.289181 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:49.289333 (+ 152us) server_negotiation.cc:299] Negotiation successful
0807 22:40:49.289408 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260807 22:40:49.289620 1474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.282994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.0.0.1:58408)
0807 22:40:49.283146 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:49.283158 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:49.283225 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:49.283365 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:49.283365 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:49.283578 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:49.283670 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.283672 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.284477 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.284479 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.285044 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.285046 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.285423 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.285424 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.285486 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.286138 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:49.286141 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:49.286514 (+ 373us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:49.288425 (+ 1911us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:49.288426 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:49.288426 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:49.288657 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:49.288860 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:49.288861 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:49.288862 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:49.288919 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:49.289186 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:49.289187 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:49.289228 (+ 41us) client_negotiation.cc:769] Sending connection context
0807 22:40:49.289308 (+ 80us) client_negotiation.cc:240] Negotiation successful
0807 22:40:49.289408 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":99,"threads_started":1}
I20260807 22:40:49.290148 1448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.283411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44862 (local address 127.22.212.125:41083)
0807 22:40:49.283452 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:49.283454 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:49.283466 (+ 12us) server_negotiation.cc:407] Connection header received
0807 22:40:49.283539 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:49.283540 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:49.283548 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:49.283617 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:49.283976 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.284738 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.285732 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.286020 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.286075 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.287060 (+ 985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:49.287061 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:49.287062 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:49.287068 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:49.288870 (+ 1802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.289233 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.289234 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.289234 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.289284 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.289455 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.289455 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.289456 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.289570 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:49.289610 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:49.289993 (+ 383us) server_negotiation.cc:299] Negotiation successful
0807 22:40:49.290067 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 22:40:49.290503 1476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.283300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.125:41083 (local address 127.0.0.1:44862)
0807 22:40:49.283426 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:49.283436 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:49.283477 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:49.283634 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:49.283635 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:49.283835 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:49.283891 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.283892 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.284830 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.284831 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.285645 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.285648 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.286107 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.286109 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.286175 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.286584 (+ 409us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:49.286589 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:49.286965 (+ 376us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:49.288956 (+ 1991us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:49.288957 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:49.288957 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:49.289156 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:49.289346 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:49.289346 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:49.289347 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:49.289394 (+ 47us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:49.289847 (+ 453us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:49.289848 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:49.289886 (+ 38us) client_negotiation.cc:769] Sending connection context
0807 22:40:49.290313 (+ 427us) client_negotiation.cc:240] Negotiation successful
0807 22:40:49.290409 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":69,"threads_started":1}
Aug 07 22:40:49 dist-test-slave-2d19 krb5kdc[553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142448, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.212.126@KRBTEST.COM for oryx/127.22.212.125@KRBTEST.COM
I20260807 22:40:49.299124 1448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.291922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44878 (local address 127.22.212.125:41083)
0807 22:40:49.291962 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:49.291964 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:49.292140 (+ 176us) server_negotiation.cc:407] Connection header received
0807 22:40:49.292226 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:49.292227 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:49.292238 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:49.292317 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:49.292722 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.293161 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.293912 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.294194 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.294284 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.296500 (+ 2216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:49.296501 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:49.296501 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:49.296508 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:49.297903 (+ 1395us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.298300 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.298301 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.298301 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.298355 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.298572 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.298573 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.298573 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.298681 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:49.298757 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:49.298950 (+ 193us) server_negotiation.cc:299] Negotiation successful
0807 22:40:49.299026 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 22:40:49.299161 1478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.291861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.125:41083 (local address 127.0.0.1:44878)
0807 22:40:49.292051 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:49.292080 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:49.292163 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:49.292324 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:49.292327 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:49.292587 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:49.292629 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.292631 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.293244 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.293245 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.293825 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.293826 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.294270 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.294272 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.294357 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.294822 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:49.294827 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:49.296399 (+ 1572us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:49.298006 (+ 1607us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:49.298014 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:49.298016 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:49.298222 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:49.298438 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:49.298438 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:49.298439 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:49.298504 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:49.298751 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:49.298758 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:49.298808 (+ 50us) client_negotiation.cc:769] Sending connection context
0807 22:40:49.298908 (+ 100us) client_negotiation.cc:240] Negotiation successful
0807 22:40:49.299038 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":79,"threads_started":1}
I20260807 22:40:49.300012 618 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.22.212.125:41083: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "940825a01cf04921b576d61a33cb13dc"
member_type: NON_VOTER
last_known_addr {
host: "127.22.212.125"
port: 41083
}
attrs {
promote: true
}
}
dest_uuid: "23677f8da61b48e59d3faf7ab7da7ea9"
cas_config_opid_index: -1
I20260807 22:40:49.300370 618 consensus_queue.cc:237] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: NON_VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: true } }
I20260807 22:40:49.300920 1479 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 940825a01cf04921b576d61a33cb13dc (127.22.212.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: NON_VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: true } } }
I20260807 22:40:49.301213 1404 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:49.301994 1404 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [term 1 FOLLOWER]: Refusing update from remote peer 23677f8da61b48e59d3faf7ab7da7ea9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 22:40:49.302078 1479 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.22.212.125:41083
I20260807 22:40:49.302157 1479 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: NON_VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: true } } }
I20260807 22:40:49.302225 1479 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:49.302464 1481 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: NON_VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:40:49.302572 1334 master.cc:537] Master@127.22.212.125:41083 shutting down...
W20260807 22:40:49.303241 601 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260807 22:40:49.303673 601 consensus_peers.cc:487] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 -> Peer 940825a01cf04921b576d61a33cb13dc (127.22.212.125:41083): Couldn't send request to peer 940825a01cf04921b576d61a33cb13dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260807 22:40:49.305241 1334 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:40:49.305332 1334 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:49.305387 1334 tablet_replica.cc:330] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc: stopping tablet replica
I20260807 22:40:49.307962 1334 master.cc:552] Master@127.22.212.125:41083 shutdown complete.
I20260807 22:40:49.308024 1334 master_runner.cc:305] Clearing existing system tablet
I20260807 22:40:49.308164 1334 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:49.308228 1334 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:49.308869 1334 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:49.309345 1487 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:49.309465 1334 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:49.309523 1334 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:49.309564 1334 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-1/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-1/wal
uuid: "940825a01cf04921b576d61a33cb13dc"
format_stamp: "Formatted at 2026-08-07 22:40:49 on dist-test-slave-2d19"
server_key: "a03502ebf65dd0f56c370ef5011389aa"
server_key_iv: "0dad2b974cc23ec1c7efde0c823cce0f"
server_key_version: "encryptionkey@0"
I20260807 22:40:49.310221 1334 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:49.311722 1334 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260807 22:40:49.311779 1334 log.cc:1196] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260807 22:40:49.311998 1334 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc: Deleting consensus metadata
I20260807 22:40:49.312136 1334 master_runner.cc:315] Copying system tablet from 127.22.212.126:43419
I20260807 22:40:49.312801 1334 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc: tablet copy: Beginning tablet copy session from remote peer at address 127.22.212.126:43419
I20260807 22:40:49.318827 676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.313183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58414 (local address 127.22.212.126:43419)
0807 22:40:49.313226 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:49.313228 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:49.313331 (+ 103us) server_negotiation.cc:407] Connection header received
0807 22:40:49.313401 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:49.313402 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:49.313412 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:49.313462 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:49.313791 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.314306 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.315048 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.315252 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.315337 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.316329 (+ 992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:49.316330 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:49.316331 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:49.316337 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:49.317690 (+ 1353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.318063 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.318065 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.318065 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.318144 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.318369 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.318370 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.318370 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.318470 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:49.318522 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:49.318701 (+ 179us) server_negotiation.cc:299] Negotiation successful
0807 22:40:49.318766 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 22:40:49.318991 1495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.313097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.0.0.1:58414)
0807 22:40:49.313252 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:49.313262 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:49.313347 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:49.313465 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:49.313466 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:49.313653 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:49.313707 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.313709 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.314395 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.314397 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.314949 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.314951 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.315340 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.315341 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.315408 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.315896 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:49.315901 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:49.316203 (+ 302us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:49.317777 (+ 1574us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:49.317778 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:49.317779 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:49.317965 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:49.318209 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:49.318210 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:49.318210 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:49.318295 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:49.318534 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:49.318535 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:49.318605 (+ 70us) client_negotiation.cc:769] Sending connection context
0807 22:40:49.318683 (+ 78us) client_negotiation.cc:240] Negotiation successful
0807 22:40:49.318795 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":71,"threads_started":1}
I20260807 22:40:49.319324 654 tablet_copy_service.cc:140] P 23677f8da61b48e59d3faf7ab7da7ea9: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 940825a01cf04921b576d61a33cb13dc ({username='oryx', principal='oryx/127.22.212.125@KRBTEST.COM'} at 127.0.0.1:58414)
I20260807 22:40:49.319427 654 tablet_copy_service.cc:161] P 23677f8da61b48e59d3faf7ab7da7ea9: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 940825a01cf04921b576d61a33cb13dc at {username='oryx', principal='oryx/127.22.212.125@KRBTEST.COM'} at 127.0.0.1:58414: session id = 940825a01cf04921b576d61a33cb13dc-00000000000000000000000000000000
I20260807 22:40:49.320047 654 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 22:40:49.320786 1334 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260807 22:40:49.321720 1334 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc: tablet copy: Starting download of 0 data blocks...
I20260807 22:40:49.321897 1334 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc: tablet copy: Starting download of 1 WAL segments...
I20260807 22:40:49.322839 1334 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 22:40:49.323628 654 tablet_copy_service.cc:342] P 23677f8da61b48e59d3faf7ab7da7ea9: Request end of tablet copy session 940825a01cf04921b576d61a33cb13dc-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.22.212.125@KRBTEST.COM'} at 127.0.0.1:58414
I20260807 22:40:49.323694 654 tablet_copy_service.cc:433] P 23677f8da61b48e59d3faf7ab7da7ea9: ending tablet copy session 940825a01cf04921b576d61a33cb13dc-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 940825a01cf04921b576d61a33cb13dc
I20260807 22:40:49.326174 1334 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:49.327371 1496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:49.327405 1498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:49.327540 1334 server_base.cc:1034] running on GCE node
W20260807 22:40:49.327596 1500 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:49.327706 1334 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:49.327877 1334 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:49.329005 1334 hybrid_clock.cc:648] HybridClock initialized: now 1786142449328996 us; error 27 us; skew 500 ppm
Aug 07 22:40:49 dist-test-slave-2d19 krb5kdc[553](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142449, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.212.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:49.330410 1334 init.cc:377] Logged in from keytab as oryx/127.22.212.125@KRBTEST.COM (short username oryx)
I20260807 22:40:49.330681 1334 webserver.cc:460] Webserver started at http://127.22.212.125:39839/ using document root <none> and password file <none>
I20260807 22:40:49.330802 1334 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:49.330840 1334 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:49.331550 1334 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260807 22:40:49.332162 1509 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:49.332319 1334 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:49.332377 1334 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-1/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-1/wal
uuid: "940825a01cf04921b576d61a33cb13dc"
format_stamp: "Formatted at 2026-08-07 22:40:49 on dist-test-slave-2d19"
server_key: "a03502ebf65dd0f56c370ef5011389aa"
server_key_iv: "0dad2b974cc23ec1c7efde0c823cce0f"
server_key_version: "encryptionkey@0"
I20260807 22:40:49.332438 1334 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:49.347463 1334 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:49.349251 1334 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:49.352496 1334 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.125:41083
I20260807 22:40:49.352769 1595 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.125:41083 every 8 connection(s)
I20260807 22:40:49.352896 1334 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-1/data/info.pb
I20260807 22:40:49.353720 1596 sys_catalog.cc:263] Verifying existing consensus state
I20260807 22:40:49.354149 1596 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc: Bootstrap starting.
I20260807 22:40:49.356660 1596 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 22:40:49.356963 1596 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc: Bootstrap complete.
I20260807 22:40:49.357163 1596 raft_consensus.cc:348] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: NON_VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: true } }
I20260807 22:40:49.357254 1596 raft_consensus.cc:729] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 940825a01cf04921b576d61a33cb13dc, State: Initialized, Role: LEARNER
I20260807 22:40:49.357311 1596 consensus_queue.cc:260] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: NON_VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: true } }
I20260807 22:40:49.357483 1596 sys_catalog.cc:564] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:40:49.357467 1599 sys_catalog.cc:455] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: NON_VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: true } } }
I20260807 22:40:49.357573 1599 sys_catalog.cc:458] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [sys.catalog]: This master's current role is: LEARNER
I20260807 22:40:49.358947 1613 catalog_manager.cc:1259] Loaded cluster ID: aa01039e82474ddaafdc8d1334a2a8c8
I20260807 22:40:49.359021 1613 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc: loading cluster ID for follower catalog manager: success
I20260807 22:40:49.359977 1613 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc: acquiring CA information for follower catalog manager: success
I20260807 22:40:49.360337 1613 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 22:40:49.378125 1615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.371260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44900 (local address 127.22.212.125:41083)
0807 22:40:49.371412 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:49.371414 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:49.371425 (+ 11us) server_negotiation.cc:407] Connection header received
0807 22:40:49.371455 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:49.371456 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:49.371464 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:49.371573 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:49.372186 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.372903 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.373615 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.373828 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.373907 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.375203 (+ 1296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:49.375205 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:49.375205 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:49.375213 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:49.376796 (+ 1583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.377184 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.377185 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.377186 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.377274 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.377599 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.377599 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.377600 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.377712 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:49.377791 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:49.377969 (+ 178us) server_negotiation.cc:299] Negotiation successful
0807 22:40:49.378043 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":76,"threads_started":1}
WARNING: no policy specified for oryx/127.22.212.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.212.124@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.212.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.124.keytab.
Entry for principal oryx/127.22.212.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.124.keytab.
I20260807 22:40:49.411523 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.124:37321
--webserver_interface=127.22.212.124
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.124.keytab
--principal=oryx/127.22.212.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:41831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:43419,127.22.212.125:41083,127.22.212.124:37321
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:49.503171 1618 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:49.503376 1618 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:49.503429 1618 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:49.504694 1618 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:40:49.504734 1618 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:49.504750 1618 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:49.504791 1618 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:40:49.504808 1618 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:40:49.506309 1618 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:41831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:43419,127.22.212.125:41083,127.22.212.124:37321
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.124.keytab
--principal=oryx/127.22.212.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.124:37321
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.22.212.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1618
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:49.506578 1618 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:49.506832 1618 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:49.511827 1631 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:49.511845 1627 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:49.511839 1628 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:49.512122 1618 server_base.cc:1034] running on GCE node
I20260807 22:40:49.512398 1618 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:49.512696 1618 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:49.513870 1618 hybrid_clock.cc:648] HybridClock initialized: now 1786142449513841 us; error 64 us; skew 500 ppm
Aug 07 22:40:49 dist-test-slave-2d19 krb5kdc[553](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142449, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.212.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:49.516450 1618 init.cc:377] Logged in from keytab as oryx/127.22.212.124@KRBTEST.COM (short username oryx)
I20260807 22:40:49.516942 1618 webserver.cc:460] Webserver started at http://127.22.212.124:43455/ using document root <none> and password file <none>
I20260807 22:40:49.517208 1618 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:49.517282 1618 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:49.517445 1618 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:49.518602 1618 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-2/data/instance:
uuid: "29971711a8104e688dc096f5f926330c"
format_stamp: "Formatted at 2026-08-07 22:40:49 on dist-test-slave-2d19"
server_key: "09fa53de9e958f02e2347637701e7de3"
server_key_iv: "3d3331be30cd821cdf7f9561af8232e8"
server_key_version: "encryptionkey@0"
I20260807 22:40:49.518977 1618 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-2/wal/instance:
uuid: "29971711a8104e688dc096f5f926330c"
format_stamp: "Formatted at 2026-08-07 22:40:49 on dist-test-slave-2d19"
server_key: "09fa53de9e958f02e2347637701e7de3"
server_key_iv: "3d3331be30cd821cdf7f9561af8232e8"
server_key_version: "encryptionkey@0"
I20260807 22:40:49.520390 1618 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 22:40:49.521152 1641 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:49.521328 1618 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 22:40:49.521443 1618 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-2/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-2/wal
uuid: "29971711a8104e688dc096f5f926330c"
format_stamp: "Formatted at 2026-08-07 22:40:49 on dist-test-slave-2d19"
server_key: "09fa53de9e958f02e2347637701e7de3"
server_key_iv: "3d3331be30cd821cdf7f9561af8232e8"
server_key_version: "encryptionkey@0"
I20260807 22:40:49.521544 1618 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:49.535459 1618 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:49.537269 1618 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:49.537432 1618 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:49.541646 1618 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.124:37321
I20260807 22:40:49.541675 1711 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.124:37321 every 8 connection(s)
I20260807 22:40:49.542017 1618 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-2/data/info.pb
I20260807 22:40:49.543038 1712 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:49.544634 1712 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:40:49.548316 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 1618
Aug 07 22:40:49 dist-test-slave-2d19 krb5kdc[553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142449, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.212.124@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM
Aug 07 22:40:49 dist-test-slave-2d19 krb5kdc[553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142448, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.22.212.124@KRBTEST.COM
I20260807 22:40:49.554623 676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.545481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58418 (local address 127.22.212.126:43419)
0807 22:40:49.545549 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:49.545552 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:49.545681 (+ 129us) server_negotiation.cc:407] Connection header received
0807 22:40:49.546189 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:49.546191 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:49.546204 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:49.546312 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:49.547002 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.547519 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.548613 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.548961 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.549042 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.551577 (+ 2535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:49.551578 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:49.551578 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:49.551587 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:49.553209 (+ 1622us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.553629 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.553631 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.553631 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.553689 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.553951 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.553952 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.553952 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.554078 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:49.554155 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:49.554451 (+ 296us) server_negotiation.cc:299] Negotiation successful
0807 22:40:49.554533 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 22:40:49.554836 1714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.545331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.0.0.1:58418)
0807 22:40:49.545545 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:49.545598 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:49.546073 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:49.546372 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:49.546376 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:49.546624 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:49.546827 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.546831 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.547617 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.547618 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.548508 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.548511 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.549134 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.549136 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.549281 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.549852 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:49.549860 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:49.551471 (+ 1611us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:49.553311 (+ 1840us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:49.553319 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:49.553322 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:49.553551 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:49.553765 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:49.553766 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:49.553766 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:49.553880 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:49.554146 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:49.554153 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:49.554310 (+ 157us) client_negotiation.cc:769] Sending connection context
0807 22:40:49.554428 (+ 118us) client_negotiation.cc:240] Negotiation successful
0807 22:40:49.554588 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":111,"threads_started":1}
I20260807 22:40:49.555419 1712 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.212.125" port: 41083 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:40:49.558041 1715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.548997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57730 (local address 127.22.212.124:37321)
0807 22:40:49.549201 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:49.549206 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:49.549224 (+ 18us) server_negotiation.cc:407] Connection header received
0807 22:40:49.549244 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:49.549246 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:49.549265 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:49.549337 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:49.549954 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.550870 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.551670 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.552107 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.552207 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.554628 (+ 2421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:49.554636 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:49.554636 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:49.554643 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:49.556642 (+ 1999us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.557060 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.557079 (+ 19us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.557079 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.557146 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.557406 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.557407 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.557407 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.557546 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:49.557738 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:49.557838 (+ 100us) server_negotiation.cc:299] Negotiation successful
0807 22:40:49.557934 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":85,"threads_started":1}
Aug 07 22:40:49 dist-test-slave-2d19 krb5kdc[553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142449, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.212.124@KRBTEST.COM for oryx/127.22.212.125@KRBTEST.COM
I20260807 22:40:49.562459 1615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.555794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44914 (local address 127.22.212.125:41083)
0807 22:40:49.555839 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:49.555841 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:49.555849 (+ 8us) server_negotiation.cc:407] Connection header received
0807 22:40:49.555877 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:49.555878 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:49.555897 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:49.555942 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:49.556294 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.556769 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.557694 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.558010 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.558086 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.560068 (+ 1982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:49.560069 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:49.560069 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:49.560076 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:49.561467 (+ 1391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.561752 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.561753 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.561753 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.561803 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.562021 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.562021 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.562021 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.562111 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:49.562156 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:49.562333 (+ 177us) server_negotiation.cc:299] Negotiation successful
0807 22:40:49.562399 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 22:40:49.562463 1714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.555695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.125:41083 (local address 127.0.0.1:44914)
0807 22:40:49.555751 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:49.555762 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:49.555805 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:49.555966 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:49.555967 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:49.556134 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:49.556171 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.556173 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.556842 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.556843 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.557566 (+ 723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.557568 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.558083 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.558084 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.558331 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.558785 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:49.558790 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:49.559993 (+ 1203us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:49.561540 (+ 1547us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:49.561540 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:49.561541 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:49.561688 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:49.561886 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:49.561887 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:49.561888 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:49.561958 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:49.562198 (+ 240us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:49.562199 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:49.562240 (+ 41us) client_negotiation.cc:769] Sending connection context
0807 22:40:49.562315 (+ 75us) client_negotiation.cc:240] Negotiation successful
0807 22:40:49.562394 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260807 22:40:49.562966 1712 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37321 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 22:40:49 dist-test-slave-2d19 krb5kdc[553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142449, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.212.124@KRBTEST.COM for oryx/127.22.212.124@KRBTEST.COM
I20260807 22:40:49.568866 1714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.563243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:37321 (local address 127.0.0.1:57746)
0807 22:40:49.563293 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:49.563304 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:49.563341 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:49.563435 (+ 94us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:49.563436 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:49.563545 (+ 109us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:49.563573 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.563574 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.564148 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.564149 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.564682 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.564684 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.565042 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.565043 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.565085 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.565413 (+ 328us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:49.565416 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:49.566578 (+ 1162us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:49.567852 (+ 1274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:49.567853 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:49.567853 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:49.568012 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:49.568227 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:49.568228 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:49.568229 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:49.568356 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:49.568600 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:49.568600 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:49.568636 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 22:40:49.568689 (+ 53us) client_negotiation.cc:240] Negotiation successful
0807 22:40:49.568773 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260807 22:40:49.568910 1715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.563293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57746 (local address 127.22.212.124:37321)
0807 22:40:49.563346 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:49.563348 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:49.563357 (+ 9us) server_negotiation.cc:407] Connection header received
0807 22:40:49.563380 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:49.563380 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:49.563388 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:49.563433 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:49.563628 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.564077 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.564753 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.564950 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.565004 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.566655 (+ 1651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:49.566656 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:49.566656 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:49.566662 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:49.567780 (+ 1118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.568087 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.568088 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.568088 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.568137 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.568437 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.568438 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.568438 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.568535 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:49.568590 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:49.568705 (+ 115us) server_negotiation.cc:299] Negotiation successful
0807 22:40:49.568816 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":54,"server-negotiator.queue_time_us":39}
I20260807 22:40:49.570295 1712 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c: Bootstrap starting.
I20260807 22:40:49.571177 1712 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:49.571499 1712 log.cc:824] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:49.572363 1712 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c: No bootstrap required, opened a new log
I20260807 22:40:49.573915 1712 raft_consensus.cc:348] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 41083 } } peers { permanent_uuid: "29971711a8104e688dc096f5f926330c" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37321 } }
I20260807 22:40:49.574067 1712 raft_consensus.cc:374] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:49.574119 1712 raft_consensus.cc:729] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29971711a8104e688dc096f5f926330c, State: Initialized, Role: FOLLOWER
I20260807 22:40:49.574275 1712 consensus_queue.cc:260] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 41083 } } peers { permanent_uuid: "29971711a8104e688dc096f5f926330c" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37321 } }
I20260807 22:40:49.574651 1712 sys_catalog.cc:564] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:40:49.574595 1718 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 41083 } } peers { permanent_uuid: "29971711a8104e688dc096f5f926330c" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37321 } } }
I20260807 22:40:49.574715 1718 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [sys.catalog]: This master's current role is: FOLLOWER
W20260807 22:40:49.576558 1733 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:40:49.576620 1733 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:40:49.579071 1618 master_runner.cc:428] Detected that this master 29971711a8104e688dc096f5f926330c is joining an existing cluster
I20260807 22:40:49.579142 1618 master_runner.cc:432] Initiating AddMaster RPC to add 127.22.212.124:37321
I20260807 22:40:49.587288 1745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.580501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:37321 (local address 127.0.0.1:57762)
0807 22:40:49.580812 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:49.580823 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:49.580886 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:49.581060 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:49.581061 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:49.581350 (+ 289us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:49.581421 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.581422 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.582328 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.582328 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.583215 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.583218 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.583681 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.583681 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.583734 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.584341 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:49.584346 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:49.584673 (+ 327us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:49.586185 (+ 1512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:49.586185 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:49.586186 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:49.586354 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:49.586574 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:49.586575 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:49.586575 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:49.586631 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:49.586888 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:49.586888 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:49.586927 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 22:40:49.587031 (+ 104us) client_negotiation.cc:240] Negotiation successful
0807 22:40:49.587140 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":97,"threads_started":1}
I20260807 22:40:49.587304 1715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.580688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57762 (local address 127.22.212.124:37321)
0807 22:40:49.580723 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:49.580724 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:49.580889 (+ 165us) server_negotiation.cc:407] Connection header received
0807 22:40:49.580961 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:49.580962 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:49.580970 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:49.581024 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:49.581502 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.582248 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.583307 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.583568 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.583604 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.584785 (+ 1181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:49.584786 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:49.584787 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:49.584793 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:49.586086 (+ 1293us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.586439 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.586440 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.586441 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.586500 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.586703 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.586704 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.586704 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.586814 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:49.586890 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:49.587055 (+ 165us) server_negotiation.cc:299] Negotiation successful
0807 22:40:49.587206 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":87,"server-negotiator.queue_time_us":17}
I20260807 22:40:49.600920 1615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.580525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44918 (local address 127.22.212.125:41083)
0807 22:40:49.580590 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:49.580592 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:49.581130 (+ 538us) server_negotiation.cc:407] Connection header received
0807 22:40:49.581227 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:49.581228 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:49.581238 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:49.581268 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:49.581682 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.582384 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.583449 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.583754 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.583794 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.597548 (+ 13754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:49.597550 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:49.597550 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:49.597560 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:49.599494 (+ 1934us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.600029 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.600031 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.600031 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.600097 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.600338 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.600340 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.600340 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.600500 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:49.600584 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:49.600744 (+ 160us) server_negotiation.cc:299] Negotiation successful
0807 22:40:49.600824 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 22:40:49.601006 676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.580496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58420 (local address 127.22.212.126:43419)
0807 22:40:49.580598 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:49.580600 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:49.580918 (+ 318us) server_negotiation.cc:407] Connection header received
0807 22:40:49.580945 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:49.580946 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:49.580958 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:49.581014 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:49.581495 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.582285 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.583465 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.583773 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.583816 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.597596 (+ 13780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:49.597598 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:49.597598 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:49.597608 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:49.599591 (+ 1983us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.600026 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.600027 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.600027 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.600089 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.600374 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.600375 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.600376 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.600564 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:49.600633 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:49.600822 (+ 189us) server_negotiation.cc:299] Negotiation successful
0807 22:40:49.600908 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260807 22:40:49.600945 1748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.580675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.125:41083 (local address 127.0.0.1:44918)
0807 22:40:49.581067 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:49.581077 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:49.581155 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:49.581337 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:49.581337 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:49.581549 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:49.581596 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.581598 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.582466 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.582467 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.583368 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.583369 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.583874 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.583875 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.583935 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.596982 (+ 13047us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:49.596987 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:49.597416 (+ 429us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:49.599600 (+ 2184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:49.599602 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:49.599603 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:49.599925 (+ 322us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:49.600171 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:49.600172 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:49.600172 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:49.600277 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:49.600574 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:49.600575 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:49.600623 (+ 48us) client_negotiation.cc:769] Sending connection context
0807 22:40:49.600704 (+ 81us) client_negotiation.cc:240] Negotiation successful
0807 22:40:49.600824 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":376,"mutex_wait_us":32,"thread_start_us":81,"threads_started":1}
I20260807 22:40:49.601352 1744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.580667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.0.0.1:58420)
0807 22:40:49.580814 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:49.580824 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:49.580890 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:49.581018 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:49.581018 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:49.581316 (+ 298us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:49.581394 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.581396 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.582406 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.582407 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.583360 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.583363 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.583897 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.583898 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.583958 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.596912 (+ 12954us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:49.596917 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:49.597443 (+ 526us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:49.599664 (+ 2221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:49.599665 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:49.599666 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:49.599934 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:49.600172 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:49.600173 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:49.600173 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:49.600311 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:49.600662 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:49.600663 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:49.600707 (+ 44us) client_negotiation.cc:769] Sending connection context
0807 22:40:49.601125 (+ 418us) client_negotiation.cc:240] Negotiation successful
0807 22:40:49.601241 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"mutex_wait_us":5,"thread_start_us":72,"threads_started":1}
Aug 07 22:40:49 dist-test-slave-2d19 krb5kdc[553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142448, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.212.126@KRBTEST.COM for oryx/127.22.212.124@KRBTEST.COM
I20260807 22:40:49.609488 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 713
I20260807 22:40:49.610438 1478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.603426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:37321 (local address 127.0.0.1:57772)
0807 22:40:49.603478 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:49.603488 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:49.603526 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:49.603663 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:49.603664 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:49.603816 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:49.603856 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.603857 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.604609 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.604610 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.605149 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.605151 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.605523 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.605524 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.605600 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.606042 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:49.606046 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:49.607430 (+ 1384us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:49.609209 (+ 1779us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:49.609210 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:49.609211 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:49.609417 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:49.609650 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:49.609651 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:49.609651 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:49.609723 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:49.610007 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:49.610009 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:49.610057 (+ 48us) client_negotiation.cc:769] Sending connection context
0807 22:40:49.610137 (+ 80us) client_negotiation.cc:240] Negotiation successful
0807 22:40:49.610274 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260807 22:40:49.610849 1715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.603483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57772 (local address 127.22.212.124:37321)
0807 22:40:49.603526 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:49.603528 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:49.603536 (+ 8us) server_negotiation.cc:407] Connection header received
0807 22:40:49.603592 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:49.603593 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:49.603602 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:49.603659 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:49.603934 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.604522 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.605237 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.605430 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.605522 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.607518 (+ 1996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:49.607520 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:49.607520 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:49.607528 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:49.609111 (+ 1583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.609487 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.609488 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.609488 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.609561 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.609788 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.609789 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.609789 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.609928 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:49.609984 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:49.610611 (+ 627us) server_negotiation.cc:299] Negotiation successful
0807 22:40:49.610707 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 22:40:49.622200 618 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.22.212.124:37321: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "29971711a8104e688dc096f5f926330c"
member_type: NON_VOTER
last_known_addr {
host: "127.22.212.124"
port: 37321
}
attrs {
promote: true
}
}
dest_uuid: "23677f8da61b48e59d3faf7ab7da7ea9"
cas_config_opid_index: 5
I20260807 22:40:49.622495 618 consensus_queue.cc:237] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: NON_VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: true } } peers { permanent_uuid: "29971711a8104e688dc096f5f926330c" member_type: NON_VOTER last_known_addr { host: "127.22.212.124" port: 37321 } attrs { promote: true } }
I20260807 22:40:49.623080 1481 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 29971711a8104e688dc096f5f926330c (127.22.212.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: NON_VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: true } } peers { permanent_uuid: "29971711a8104e688dc096f5f926330c" member_type: NON_VOTER last_known_addr { host: "127.22.212.124" port: 37321 } attrs { promote: true } } }
I20260807 22:40:49.624150 1481 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.22.212.124:37321
I20260807 22:40:49.624222 1481 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: NON_VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: true } } peers { permanent_uuid: "29971711a8104e688dc096f5f926330c" member_type: NON_VOTER last_known_addr { host: "127.22.212.124" port: 37321 } attrs { promote: true } } }
I20260807 22:40:49.624315 1481 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:49.624707 1618 master.cc:537] Master@127.22.212.124:37321 shutting down...
I20260807 22:40:49.624891 1678 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:49.626114 1678 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [term 1 FOLLOWER]: Refusing update from remote peer 23677f8da61b48e59d3faf7ab7da7ea9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 22:40:49.626588 1481 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29971711a8104e688dc096f5f926330c" member_type: NON_VOTER last_known_addr { host: "127.22.212.124" port: 37321 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:40:49.629285 1615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.623112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44920 (local address 127.22.212.125:41083)
0807 22:40:49.623159 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:49.623162 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:49.624463 (+ 1301us) server_negotiation.cc:407] Connection header received
0807 22:40:49.624496 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:49.624498 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:49.624535 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:49.624607 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:49.625397 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.626177 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.628149 (+ 1972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.628763 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.628848 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.628930 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:49.629122 (+ 192us) server_negotiation.cc:299] Negotiation successful
0807 22:40:49.629192 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 22:40:49.629865 1478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.623027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.125:41083 (local address 127.0.0.1:44920)
0807 22:40:49.624325 (+ 1298us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:49.624338 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:49.624396 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:49.625250 (+ 854us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:49.625252 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:49.625254 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:49.625305 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.625307 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.626913 (+ 1606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.626915 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.628037 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.628040 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.628867 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.628868 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.628970 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.629017 (+ 47us) client_negotiation.cc:769] Sending connection context
0807 22:40:49.629702 (+ 685us) client_negotiation.cc:240] Negotiation successful
0807 22:40:49.629777 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1279}
I20260807 22:40:49.630165 1550 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [term 1 LEARNER]: Refusing update from remote peer 23677f8da61b48e59d3faf7ab7da7ea9: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 22:40:49.630409 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.65:39385
--local_ip_for_outbound_sockets=127.22.212.65
--tserver_master_addrs=127.22.212.126:43419
--webserver_port=41801
--webserver_interface=127.22.212.65
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.65.keytab
--principal=oryx/127.22.212.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:41831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.22.212.126:43419,127.22.212.125:41083
--tserver_master_addrs=127.22.212.126:43419,127.22.212.125:41083,127.22.212.124:37321 with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:40:49.630486 1481 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: NON_VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 22:40:49.631081 1550 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 29971711a8104e688dc096f5f926330c (127.22.212.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: NON_VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: true } } peers { permanent_uuid: "29971711a8104e688dc096f5f926330c" member_type: NON_VOTER last_known_addr { host: "127.22.212.124" port: 37321 } attrs { promote: true } } }
I20260807 22:40:49.632395 1599 sys_catalog.cc:455] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23677f8da61b48e59d3faf7ab7da7ea9. Latest consensus state: current_term: 1 leader_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: NON_VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: true } } peers { permanent_uuid: "29971711a8104e688dc096f5f926330c" member_type: NON_VOTER last_known_addr { host: "127.22.212.124" port: 37321 } attrs { promote: true } } }
I20260807 22:40:49.632485 1599 sys_catalog.cc:458] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [sys.catalog]: This master's current role is: LEARNER
I20260807 22:40:49.632519 1599 sys_catalog.cc:455] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: NON_VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: true } } peers { permanent_uuid: "29971711a8104e688dc096f5f926330c" member_type: NON_VOTER last_known_addr { host: "127.22.212.124" port: 37321 } attrs { promote: true } } }
I20260807 22:40:49.632584 1599 sys_catalog.cc:458] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [sys.catalog]: This master's current role is: LEARNER
I20260807 22:40:49.632879 1481 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9: attempting to promote NON_VOTER 940825a01cf04921b576d61a33cb13dc to VOTER
I20260807 22:40:49.633091 1481 consensus_queue.cc:237] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: false } } peers { permanent_uuid: "29971711a8104e688dc096f5f926330c" member_type: NON_VOTER last_known_addr { host: "127.22.212.124" port: 37321 } attrs { promote: true } }
I20260807 22:40:49.633630 1550 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [term 1 LEARNER]: Refusing update from remote peer 23677f8da61b48e59d3faf7ab7da7ea9: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
W20260807 22:40:49.633776 597 consensus_peers.cc:487] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 -> Peer 29971711a8104e688dc096f5f926330c (127.22.212.124:37321): Couldn't send request to peer 29971711a8104e688dc096f5f926330c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260807 22:40:49.633801 1479 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 22:40:49.633996 1618 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:40:49.634096 1618 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:49.634147 1618 tablet_replica.cc:330] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c: stopping tablet replica
I20260807 22:40:49.634405 1479 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 940825a01cf04921b576d61a33cb13dc (127.22.212.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: false } } peers { permanent_uuid: "29971711a8104e688dc096f5f926330c" member_type: NON_VOTER last_known_addr { host: "127.22.212.124" port: 37321 } attrs { promote: true } } }
I20260807 22:40:49.635365 1550 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 940825a01cf04921b576d61a33cb13dc (127.22.212.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: false } } peers { permanent_uuid: "29971711a8104e688dc096f5f926330c" member_type: NON_VOTER last_known_addr { host: "127.22.212.124" port: 37321 } attrs { promote: true } } }
I20260807 22:40:49.635408 1479 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: false } } peers { permanent_uuid: "29971711a8104e688dc096f5f926330c" member_type: NON_VOTER last_known_addr { host: "127.22.212.124" port: 37321 } attrs { promote: true } } }
I20260807 22:40:49.635473 1479 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:49.635525 1479 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: false } } peers { permanent_uuid: "29971711a8104e688dc096f5f926330c" member_type: NON_VOTER last_known_addr { host: "127.22.212.124" port: 37321 } attrs { promote: true } } }
I20260807 22:40:49.635581 1479 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:49.636579 1752 sys_catalog.cc:455] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: false } } peers { permanent_uuid: "29971711a8104e688dc096f5f926330c" member_type: NON_VOTER last_known_addr { host: "127.22.212.124" port: 37321 } attrs { promote: true } } }
I20260807 22:40:49.636936 1752 sys_catalog.cc:458] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:40:49.647931 1618 master.cc:552] Master@127.22.212.124:37321 shutdown complete.
I20260807 22:40:49.647989 1618 master_runner.cc:305] Clearing existing system tablet
I20260807 22:40:49.648128 1618 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:49.648175 1618 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:49.648984 1618 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260807 22:40:49.649591 1761 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:49.649731 1618 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:49.649782 1618 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:49.649803 1618 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-2/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-2/wal
uuid: "29971711a8104e688dc096f5f926330c"
format_stamp: "Formatted at 2026-08-07 22:40:49 on dist-test-slave-2d19"
server_key: "09fa53de9e958f02e2347637701e7de3"
server_key_iv: "3d3331be30cd821cdf7f9561af8232e8"
server_key_version: "encryptionkey@0"
I20260807 22:40:49.650604 1618 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:49.652130 1618 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260807 22:40:49.652271 1618 log.cc:1196] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260807 22:40:49.652503 1618 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c: Deleting consensus metadata
I20260807 22:40:49.652638 1618 master_runner.cc:315] Copying system tablet from 127.22.212.126:43419
I20260807 22:40:49.653245 1618 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c: tablet copy: Beginning tablet copy session from remote peer at address 127.22.212.126:43419
I20260807 22:40:49.661082 1769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.653546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.0.0.1:58428)
0807 22:40:49.653694 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:49.653707 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:49.653776 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:49.653925 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:49.653926 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:49.654129 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:49.654183 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.654186 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.655121 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.655122 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.655943 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.655946 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.656465 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.656466 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.656532 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.657140 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:49.657145 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:49.657609 (+ 464us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:49.659868 (+ 2259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:49.659869 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:49.659869 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:49.660084 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:49.660374 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:49.660375 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:49.660375 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:49.660444 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:49.660750 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:49.660751 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:49.660800 (+ 49us) client_negotiation.cc:769] Sending connection context
0807 22:40:49.660873 (+ 73us) client_negotiation.cc:240] Negotiation successful
0807 22:40:49.660983 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":80,"threads_started":1}
I20260807 22:40:49.661104 676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.653733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58428 (local address 127.22.212.126:43419)
0807 22:40:49.653784 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:49.653786 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:49.653798 (+ 12us) server_negotiation.cc:407] Connection header received
0807 22:40:49.653829 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:49.653830 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:49.653841 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:49.653907 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:49.654279 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.655023 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.656050 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.656378 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.656459 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.657701 (+ 1242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:49.657703 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:49.657703 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:49.657711 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:49.659778 (+ 2067us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.660193 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.660195 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.660195 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.660295 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.660514 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.660515 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.660516 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.660672 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:49.660750 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:49.660920 (+ 170us) server_negotiation.cc:299] Negotiation successful
0807 22:40:49.661009 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260807 22:40:49.661674 654 tablet_copy_service.cc:140] P 23677f8da61b48e59d3faf7ab7da7ea9: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 29971711a8104e688dc096f5f926330c ({username='oryx', principal='oryx/127.22.212.124@KRBTEST.COM'} at 127.0.0.1:58428)
I20260807 22:40:49.661731 654 tablet_copy_service.cc:161] P 23677f8da61b48e59d3faf7ab7da7ea9: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 29971711a8104e688dc096f5f926330c at {username='oryx', principal='oryx/127.22.212.124@KRBTEST.COM'} at 127.0.0.1:58428: session id = 29971711a8104e688dc096f5f926330c-00000000000000000000000000000000
I20260807 22:40:49.662338 654 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 22:40:49.662843 1618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260807 22:40:49.664134 1618 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c: tablet copy: Starting download of 0 data blocks...
I20260807 22:40:49.664340 1618 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c: tablet copy: Starting download of 1 WAL segments...
I20260807 22:40:49.665331 1618 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 22:40:49.666303 654 tablet_copy_service.cc:342] P 23677f8da61b48e59d3faf7ab7da7ea9: Request end of tablet copy session 29971711a8104e688dc096f5f926330c-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.22.212.124@KRBTEST.COM'} at 127.0.0.1:58428
I20260807 22:40:49.666363 654 tablet_copy_service.cc:433] P 23677f8da61b48e59d3faf7ab7da7ea9: ending tablet copy session 29971711a8104e688dc096f5f926330c-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 29971711a8104e688dc096f5f926330c
I20260807 22:40:49.669875 1618 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:49.671208 1770 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:49.673146 1771 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:49.673504 1773 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:49.677233 1618 server_base.cc:1034] running on GCE node
I20260807 22:40:49.677364 1618 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:49.677531 1618 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:49.678704 1618 hybrid_clock.cc:648] HybridClock initialized: now 1786142449678680 us; error 42 us; skew 500 ppm
Aug 07 22:40:49 dist-test-slave-2d19 krb5kdc[553](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142449, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.212.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:49.680512 1618 init.cc:377] Logged in from keytab as oryx/127.22.212.124@KRBTEST.COM (short username oryx)
I20260807 22:40:49.680795 1618 webserver.cc:460] Webserver started at http://127.22.212.124:42489/ using document root <none> and password file <none>
I20260807 22:40:49.680918 1618 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:49.680955 1618 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:49.681813 1618 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:40:49.682452 1781 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:49.682651 1618 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:40:49.682709 1618 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-2/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-2/wal
uuid: "29971711a8104e688dc096f5f926330c"
format_stamp: "Formatted at 2026-08-07 22:40:49 on dist-test-slave-2d19"
server_key: "09fa53de9e958f02e2347637701e7de3"
server_key_iv: "3d3331be30cd821cdf7f9561af8232e8"
server_key_version: "encryptionkey@0"
I20260807 22:40:49.682773 1618 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:49.711125 1618 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:49.713239 1618 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:49.716651 1618 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.124:37321
I20260807 22:40:49.716697 1851 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.124:37321 every 8 connection(s)
I20260807 22:40:49.717041 1618 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/master-2/data/info.pb
I20260807 22:40:49.718081 1852 sys_catalog.cc:263] Verifying existing consensus state
I20260807 22:40:49.718632 1852 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c: Bootstrap starting.
I20260807 22:40:49.721837 1852 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 22:40:49.722075 1852 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c: Bootstrap complete.
I20260807 22:40:49.722294 1852 raft_consensus.cc:348] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: false } } peers { permanent_uuid: "29971711a8104e688dc096f5f926330c" member_type: NON_VOTER last_known_addr { host: "127.22.212.124" port: 37321 } attrs { promote: true } }
I20260807 22:40:49.722380 1852 raft_consensus.cc:729] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 29971711a8104e688dc096f5f926330c, State: Initialized, Role: LEARNER
I20260807 22:40:49.722414 1852 consensus_queue.cc:260] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: false } } peers { permanent_uuid: "29971711a8104e688dc096f5f926330c" member_type: NON_VOTER last_known_addr { host: "127.22.212.124" port: 37321 } attrs { promote: true } }
I20260807 22:40:49.722590 1852 sys_catalog.cc:564] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:40:49.722611 1860 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: false } } peers { permanent_uuid: "29971711a8104e688dc096f5f926330c" member_type: NON_VOTER last_known_addr { host: "127.22.212.124" port: 37321 } attrs { promote: true } } }
I20260807 22:40:49.722824 1860 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [sys.catalog]: This master's current role is: LEARNER
I20260807 22:40:49.724089 1873 catalog_manager.cc:1259] Loaded cluster ID: aa01039e82474ddaafdc8d1334a2a8c8
I20260807 22:40:49.724181 1873 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c: loading cluster ID for follower catalog manager: success
I20260807 22:40:49.725976 1873 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c: acquiring CA information for follower catalog manager: success
I20260807 22:40:49.726284 1873 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260807 22:40:49.738960 1751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:49.739169 1751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:49.739192 1751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:49.740449 1751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:49.740491 1751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:49.740518 1751 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.65
I20260807 22:40:49.742003 1751 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:41831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.65.keytab
--principal=oryx/127.22.212.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.65:39385
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.212.65
--webserver_port=41801
--tserver_master_addrs=127.22.212.126:43419,127.22.212.125:41083,127.22.212.124:37321
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1751
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.65
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:49.742262 1751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:49.742502 1751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:49.747978 1880 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:49.747964 1879 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:49.747964 1884 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:49.747993 1751 server_base.cc:1034] running on GCE node
I20260807 22:40:49.748404 1751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:49.748651 1751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:49.749827 1751 hybrid_clock.cc:648] HybridClock initialized: now 1786142449749812 us; error 28 us; skew 500 ppm
Aug 07 22:40:49 dist-test-slave-2d19 krb5kdc[553](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142449, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.212.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:49.752529 1751 init.cc:377] Logged in from keytab as oryx/127.22.212.65@KRBTEST.COM (short username oryx)
I20260807 22:40:49.752930 1751 webserver.cc:460] Webserver started at http://127.22.212.65:41801/ using document root <none> and password file <none>
I20260807 22:40:49.753150 1751 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:49.753206 1751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:49.754472 1751 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:40:49.755008 1892 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:49.755167 1751 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:49.755261 1751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-0/wal
uuid: "71378a822b0244288e2f95ad5e419c9a"
format_stamp: "Formatted at 2026-08-07 22:40:48 on dist-test-slave-2d19"
server_key: "74b6d25780a25116b407ea1c51fb4190"
server_key_iv: "6cadbe17274b25495f4139322aa4b6bb"
server_key_version: "encryptionkey@0"
I20260807 22:40:49.755601 1751 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:49.781678 1751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:49.783936 1751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:49.784062 1751 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:49.784273 1751 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:49.784608 1751 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:49.784644 1751 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:49.784689 1751 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:49.784715 1751 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:49.791216 1751 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.65:39385
I20260807 22:40:49.791263 2086 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.65:39385 every 8 connection(s)
I20260807 22:40:49.791633 1751 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
Aug 07 22:40:49 dist-test-slave-2d19 krb5kdc[553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142449, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.212.65@KRBTEST.COM for oryx/127.22.212.125@KRBTEST.COM
Aug 07 22:40:49 dist-test-slave-2d19 krb5kdc[553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142449, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.212.65@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM
I20260807 22:40:49.800331 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 1751
I20260807 22:40:49.800508 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 919
Aug 07 22:40:49 dist-test-slave-2d19 krb5kdc[553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142449, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.212.65@KRBTEST.COM for oryx/127.22.212.124@KRBTEST.COM
I20260807 22:40:49.812515 2098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.792420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:37321 (local address 127.22.212.65:44833)
0807 22:40:49.792606 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:49.792654 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:49.793747 (+ 1093us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:49.794151 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:49.794151 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:49.794485 (+ 334us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:49.794749 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.794755 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.797430 (+ 2675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.797431 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.798712 (+ 1281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.798715 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.799217 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.799217 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.799281 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.799747 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:49.799751 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:49.807668 (+ 7917us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:49.810322 (+ 2654us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:49.810338 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:49.810342 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:49.810810 (+ 468us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:49.811096 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:49.811097 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:49.811098 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:49.811347 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:49.811698 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:49.811706 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:49.811900 (+ 194us) client_negotiation.cc:769] Sending connection context
0807 22:40:49.811997 (+ 97us) client_negotiation.cc:240] Negotiation successful
0807 22:40:49.812204 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"mutex_wait_us":8,"thread_start_us":105,"threads_started":1}
I20260807 22:40:49.812999 2107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.792763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:44833 (local address 127.22.212.124:37321)
0807 22:40:49.792877 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:49.792879 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:49.792891 (+ 12us) server_negotiation.cc:407] Connection header received
0807 22:40:49.794042 (+ 1151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:49.794044 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:49.794057 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:49.794137 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:49.796358 (+ 2221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.797352 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.798797 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.799138 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.799213 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.807806 (+ 8593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:49.807808 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:49.807808 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:49.807817 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:49.810192 (+ 2375us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.810913 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.810915 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.810915 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.810990 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.811439 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.811441 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.811441 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.811613 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:49.811672 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:49.812771 (+ 1099us) server_negotiation.cc:299] Negotiation successful
0807 22:40:49.812868 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":52,"threads_started":1}
I20260807 22:40:49.813340 2087 heartbeater.cc:347] Connected to a master server at 127.22.212.124:37321
I20260807 22:40:49.813426 2087 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:49.813612 2087 heartbeater.cc:511] Master 127.22.212.124:37321 requested a full tablet report, sending...
I20260807 22:40:49.814070 1800 ts_manager.cc:194] Registered new tserver with Master: 71378a822b0244288e2f95ad5e419c9a (127.22.212.65:39385)
I20260807 22:40:49.817500 676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.792746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:49967 (local address 127.22.212.126:43419)
0807 22:40:49.792849 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:49.792851 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:49.793123 (+ 272us) server_negotiation.cc:407] Connection header received
0807 22:40:49.793868 (+ 745us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:49.793869 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:49.793882 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:49.793939 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:49.795463 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.796219 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.796985 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.797182 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.797259 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.800379 (+ 3120us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:49.800381 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:49.800381 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:49.800389 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:49.815327 (+ 14938us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.816711 (+ 1384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.816713 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.816713 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.816768 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.816934 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.816935 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.816935 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.817070 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:49.817112 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:49.817289 (+ 177us) server_negotiation.cc:299] Negotiation successful
0807 22:40:49.817373 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260807 22:40:49.817864 2104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.792484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.22.212.65:49967)
0807 22:40:49.793041 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:49.793048 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:49.793765 (+ 717us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:49.794051 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:49.794056 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:49.794517 (+ 461us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:49.794749 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.794755 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.796324 (+ 1569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.796325 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.796888 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.796889 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.797267 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.797269 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.797407 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.798093 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:49.798098 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:49.800240 (+ 2142us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:49.816407 (+ 16167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:49.816409 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:49.816409 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:49.816627 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:49.816829 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:49.816829 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:49.816829 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:49.816878 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:49.817153 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:49.817154 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:49.817193 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 22:40:49.817609 (+ 416us) client_negotiation.cc:240] Negotiation successful
0807 22:40:49.817717 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":545,"mutex_wait_us":46,"thread_start_us":87,"threads_started":1}
I20260807 22:40:49.818152 2090 heartbeater.cc:347] Connected to a master server at 127.22.212.126:43419
I20260807 22:40:49.818192 2090 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:49.818259 2090 heartbeater.cc:511] Master 127.22.212.126:43419 requested a full tablet report, sending...
I20260807 22:40:49.818468 618 ts_manager.cc:194] Re-registered known tserver with Master: 71378a822b0244288e2f95ad5e419c9a (127.22.212.65:39385)
I20260807 22:40:49.818908 618 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.22.212.65@KRBTEST.COM'} at 127.22.212.65:49967
I20260807 22:40:49.826373 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.66:38741
--local_ip_for_outbound_sockets=127.22.212.66
--tserver_master_addrs=127.22.212.126:43419
--webserver_port=44211
--webserver_interface=127.22.212.66
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.66.keytab
--principal=oryx/127.22.212.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:41831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.22.212.126:43419,127.22.212.125:41083
--tserver_master_addrs=127.22.212.126:43419,127.22.212.125:41083,127.22.212.124:37321 with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:40:49.826774 1615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.792797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:35837 (local address 127.22.212.125:41083)
0807 22:40:49.792849 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:49.792851 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:49.792993 (+ 142us) server_negotiation.cc:407] Connection header received
0807 22:40:49.793949 (+ 956us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:49.793950 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:49.793963 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:49.794017 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:49.794849 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.795340 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.796831 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.797135 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.797175 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.799817 (+ 2642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:49.799819 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:49.799819 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:49.799827 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:49.825447 (+ 25620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.825898 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.825900 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.825900 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.825955 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.826180 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.826181 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.826182 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.826346 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:49.826423 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:49.826633 (+ 210us) server_negotiation.cc:299] Negotiation successful
0807 22:40:49.826712 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 22:40:49.827158 2099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.792420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.125:41083 (local address 127.22.212.65:35837)
0807 22:40:49.792912 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:49.792929 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:49.793765 (+ 836us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:49.794054 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:49.794056 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:49.794504 (+ 448us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:49.794747 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.794752 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.795459 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.795460 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.796735 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.796737 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.797258 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.797259 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.797398 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.797988 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:49.797996 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:49.799717 (+ 1721us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:49.825554 (+ 25837us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:49.825556 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:49.825556 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:49.825824 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:49.826020 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:49.826021 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:49.826021 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:49.826111 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:49.826415 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:49.826416 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:49.826480 (+ 64us) client_negotiation.cc:769] Sending connection context
0807 22:40:49.826882 (+ 402us) client_negotiation.cc:240] Negotiation successful
0807 22:40:49.827015 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":466,"mutex_wait_us":35,"thread_start_us":104,"threads_started":1}
I20260807 22:40:49.827891 2094 heartbeater.cc:347] Connected to a master server at 127.22.212.125:41083
I20260807 22:40:49.827999 2094 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:49.828101 2094 heartbeater.cc:511] Master 127.22.212.125:41083 requested a full tablet report, sending...
I20260807 22:40:49.828724 1537 ts_manager.cc:194] Registered new tserver with Master: 71378a822b0244288e2f95ad5e419c9a (127.22.212.65:39385)
W20260807 22:40:49.910362 2108 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:49.910568 2108 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:49.910590 2108 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:49.911724 2108 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:49.911763 2108 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:49.911789 2108 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.66
I20260807 22:40:49.913251 2108 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:41831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.66.keytab
--principal=oryx/127.22.212.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.66:38741
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.212.66
--webserver_port=44211
--tserver_master_addrs=127.22.212.126:43419,127.22.212.125:41083,127.22.212.124:37321
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2108
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.66
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:49.913439 2108 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:49.913619 2108 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 22:40:49.919481 2108 server_base.cc:1034] running on GCE node
W20260807 22:40:49.919438 2117 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:49.919449 2114 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:49.919507 2115 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:49.919857 2108 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:49.920092 2108 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:49.921231 2108 hybrid_clock.cc:648] HybridClock initialized: now 1786142449921212 us; error 36 us; skew 500 ppm
Aug 07 22:40:49 dist-test-slave-2d19 krb5kdc[553](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142449, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.212.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:49.924116 2108 init.cc:377] Logged in from keytab as oryx/127.22.212.66@KRBTEST.COM (short username oryx)
I20260807 22:40:49.924580 2108 webserver.cc:460] Webserver started at http://127.22.212.66:44211/ using document root <none> and password file <none>
I20260807 22:40:49.924778 2108 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:49.924834 2108 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:49.926164 2108 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 22:40:49.926721 2126 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:49.926893 2108 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 22:40:49.927001 2108 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-1/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-1/wal
uuid: "bef2621d444d4e0c8c964fd8a5e4a9c9"
format_stamp: "Formatted at 2026-08-07 22:40:48 on dist-test-slave-2d19"
server_key: "9a07b8ff499200f37e2df95b3c053c24"
server_key_iv: "e2e1183c5a1e32eabf25b9b7ce03228b"
server_key_version: "encryptionkey@0"
I20260807 22:40:49.927353 2108 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:49.938460 2108 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:49.940821 2108 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:49.940984 2108 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:49.941220 2108 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:49.941550 2108 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:49.941610 2108 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:49.941653 2108 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:49.941681 2108 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:49.947808 2108 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.66:38741
I20260807 22:40:49.947865 2308 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.66:38741 every 8 connection(s)
I20260807 22:40:49.948215 2108 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
I20260807 22:40:49.952306 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 2108
I20260807 22:40:49.952473 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 1121
Aug 07 22:40:49 dist-test-slave-2d19 krb5kdc[553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142449, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.212.66@KRBTEST.COM for oryx/127.22.212.124@KRBTEST.COM
Aug 07 22:40:49 dist-test-slave-2d19 krb5kdc[553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142449, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.212.66@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM
Aug 07 22:40:49 dist-test-slave-2d19 krb5kdc[553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142449, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.212.66@KRBTEST.COM for oryx/127.22.212.125@KRBTEST.COM
I20260807 22:40:49.960477 2107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.949293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:44731 (local address 127.22.212.124:37321)
0807 22:40:49.949408 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:49.949410 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:49.949476 (+ 66us) server_negotiation.cc:407] Connection header received
0807 22:40:49.950337 (+ 861us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:49.950339 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:49.950355 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:49.950387 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:49.951207 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.951977 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.953225 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.953533 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.953577 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.956935 (+ 3358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:49.956937 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:49.956938 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:49.956945 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:49.958714 (+ 1769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.959225 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.959226 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.959227 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.959286 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.959648 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.959649 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.959650 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.959793 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:49.959837 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:49.960232 (+ 395us) server_negotiation.cc:299] Negotiation successful
0807 22:40:49.960355 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260807 22:40:49.961318 2318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.948987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:37321 (local address 127.22.212.66:44731)
0807 22:40:49.949421 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:49.949429 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:49.950235 (+ 806us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:49.950490 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:49.950495 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:49.950919 (+ 424us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:49.951092 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.951099 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.952101 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.952101 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.953117 (+ 1016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.953120 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.953672 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.953673 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.953812 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.954493 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:49.954501 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:49.956818 (+ 2317us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:49.958804 (+ 1986us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:49.958814 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:49.958816 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:49.959124 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:49.959374 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:49.959375 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:49.959375 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:49.959514 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:49.959888 (+ 374us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:49.959895 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:49.960066 (+ 171us) client_negotiation.cc:769] Sending connection context
0807 22:40:49.960855 (+ 789us) client_negotiation.cc:240] Negotiation successful
0807 22:40:49.961042 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":411,"mutex_wait_us":73,"spinlock_wait_cycles":7424,"thread_start_us":132,"threads_started":1}
I20260807 22:40:49.962036 2310 heartbeater.cc:347] Connected to a master server at 127.22.212.124:37321
I20260807 22:40:49.962105 676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.949356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:57109 (local address 127.22.212.126:43419)
0807 22:40:49.949442 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:49.949444 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:49.949453 (+ 9us) server_negotiation.cc:407] Connection header received
0807 22:40:49.950338 (+ 885us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:49.950339 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:49.950351 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:49.950386 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:49.951206 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.951988 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.953226 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.953536 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.953577 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.957786 (+ 4209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:49.957788 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:49.957788 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:49.957796 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:49.960197 (+ 2401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.961203 (+ 1006us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.961204 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.961204 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.961273 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.961498 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.961499 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.961499 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.961630 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:49.961688 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:49.961902 (+ 214us) server_negotiation.cc:299] Negotiation successful
0807 22:40:49.961993 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 22:40:49.962128 2310 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:49.962321 2310 heartbeater.cc:511] Master 127.22.212.124:37321 requested a full tablet report, sending...
I20260807 22:40:49.962391 1615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.949299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:60063 (local address 127.22.212.125:41083)
0807 22:40:49.949349 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:49.949351 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:49.949362 (+ 11us) server_negotiation.cc:407] Connection header received
0807 22:40:49.950329 (+ 967us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:49.950331 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:49.950345 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:49.950417 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:49.951187 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.951685 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.953236 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.953641 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.953693 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.957796 (+ 4103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:49.957797 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:49.957798 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:49.957804 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:49.961093 (+ 3289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.961506 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.961508 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.961508 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.961579 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:49.961774 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:49.961775 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:49.961775 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:49.961910 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:49.961964 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:49.962166 (+ 202us) server_negotiation.cc:299] Negotiation successful
0807 22:40:49.962254 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260807 22:40:49.962431 2319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.948987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.22.212.66:57109)
0807 22:40:49.949308 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:49.949319 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:49.950235 (+ 916us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:49.950490 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:49.950495 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:49.950933 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:49.951092 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.951099 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.952084 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.952084 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.953118 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.953120 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.953671 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.953672 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.953812 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.954588 (+ 776us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:49.954592 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:49.957593 (+ 3001us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:49.960314 (+ 2721us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:49.960315 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:49.960315 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:49.960565 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:49.961349 (+ 784us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:49.961350 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:49.961350 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:49.961419 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:49.961724 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:49.961725 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:49.961768 (+ 43us) client_negotiation.cc:769] Sending connection context
0807 22:40:49.962211 (+ 443us) client_negotiation.cc:240] Negotiation successful
0807 22:40:49.962314 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"mutex_wait_us":47,"thread_start_us":95,"threads_started":1}
I20260807 22:40:49.962767 2311 heartbeater.cc:347] Connected to a master server at 127.22.212.126:43419
I20260807 22:40:49.962815 2311 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:49.962872 2311 heartbeater.cc:511] Master 127.22.212.126:43419 requested a full tablet report, sending...
I20260807 22:40:49.963128 618 ts_manager.cc:194] Re-registered known tserver with Master: bef2621d444d4e0c8c964fd8a5e4a9c9 (127.22.212.66:38741)
I20260807 22:40:49.963233 2316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:49.948988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.125:41083 (local address 127.22.212.66:60063)
0807 22:40:49.949159 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:49.949203 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:49.950215 (+ 1012us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:49.950490 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:49.950493 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:49.950889 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:49.951090 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.951095 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.951797 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.951798 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.953118 (+ 1320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:49.953121 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:49.953786 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:49.953787 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:49.953931 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:49.954925 (+ 994us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:49.954932 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:49.957705 (+ 2773us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:49.961183 (+ 3478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:49.961184 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:49.961185 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:49.961413 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:49.961652 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:49.961652 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:49.961653 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:49.961711 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:49.962012 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:49.962013 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:49.962055 (+ 42us) client_negotiation.cc:769] Sending connection context
0807 22:40:49.962507 (+ 452us) client_negotiation.cc:240] Negotiation successful
0807 22:40:49.962643 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":96,"threads_started":1}
I20260807 22:40:49.963239 1800 ts_manager.cc:194] Registered new tserver with Master: bef2621d444d4e0c8c964fd8a5e4a9c9 (127.22.212.66:38741)
I20260807 22:40:49.963558 2313 heartbeater.cc:347] Connected to a master server at 127.22.212.125:41083
I20260807 22:40:49.963625 2313 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:49.963629 618 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.22.212.66@KRBTEST.COM'} at 127.22.212.66:57109
I20260807 22:40:49.963693 2313 heartbeater.cc:511] Master 127.22.212.125:41083 requested a full tablet report, sending...
I20260807 22:40:49.964305 1537 ts_manager.cc:194] Registered new tserver with Master: bef2621d444d4e0c8c964fd8a5e4a9c9 (127.22.212.66:38741)
I20260807 22:40:49.964468 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.67:38195
--local_ip_for_outbound_sockets=127.22.212.67
--tserver_master_addrs=127.22.212.126:43419
--webserver_port=43719
--webserver_interface=127.22.212.67
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.67.keytab
--principal=oryx/127.22.212.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:41831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.22.212.126:43419,127.22.212.125:41083
--tserver_master_addrs=127.22.212.126:43419,127.22.212.125:41083,127.22.212.124:37321 with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:50.048547 2323 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:50.048749 2323 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:50.048772 2323 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:50.049912 2323 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:50.049957 2323 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:50.050009 2323 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.67
I20260807 22:40:50.051807 2323 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:41831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.67.keytab
--principal=oryx/127.22.212.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.67:38195
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.212.67
--webserver_port=43719
--tserver_master_addrs=127.22.212.126:43419,127.22.212.125:41083,127.22.212.124:37321
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2323
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.67
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:50.052129 2323 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:50.052428 2323 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:50.057961 2334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:50.057971 2330 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:50.057977 2332 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:50.058209 2323 server_base.cc:1034] running on GCE node
I20260807 22:40:50.058760 2323 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:50.059049 2323 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:50.060220 2323 hybrid_clock.cc:648] HybridClock initialized: now 1786142450060202 us; error 32 us; skew 500 ppm
Aug 07 22:40:50 dist-test-slave-2d19 krb5kdc[553](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142450, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.212.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:50.062711 2323 init.cc:377] Logged in from keytab as oryx/127.22.212.67@KRBTEST.COM (short username oryx)
I20260807 22:40:50.063189 2323 webserver.cc:460] Webserver started at http://127.22.212.67:43719/ using document root <none> and password file <none>
I20260807 22:40:50.063439 2323 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:50.063527 2323 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:50.064960 2323 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 22:40:50.065543 2343 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:50.065714 2323 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 22:40:50.065821 2323 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-2/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-2/wal
uuid: "75c56dc41c8f4599b49f3c31d0ef1d44"
format_stamp: "Formatted at 2026-08-07 22:40:49 on dist-test-slave-2d19"
server_key: "f50153b9713916c475f4da1faf8268cb"
server_key_iv: "03000dda46ddc4558bc0d128152fa78e"
server_key_version: "encryptionkey@0"
I20260807 22:40:50.066157 2323 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:50.079700 2323 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:50.081598 2323 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:50.081768 2323 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:50.082005 2323 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:40:50.082355 2323 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:50.082410 2323 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:50.082453 2323 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:50.082481 2323 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:50.088663 2323 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.67:38195
I20260807 22:40:50.088701 2519 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.67:38195 every 8 connection(s)
I20260807 22:40:50.089087 2323 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
I20260807 22:40:50.089718 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 2323
Aug 07 22:40:50 dist-test-slave-2d19 krb5kdc[553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142450, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.212.67@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM
Aug 07 22:40:50 dist-test-slave-2d19 krb5kdc[553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142450, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.212.67@KRBTEST.COM for oryx/127.22.212.124@KRBTEST.COM
Aug 07 22:40:50 dist-test-slave-2d19 krb5kdc[553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142450, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.212.67@KRBTEST.COM for oryx/127.22.212.125@KRBTEST.COM
I20260807 22:40:50.101866 2536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:50.090872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57774 (local address 127.22.212.124:37321)
0807 22:40:50.091365 (+ 493us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:50.091367 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:50.091375 (+ 8us) server_negotiation.cc:407] Connection header received
0807 22:40:50.091404 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:50.091405 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:50.091417 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:50.091484 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:50.092522 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.093317 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.094337 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.094654 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.094970 (+ 316us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:50.096503 (+ 1533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:50.096505 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:50.096505 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:50.096512 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:50.099270 (+ 2758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:50.099981 (+ 711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:50.099982 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:50.099983 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:50.100066 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:50.101043 (+ 977us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:50.101044 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:50.101044 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:50.101189 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:50.101291 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:50.101641 (+ 350us) server_negotiation.cc:299] Negotiation successful
0807 22:40:50.101728 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":473,"thread_start_us":80,"threads_started":1}
I20260807 22:40:50.104055 2525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:50.089856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.125:41083 (local address 127.22.212.67:32803)
0807 22:40:50.090080 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:50.090124 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:50.091506 (+ 1382us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:50.091835 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:50.091839 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:50.093084 (+ 1245us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:50.093171 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:50.093173 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.094067 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.094068 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:50.094919 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:50.094922 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.095420 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.095421 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:50.095576 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:50.096221 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:50.096232 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:50.099785 (+ 3553us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:50.102267 (+ 2482us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:50.102275 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:50.102278 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:50.102585 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:50.102822 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:50.102823 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:50.102824 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:50.102957 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:50.103269 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:50.103276 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:50.103439 (+ 163us) client_negotiation.cc:769] Sending connection context
0807 22:40:50.103578 (+ 139us) client_negotiation.cc:240] Negotiation successful
0807 22:40:50.103775 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":110,"threads_started":1}
I20260807 22:40:50.104592 1615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:50.090185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:32803 (local address 127.22.212.125:41083)
0807 22:40:50.090239 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:50.090242 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:50.090253 (+ 11us) server_negotiation.cc:407] Connection header received
0807 22:40:50.091637 (+ 1384us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:50.091639 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:50.091653 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:50.091684 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:50.093252 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.093970 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.095011 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.095293 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.095356 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:50.099870 (+ 4514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:50.099872 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:50.099873 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:50.099881 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:50.101744 (+ 1863us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:50.102681 (+ 937us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:50.102682 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:50.102683 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:50.102743 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:50.103042 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:50.103043 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:50.103044 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:50.103180 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:50.103241 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:50.104405 (+ 1164us) server_negotiation.cc:299] Negotiation successful
0807 22:40:50.104483 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 22:40:50.104961 2107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:50.090759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:45751 (local address 127.22.212.124:37321)
0807 22:40:50.090812 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:50.090816 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:50.091638 (+ 822us) server_negotiation.cc:407] Connection header received
0807 22:40:50.092100 (+ 462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:50.092101 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:50.092110 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:50.092139 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:50.093437 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.094135 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.095428 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.095700 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.096270 (+ 570us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:50.100563 (+ 4293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:50.100564 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:50.100564 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:50.100571 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:50.103376 (+ 2805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:50.103931 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:50.103933 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:50.103933 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:50.103988 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:50.104363 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:50.104364 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:50.104364 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:50.104489 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:50.104544 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:50.104793 (+ 249us) server_negotiation.cc:299] Negotiation successful
0807 22:40:50.104869 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260807 22:40:50.104969 676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:50.090472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:46751 (local address 127.22.212.126:43419)
0807 22:40:50.090525 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:50.090527 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:50.090545 (+ 18us) server_negotiation.cc:407] Connection header received
0807 22:40:50.091693 (+ 1148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:50.091695 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:50.091707 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:50.091759 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:50.092775 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.093541 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.095017 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.095314 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.095378 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:50.100277 (+ 4899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:50.100279 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:50.100279 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:50.100285 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:50.103407 (+ 3122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:50.103981 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:50.103982 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:50.103982 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:50.104039 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:50.104217 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:50.104218 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:50.104218 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:50.104345 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:50.104397 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:50.104814 (+ 417us) server_negotiation.cc:299] Negotiation successful
0807 22:40:50.104884 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260807 22:40:50.104733 2526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:50.089856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.22.212.67:46751)
0807 22:40:50.090330 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:50.090343 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:50.091526 (+ 1183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:50.091834 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:50.091839 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:50.092357 (+ 518us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:50.092655 (+ 298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:50.092662 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.093654 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.093655 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:50.094916 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:50.094919 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.095432 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.095433 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:50.095576 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:50.096309 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:50.096314 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:50.100118 (+ 3804us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:50.103487 (+ 3369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:50.103488 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:50.103488 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:50.103897 (+ 409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:50.104102 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:50.104103 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:50.104103 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:50.104159 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:50.104421 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:50.104422 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:50.104458 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 22:40:50.104536 (+ 78us) client_negotiation.cc:240] Negotiation successful
0807 22:40:50.104632 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":441,"mutex_wait_us":24,"thread_start_us":121,"threads_started":1}
I20260807 22:40:50.105273 2534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:50.090641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:37321 (local address 127.22.212.67:45751)
0807 22:40:50.091579 (+ 938us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:50.091589 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:50.092007 (+ 418us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:50.092205 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:50.092205 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:50.093301 (+ 1096us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:50.093359 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:50.093360 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.094247 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.094247 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:50.095335 (+ 1088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:50.095337 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.096357 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.096359 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:50.096428 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:50.097063 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:50.097069 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:50.100442 (+ 3373us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:50.103455 (+ 3013us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:50.103455 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:50.103456 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:50.103845 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:50.104061 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:50.104062 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:50.104062 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:50.104150 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:50.104596 (+ 446us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:50.104597 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:50.104639 (+ 42us) client_negotiation.cc:769] Sending connection context
0807 22:40:50.105034 (+ 395us) client_negotiation.cc:240] Negotiation successful
0807 22:40:50.105151 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":919,"thread_start_us":112,"threads_started":1}
I20260807 22:40:50.105312 2522 heartbeater.cc:347] Connected to a master server at 127.22.212.125:41083
I20260807 22:40:50.105402 2522 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:50.105450 1478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:50.099940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:37321 (local address 127.0.0.1:57786)
0807 22:40:50.100027 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:50.100039 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:50.100076 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:50.102333 (+ 2257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:50.102334 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:50.102336 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:50.102385 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:50.102387 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.103281 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.103282 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:50.104454 (+ 1172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:50.104456 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.105239 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.105240 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:50.105300 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:50.105304 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 22:40:50.105333 (+ 29us) client_negotiation.cc:240] Negotiation successful
0807 22:40:50.105378 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71}
I20260807 22:40:50.105587 2521 heartbeater.cc:347] Connected to a master server at 127.22.212.126:43419
I20260807 22:40:50.105621 2522 heartbeater.cc:511] Master 127.22.212.125:41083 requested a full tablet report, sending...
I20260807 22:40:50.105628 2521 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:50.105720 2521 heartbeater.cc:511] Master 127.22.212.126:43419 requested a full tablet report, sending...
I20260807 22:40:50.105788 2536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:50.100152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57786 (local address 127.22.212.124:37321)
0807 22:40:50.101948 (+ 1796us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:50.101950 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:50.101957 (+ 7us) server_negotiation.cc:407] Connection header received
0807 22:40:50.101978 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:50.101979 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:50.102000 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:50.102079 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:50.102467 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.103176 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.104549 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.105137 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.105578 (+ 441us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:50.105658 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:50.105676 (+ 18us) server_negotiation.cc:299] Negotiation successful
0807 22:40:50.105716 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1781,"thread_start_us":64,"threads_started":1}
I20260807 22:40:50.105860 2520 heartbeater.cc:347] Connected to a master server at 127.22.212.124:37321
I20260807 22:40:50.105897 2520 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:50.105952 2520 heartbeater.cc:511] Master 127.22.212.124:37321 requested a full tablet report, sending...
I20260807 22:40:50.106010 618 ts_manager.cc:194] Re-registered known tserver with Master: 75c56dc41c8f4599b49f3c31d0ef1d44 (127.22.212.67:38195)
I20260807 22:40:50.106076 1537 ts_manager.cc:194] Registered new tserver with Master: 75c56dc41c8f4599b49f3c31d0ef1d44 (127.22.212.67:38195)
I20260807 22:40:50.106190 1800 ts_manager.cc:194] Registered new tserver with Master: 75c56dc41c8f4599b49f3c31d0ef1d44 (127.22.212.67:38195)
I20260807 22:40:50.106514 618 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.22.212.67@KRBTEST.COM'} at 127.22.212.67:46751
I20260807 22:40:50.107410 1816 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260807 22:40:50.107771 1860 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23677f8da61b48e59d3faf7ab7da7ea9. Latest consensus state: current_term: 1 leader_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: false } } peers { permanent_uuid: "29971711a8104e688dc096f5f926330c" member_type: NON_VOTER last_known_addr { host: "127.22.212.124" port: 37321 } attrs { promote: true } } }
I20260807 22:40:50.107882 1860 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [sys.catalog]: This master's current role is: LEARNER
I20260807 22:40:50.108668 2538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:50.091010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58440 (local address 127.22.212.126:43419)
0807 22:40:50.091845 (+ 835us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:50.091847 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:50.091853 (+ 6us) server_negotiation.cc:407] Connection header received
0807 22:40:50.091887 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:50.091888 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:50.091900 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:50.091966 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:50.095976 (+ 4010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.096748 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.098073 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.098446 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.098508 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:50.100626 (+ 2118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:50.100627 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:50.100627 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:50.100634 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:50.107079 (+ 6445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:50.107634 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:50.107635 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:50.107636 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:50.107708 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:50.108093 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:50.108093 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:50.108093 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:50.108193 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:50.108320 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:50.108468 (+ 148us) server_negotiation.cc:299] Negotiation successful
0807 22:40:50.108550 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":810,"thread_start_us":82,"threads_started":1}
I20260807 22:40:50.109416 2544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:50.091321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44924 (local address 127.22.212.125:41083)
0807 22:40:50.092335 (+ 1014us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:50.092337 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:50.092596 (+ 259us) server_negotiation.cc:407] Connection header received
0807 22:40:50.092623 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:50.092624 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:50.092682 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:50.092765 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:50.097020 (+ 4255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.097763 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.098849 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.099182 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.099249 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:50.101560 (+ 2311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:50.101561 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:50.101561 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:50.101568 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:50.108058 (+ 6490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:50.108488 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:50.108489 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:50.108489 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:50.108554 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:50.108789 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:50.108790 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:50.108790 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:50.108930 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:50.109020 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:50.109206 (+ 186us) server_negotiation.cc:299] Negotiation successful
0807 22:40:50.109301 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":993,"thread_start_us":65,"threads_started":1}
I20260807 22:40:50.110438 618 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58440:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:40:50.111919 618 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:40:50.112661 1755 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: false } } peers { permanent_uuid: "29971711a8104e688dc096f5f926330c" member_type: NON_VOTER last_known_addr { host: "127.22.212.124" port: 37321 } attrs { promote: true } } }
I20260807 22:40:50.112774 1755 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:50.114084 2549 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9: attempting to promote NON_VOTER 29971711a8104e688dc096f5f926330c to VOTER
I20260807 22:40:50.114210 2549 consensus_queue.cc:237] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: false } } peers { permanent_uuid: "29971711a8104e688dc096f5f926330c" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37321 } attrs { promote: false } }
I20260807 22:40:50.114600 1550 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [term 1 FOLLOWER]: Refusing update from remote peer 23677f8da61b48e59d3faf7ab7da7ea9: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 22:40:50.114743 1816 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [term 1 LEARNER]: Refusing update from remote peer 23677f8da61b48e59d3faf7ab7da7ea9: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 22:40:50.114979 1479 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 22:40:50.115108 1481 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29971711a8104e688dc096f5f926330c" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37321 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 22:40:50.115854 1481 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 29971711a8104e688dc096f5f926330c (127.22.212.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: false } } peers { permanent_uuid: "29971711a8104e688dc096f5f926330c" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37321 } attrs { promote: false } } }
I20260807 22:40:50.116048 1816 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 29971711a8104e688dc096f5f926330c (127.22.212.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: false } } peers { permanent_uuid: "29971711a8104e688dc096f5f926330c" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37321 } attrs { promote: false } } }
I20260807 22:40:50.116726 1481 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: false } } peers { permanent_uuid: "29971711a8104e688dc096f5f926330c" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37321 } attrs { promote: false } } }
I20260807 22:40:50.116802 1481 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:50.116855 1481 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: false } } peers { permanent_uuid: "29971711a8104e688dc096f5f926330c" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37321 } attrs { promote: false } } }
I20260807 22:40:50.116914 1481 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:50.117022 1860 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: false } } peers { permanent_uuid: "29971711a8104e688dc096f5f926330c" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37321 } attrs { promote: false } } }
I20260807 22:40:50.117118 1860 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:40:50.117157 1755 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: false } } peers { permanent_uuid: "29971711a8104e688dc096f5f926330c" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37321 } attrs { promote: false } } }
I20260807 22:40:50.117245 1755 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9 [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:50.117292 1550 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 29971711a8104e688dc096f5f926330c (127.22.212.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: false } } peers { permanent_uuid: "29971711a8104e688dc096f5f926330c" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37321 } attrs { promote: false } } }
I20260807 22:40:50.118278 1752 sys_catalog.cc:455] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: false } } peers { permanent_uuid: "29971711a8104e688dc096f5f926330c" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37321 } attrs { promote: false } } }
I20260807 22:40:50.118363 1752 sys_catalog.cc:458] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:40:50.122576 1478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:50.118133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.66:38741 (local address 127.0.0.1:34580)
0807 22:40:50.118171 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:50.118185 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:50.118232 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:50.118826 (+ 594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:50.118828 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:50.118830 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:50.118877 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:50.118879 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.120204 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.120204 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:50.121350 (+ 1146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:50.121353 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.122332 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.122333 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:50.122420 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:50.122425 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 22:40:50.122458 (+ 33us) client_negotiation.cc:240] Negotiation successful
0807 22:40:50.122497 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21,"mutex_wait_us":3}
I20260807 22:40:50.122769 2562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:50.118145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.67:38195 (local address 127.0.0.1:60024)
0807 22:40:50.118376 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:50.118387 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:50.118442 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:50.119012 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:50.119013 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:50.119015 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:50.119087 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:50.119088 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.120433 (+ 1345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.120434 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:50.121330 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:50.121332 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.122480 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.122481 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:50.122557 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:50.122561 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 22:40:50.122628 (+ 67us) client_negotiation.cc:240] Negotiation successful
0807 22:40:50.122674 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"mutex_wait_us":3,"thread_start_us":91,"threads_started":1}
I20260807 22:40:50.122789 2563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:50.118350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60024 (local address 127.22.212.67:38195)
0807 22:40:50.118559 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:50.118564 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:50.118592 (+ 28us) server_negotiation.cc:407] Connection header received
0807 22:40:50.118634 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:50.118636 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:50.118654 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:50.119193 (+ 539us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:50.119253 (+ 60us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.120336 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.121669 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.122371 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.122465 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:50.122567 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:50.122648 (+ 81us) server_negotiation.cc:299] Negotiation successful
0807 22:40:50.122696 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":83,"threads_started":1}
I20260807 22:40:50.123057 2564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:50.118464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34580 (local address 127.22.212.66:38741)
0807 22:40:50.118667 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:50.118672 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:50.118683 (+ 11us) server_negotiation.cc:407] Connection header received
0807 22:40:50.118720 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:50.118722 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:50.118738 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:50.118815 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:50.118993 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.120121 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.121438 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.122231 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.122771 (+ 540us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:50.122870 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:50.122898 (+ 28us) server_negotiation.cc:299] Negotiation successful
0807 22:40:50.122980 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":103,"threads_started":1}
I20260807 22:40:50.123631 2424 tablet_service.cc:1467] Processing CreateTablet for tablet f65bd8447eab4bd987e27f21274f3d27 (DEFAULT_TABLE table=test-table [id=f3d79687324c444e86c53d29e882197b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:50.124028 2424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f65bd8447eab4bd987e27f21274f3d27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:50.124440 2565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:50.118859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:39385 (local address 127.0.0.1:32956)
0807 22:40:50.120330 (+ 1471us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:50.120343 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:50.120387 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:50.120613 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:50.120614 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:50.120616 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:50.120649 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:50.120650 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.121740 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.121741 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:50.122798 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:50.122801 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.124068 (+ 1267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.124069 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:50.124211 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:50.124218 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 22:40:50.124331 (+ 113us) client_negotiation.cc:240] Negotiation successful
0807 22:40:50.124373 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1453,"thread_start_us":76,"threads_started":1}
I20260807 22:40:50.124642 2567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:50.119076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32956 (local address 127.22.212.65:39385)
0807 22:40:50.120400 (+ 1324us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:50.120405 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:50.120416 (+ 11us) server_negotiation.cc:407] Connection header received
0807 22:40:50.120493 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:50.120495 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:50.120511 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:50.120602 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:50.120711 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.121660 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.123200 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.123983 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.124068 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:50.124144 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:50.124412 (+ 268us) server_negotiation.cc:299] Negotiation successful
0807 22:40:50.124455 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1282,"thread_start_us":89,"threads_started":1}
I20260807 22:40:50.125185 1974 tablet_service.cc:1467] Processing CreateTablet for tablet f65bd8447eab4bd987e27f21274f3d27 (DEFAULT_TABLE table=test-table [id=f3d79687324c444e86c53d29e882197b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:50.125500 1974 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f65bd8447eab4bd987e27f21274f3d27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:50.127123 2568 tablet_bootstrap.cc:492] T f65bd8447eab4bd987e27f21274f3d27 P 75c56dc41c8f4599b49f3c31d0ef1d44: Bootstrap starting.
I20260807 22:40:50.127854 2568 tablet_bootstrap.cc:654] T f65bd8447eab4bd987e27f21274f3d27 P 75c56dc41c8f4599b49f3c31d0ef1d44: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:50.127830 2201 tablet_service.cc:1467] Processing CreateTablet for tablet f65bd8447eab4bd987e27f21274f3d27 (DEFAULT_TABLE table=test-table [id=f3d79687324c444e86c53d29e882197b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:50.128185 2201 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f65bd8447eab4bd987e27f21274f3d27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:50.128227 2568 log.cc:824] T f65bd8447eab4bd987e27f21274f3d27 P 75c56dc41c8f4599b49f3c31d0ef1d44: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:50.128341 2569 tablet_bootstrap.cc:492] T f65bd8447eab4bd987e27f21274f3d27 P 71378a822b0244288e2f95ad5e419c9a: Bootstrap starting.
I20260807 22:40:50.129024 2569 tablet_bootstrap.cc:654] T f65bd8447eab4bd987e27f21274f3d27 P 71378a822b0244288e2f95ad5e419c9a: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:50.129119 2568 tablet_bootstrap.cc:492] T f65bd8447eab4bd987e27f21274f3d27 P 75c56dc41c8f4599b49f3c31d0ef1d44: No bootstrap required, opened a new log
I20260807 22:40:50.129186 2568 ts_tablet_manager.cc:1397] T f65bd8447eab4bd987e27f21274f3d27 P 75c56dc41c8f4599b49f3c31d0ef1d44: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 22:40:50.129405 2569 log.cc:824] T f65bd8447eab4bd987e27f21274f3d27 P 71378a822b0244288e2f95ad5e419c9a: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:50.130285 2569 tablet_bootstrap.cc:492] T f65bd8447eab4bd987e27f21274f3d27 P 71378a822b0244288e2f95ad5e419c9a: No bootstrap required, opened a new log
I20260807 22:40:50.130340 2569 ts_tablet_manager.cc:1397] T f65bd8447eab4bd987e27f21274f3d27 P 71378a822b0244288e2f95ad5e419c9a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 22:40:50.131095 2573 tablet_bootstrap.cc:492] T f65bd8447eab4bd987e27f21274f3d27 P bef2621d444d4e0c8c964fd8a5e4a9c9: Bootstrap starting.
I20260807 22:40:50.131703 2573 tablet_bootstrap.cc:654] T f65bd8447eab4bd987e27f21274f3d27 P bef2621d444d4e0c8c964fd8a5e4a9c9: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:50.131808 2568 raft_consensus.cc:348] T f65bd8447eab4bd987e27f21274f3d27 P 75c56dc41c8f4599b49f3c31d0ef1d44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bef2621d444d4e0c8c964fd8a5e4a9c9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 38741 } } peers { permanent_uuid: "75c56dc41c8f4599b49f3c31d0ef1d44" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 38195 } } peers { permanent_uuid: "71378a822b0244288e2f95ad5e419c9a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 39385 } }
I20260807 22:40:50.132030 2568 raft_consensus.cc:374] T f65bd8447eab4bd987e27f21274f3d27 P 75c56dc41c8f4599b49f3c31d0ef1d44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:50.132084 2568 raft_consensus.cc:729] T f65bd8447eab4bd987e27f21274f3d27 P 75c56dc41c8f4599b49f3c31d0ef1d44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75c56dc41c8f4599b49f3c31d0ef1d44, State: Initialized, Role: FOLLOWER
I20260807 22:40:50.132119 2573 log.cc:824] T f65bd8447eab4bd987e27f21274f3d27 P bef2621d444d4e0c8c964fd8a5e4a9c9: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:50.132220 2568 consensus_queue.cc:260] T f65bd8447eab4bd987e27f21274f3d27 P 75c56dc41c8f4599b49f3c31d0ef1d44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bef2621d444d4e0c8c964fd8a5e4a9c9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 38741 } } peers { permanent_uuid: "75c56dc41c8f4599b49f3c31d0ef1d44" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 38195 } } peers { permanent_uuid: "71378a822b0244288e2f95ad5e419c9a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 39385 } }
I20260807 22:40:50.132509 2568 ts_tablet_manager.cc:1428] T f65bd8447eab4bd987e27f21274f3d27 P 75c56dc41c8f4599b49f3c31d0ef1d44: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260807 22:40:50.132838 2521 heartbeater.cc:503] Master 127.22.212.126:43419 was elected leader, sending a full tablet report...
I20260807 22:40:50.133798 2573 tablet_bootstrap.cc:492] T f65bd8447eab4bd987e27f21274f3d27 P bef2621d444d4e0c8c964fd8a5e4a9c9: No bootstrap required, opened a new log
I20260807 22:40:50.133880 2573 ts_tablet_manager.cc:1397] T f65bd8447eab4bd987e27f21274f3d27 P bef2621d444d4e0c8c964fd8a5e4a9c9: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 22:40:50.134007 2569 raft_consensus.cc:348] T f65bd8447eab4bd987e27f21274f3d27 P 71378a822b0244288e2f95ad5e419c9a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bef2621d444d4e0c8c964fd8a5e4a9c9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 38741 } } peers { permanent_uuid: "75c56dc41c8f4599b49f3c31d0ef1d44" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 38195 } } peers { permanent_uuid: "71378a822b0244288e2f95ad5e419c9a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 39385 } }
I20260807 22:40:50.134140 2569 raft_consensus.cc:374] T f65bd8447eab4bd987e27f21274f3d27 P 71378a822b0244288e2f95ad5e419c9a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:50.134161 2569 raft_consensus.cc:729] T f65bd8447eab4bd987e27f21274f3d27 P 71378a822b0244288e2f95ad5e419c9a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71378a822b0244288e2f95ad5e419c9a, State: Initialized, Role: FOLLOWER
I20260807 22:40:50.134284 2569 consensus_queue.cc:260] T f65bd8447eab4bd987e27f21274f3d27 P 71378a822b0244288e2f95ad5e419c9a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bef2621d444d4e0c8c964fd8a5e4a9c9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 38741 } } peers { permanent_uuid: "75c56dc41c8f4599b49f3c31d0ef1d44" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 38195 } } peers { permanent_uuid: "71378a822b0244288e2f95ad5e419c9a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 39385 } }
I20260807 22:40:50.134548 2569 ts_tablet_manager.cc:1428] T f65bd8447eab4bd987e27f21274f3d27 P 71378a822b0244288e2f95ad5e419c9a: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260807 22:40:50.134742 2090 heartbeater.cc:503] Master 127.22.212.126:43419 was elected leader, sending a full tablet report...
I20260807 22:40:50.136292 2573 raft_consensus.cc:348] T f65bd8447eab4bd987e27f21274f3d27 P bef2621d444d4e0c8c964fd8a5e4a9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bef2621d444d4e0c8c964fd8a5e4a9c9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 38741 } } peers { permanent_uuid: "75c56dc41c8f4599b49f3c31d0ef1d44" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 38195 } } peers { permanent_uuid: "71378a822b0244288e2f95ad5e419c9a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 39385 } }
I20260807 22:40:50.136438 2573 raft_consensus.cc:374] T f65bd8447eab4bd987e27f21274f3d27 P bef2621d444d4e0c8c964fd8a5e4a9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:50.136461 2573 raft_consensus.cc:729] T f65bd8447eab4bd987e27f21274f3d27 P bef2621d444d4e0c8c964fd8a5e4a9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bef2621d444d4e0c8c964fd8a5e4a9c9, State: Initialized, Role: FOLLOWER
I20260807 22:40:50.136570 2573 consensus_queue.cc:260] T f65bd8447eab4bd987e27f21274f3d27 P bef2621d444d4e0c8c964fd8a5e4a9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bef2621d444d4e0c8c964fd8a5e4a9c9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 38741 } } peers { permanent_uuid: "75c56dc41c8f4599b49f3c31d0ef1d44" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 38195 } } peers { permanent_uuid: "71378a822b0244288e2f95ad5e419c9a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 39385 } }
I20260807 22:40:50.136837 2573 ts_tablet_manager.cc:1428] T f65bd8447eab4bd987e27f21274f3d27 P bef2621d444d4e0c8c964fd8a5e4a9c9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 22:40:50.136893 2311 heartbeater.cc:503] Master 127.22.212.126:43419 was elected leader, sending a full tablet report...
I20260807 22:40:50.198773 2580 raft_consensus.cc:482] T f65bd8447eab4bd987e27f21274f3d27 P 71378a822b0244288e2f95ad5e419c9a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:40:50.198913 2580 raft_consensus.cc:504] T f65bd8447eab4bd987e27f21274f3d27 P 71378a822b0244288e2f95ad5e419c9a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bef2621d444d4e0c8c964fd8a5e4a9c9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 38741 } } peers { permanent_uuid: "75c56dc41c8f4599b49f3c31d0ef1d44" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 38195 } } peers { permanent_uuid: "71378a822b0244288e2f95ad5e419c9a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 39385 } }
I20260807 22:40:50.199365 2580 leader_election.cc:288] T f65bd8447eab4bd987e27f21274f3d27 P 71378a822b0244288e2f95ad5e419c9a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bef2621d444d4e0c8c964fd8a5e4a9c9 (127.22.212.66:38741), 75c56dc41c8f4599b49f3c31d0ef1d44 (127.22.212.67:38195)
W20260807 22:40:50.199736 2314 tablet.cc:2369] T f65bd8447eab4bd987e27f21274f3d27 P bef2621d444d4e0c8c964fd8a5e4a9c9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:40:50.202328 2564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:50.199643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:44477 (local address 127.22.212.66:38741)
0807 22:40:50.199689 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:50.199691 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:50.199911 (+ 220us) server_negotiation.cc:407] Connection header received
0807 22:40:50.199941 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:50.199942 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:50.199958 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:50.200022 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:50.200178 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.200708 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.201600 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.201957 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.202044 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:50.202053 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:50.202212 (+ 159us) server_negotiation.cc:299] Negotiation successful
0807 22:40:50.202249 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 22:40:50.202358 2099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:50.199549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.67:38195 (local address 127.22.212.65:59159)
0807 22:40:50.199611 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:50.199624 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:50.199675 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:50.199891 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:50.199892 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:50.199894 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:50.199976 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:50.199978 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.200724 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.200726 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:50.201468 (+ 742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:50.201470 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.202073 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.202073 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:50.202155 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:50.202158 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:40:50.202223 (+ 65us) client_negotiation.cc:240] Negotiation successful
0807 22:40:50.202269 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39,"mutex_wait_us":3}
I20260807 22:40:50.202355 2563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:50.199666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:59159 (local address 127.22.212.67:38195)
0807 22:40:50.199723 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:50.199725 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:50.199736 (+ 11us) server_negotiation.cc:407] Connection header received
0807 22:40:50.199767 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:50.199767 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:50.199778 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:50.199836 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:50.200090 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.200635 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.201579 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.201960 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.202067 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:50.202077 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:50.202245 (+ 168us) server_negotiation.cc:299] Negotiation successful
0807 22:40:50.202288 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260807 22:40:50.202384 2104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:50.199556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.66:38741 (local address 127.22.212.65:44477)
0807 22:40:50.199780 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:50.199792 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:50.199863 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:50.200037 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:50.200038 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:50.200039 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:50.200105 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:50.200106 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.200796 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.200797 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:50.201505 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:50.201507 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.202049 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.202050 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:50.202133 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:50.202136 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:40:50.202205 (+ 69us) client_negotiation.cc:240] Negotiation successful
0807 22:40:50.202249 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"mutex_wait_us":170}
I20260807 22:40:50.202719 2234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f65bd8447eab4bd987e27f21274f3d27" candidate_uuid: "71378a822b0244288e2f95ad5e419c9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bef2621d444d4e0c8c964fd8a5e4a9c9" is_pre_election: true
I20260807 22:40:50.202764 2456 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f65bd8447eab4bd987e27f21274f3d27" candidate_uuid: "71378a822b0244288e2f95ad5e419c9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75c56dc41c8f4599b49f3c31d0ef1d44" is_pre_election: true
I20260807 22:40:50.202874 2234 raft_consensus.cc:2454] T f65bd8447eab4bd987e27f21274f3d27 P bef2621d444d4e0c8c964fd8a5e4a9c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71378a822b0244288e2f95ad5e419c9a in term 0.
I20260807 22:40:50.202952 2456 raft_consensus.cc:2454] T f65bd8447eab4bd987e27f21274f3d27 P 75c56dc41c8f4599b49f3c31d0ef1d44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71378a822b0244288e2f95ad5e419c9a in term 0.
I20260807 22:40:50.203118 1895 leader_election.cc:302] T f65bd8447eab4bd987e27f21274f3d27 P 71378a822b0244288e2f95ad5e419c9a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71378a822b0244288e2f95ad5e419c9a, bef2621d444d4e0c8c964fd8a5e4a9c9; no voters:
I20260807 22:40:50.203277 2580 raft_consensus.cc:2781] T f65bd8447eab4bd987e27f21274f3d27 P 71378a822b0244288e2f95ad5e419c9a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:40:50.203362 2580 raft_consensus.cc:482] T f65bd8447eab4bd987e27f21274f3d27 P 71378a822b0244288e2f95ad5e419c9a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:40:50.203399 2580 raft_consensus.cc:3037] T f65bd8447eab4bd987e27f21274f3d27 P 71378a822b0244288e2f95ad5e419c9a [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:50.204126 2580 raft_consensus.cc:504] T f65bd8447eab4bd987e27f21274f3d27 P 71378a822b0244288e2f95ad5e419c9a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bef2621d444d4e0c8c964fd8a5e4a9c9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 38741 } } peers { permanent_uuid: "75c56dc41c8f4599b49f3c31d0ef1d44" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 38195 } } peers { permanent_uuid: "71378a822b0244288e2f95ad5e419c9a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 39385 } }
I20260807 22:40:50.204301 2580 leader_election.cc:288] T f65bd8447eab4bd987e27f21274f3d27 P 71378a822b0244288e2f95ad5e419c9a [CANDIDATE]: Term 1 election: Requested vote from peers bef2621d444d4e0c8c964fd8a5e4a9c9 (127.22.212.66:38741), 75c56dc41c8f4599b49f3c31d0ef1d44 (127.22.212.67:38195)
I20260807 22:40:50.204408 2234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f65bd8447eab4bd987e27f21274f3d27" candidate_uuid: "71378a822b0244288e2f95ad5e419c9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bef2621d444d4e0c8c964fd8a5e4a9c9"
I20260807 22:40:50.204460 2456 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f65bd8447eab4bd987e27f21274f3d27" candidate_uuid: "71378a822b0244288e2f95ad5e419c9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75c56dc41c8f4599b49f3c31d0ef1d44"
I20260807 22:40:50.204496 2234 raft_consensus.cc:3037] T f65bd8447eab4bd987e27f21274f3d27 P bef2621d444d4e0c8c964fd8a5e4a9c9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:50.204566 2456 raft_consensus.cc:3037] T f65bd8447eab4bd987e27f21274f3d27 P 75c56dc41c8f4599b49f3c31d0ef1d44 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:50.205240 2234 raft_consensus.cc:2454] T f65bd8447eab4bd987e27f21274f3d27 P bef2621d444d4e0c8c964fd8a5e4a9c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71378a822b0244288e2f95ad5e419c9a in term 1.
I20260807 22:40:50.205354 2456 raft_consensus.cc:2454] T f65bd8447eab4bd987e27f21274f3d27 P 75c56dc41c8f4599b49f3c31d0ef1d44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71378a822b0244288e2f95ad5e419c9a in term 1.
I20260807 22:40:50.205406 1895 leader_election.cc:302] T f65bd8447eab4bd987e27f21274f3d27 P 71378a822b0244288e2f95ad5e419c9a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71378a822b0244288e2f95ad5e419c9a, bef2621d444d4e0c8c964fd8a5e4a9c9; no voters:
I20260807 22:40:50.205479 2580 raft_consensus.cc:2781] T f65bd8447eab4bd987e27f21274f3d27 P 71378a822b0244288e2f95ad5e419c9a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:40:50.205662 2580 raft_consensus.cc:686] T f65bd8447eab4bd987e27f21274f3d27 P 71378a822b0244288e2f95ad5e419c9a [term 1 LEADER]: Becoming Leader. State: Replica: 71378a822b0244288e2f95ad5e419c9a, State: Running, Role: LEADER
I20260807 22:40:50.205772 2580 consensus_queue.cc:237] T f65bd8447eab4bd987e27f21274f3d27 P 71378a822b0244288e2f95ad5e419c9a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bef2621d444d4e0c8c964fd8a5e4a9c9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 38741 } } peers { permanent_uuid: "75c56dc41c8f4599b49f3c31d0ef1d44" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 38195 } } peers { permanent_uuid: "71378a822b0244288e2f95ad5e419c9a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 39385 } }
I20260807 22:40:50.206664 617 catalog_manager.cc:5495] T f65bd8447eab4bd987e27f21274f3d27 P 71378a822b0244288e2f95ad5e419c9a reported cstate change: term changed from 0 to 1, leader changed from <none> to 71378a822b0244288e2f95ad5e419c9a (127.22.212.65). New cstate: current_term: 1 leader_uuid: "71378a822b0244288e2f95ad5e419c9a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bef2621d444d4e0c8c964fd8a5e4a9c9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 38741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75c56dc41c8f4599b49f3c31d0ef1d44" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 38195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71378a822b0244288e2f95ad5e419c9a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 39385 } health_report { overall_health: HEALTHY } } }
I20260807 22:40:50.235342 2567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:50.232892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32964 (local address 127.22.212.65:39385)
0807 22:40:50.232961 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:50.232963 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:50.232972 (+ 9us) server_negotiation.cc:407] Connection header received
0807 22:40:50.233042 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:50.233043 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:50.233064 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:50.233155 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:40:50.233301 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.233778 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.234525 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.234740 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.234827 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:50.234991 (+ 164us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:40:50.235109 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:40:50.235197 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:50.235236 (+ 39us) server_negotiation.cc:299] Negotiation successful
0807 22:40:50.235257 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 22:40:50.237280 2234 raft_consensus.cc:1261] T f65bd8447eab4bd987e27f21274f3d27 P bef2621d444d4e0c8c964fd8a5e4a9c9 [term 1 FOLLOWER]: Refusing update from remote peer 71378a822b0244288e2f95ad5e419c9a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:40:50.237317 2456 raft_consensus.cc:1261] T f65bd8447eab4bd987e27f21274f3d27 P 75c56dc41c8f4599b49f3c31d0ef1d44 [term 1 FOLLOWER]: Refusing update from remote peer 71378a822b0244288e2f95ad5e419c9a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:40:50.237677 2580 consensus_queue.cc:1035] T f65bd8447eab4bd987e27f21274f3d27 P 71378a822b0244288e2f95ad5e419c9a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bef2621d444d4e0c8c964fd8a5e4a9c9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 38741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:40:50.237831 2582 consensus_queue.cc:1035] T f65bd8447eab4bd987e27f21274f3d27 P 71378a822b0244288e2f95ad5e419c9a [LEADER]: Connected to new peer: Peer: permanent_uuid: "75c56dc41c8f4599b49f3c31d0ef1d44" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 38195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:40:50.242681 2587 mvcc.cc:205] Tried to move back new op lower bound from 7316039476168884224 to 7316039476043350016. Current Snapshot: MvccSnapshot[applied={T|T < 7316039476168884224}]
I20260807 22:40:50.243906 617 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58440:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:40:50.244007 617 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58440:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:40:50.245647 617 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 23677f8da61b48e59d3faf7ab7da7ea9: Sending DeleteTablet for 3 replicas of tablet f65bd8447eab4bd987e27f21274f3d27
I20260807 22:40:50.245960 1974 tablet_service.cc:1514] Processing DeleteTablet for tablet f65bd8447eab4bd987e27f21274f3d27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:50 UTC) from {username='oryx', principal='oryx/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:32956
I20260807 22:40:50.245987 2201 tablet_service.cc:1514] Processing DeleteTablet for tablet f65bd8447eab4bd987e27f21274f3d27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:50 UTC) from {username='oryx', principal='oryx/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:34580
I20260807 22:40:50.246115 2424 tablet_service.cc:1514] Processing DeleteTablet for tablet f65bd8447eab4bd987e27f21274f3d27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:50 UTC) from {username='oryx', principal='oryx/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:60024
I20260807 22:40:50.246218 2597 tablet_replica.cc:330] T f65bd8447eab4bd987e27f21274f3d27 P bef2621d444d4e0c8c964fd8a5e4a9c9: stopping tablet replica
I20260807 22:40:50.246320 2597 raft_consensus.cc:2229] T f65bd8447eab4bd987e27f21274f3d27 P bef2621d444d4e0c8c964fd8a5e4a9c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:40:50.246483 2597 raft_consensus.cc:2258] T f65bd8447eab4bd987e27f21274f3d27 P bef2621d444d4e0c8c964fd8a5e4a9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:50.246634 2596 tablet_replica.cc:330] T f65bd8447eab4bd987e27f21274f3d27 P 71378a822b0244288e2f95ad5e419c9a: stopping tablet replica
I20260807 22:40:50.246778 2598 tablet_replica.cc:330] T f65bd8447eab4bd987e27f21274f3d27 P 75c56dc41c8f4599b49f3c31d0ef1d44: stopping tablet replica
I20260807 22:40:50.247000 2597 ts_tablet_manager.cc:1905] T f65bd8447eab4bd987e27f21274f3d27 P bef2621d444d4e0c8c964fd8a5e4a9c9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:50.247335 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 571
I20260807 22:40:50.250118 2597 ts_tablet_manager.cc:1918] T f65bd8447eab4bd987e27f21274f3d27 P bef2621d444d4e0c8c964fd8a5e4a9c9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:40:50.250201 2597 log.cc:1196] T f65bd8447eab4bd987e27f21274f3d27 P bef2621d444d4e0c8c964fd8a5e4a9c9: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-1/wal/wals/f65bd8447eab4bd987e27f21274f3d27
I20260807 22:40:50.250522 2597 ts_tablet_manager.cc:1939] T f65bd8447eab4bd987e27f21274f3d27 P bef2621d444d4e0c8c964fd8a5e4a9c9: Deleting consensus metadata
I20260807 22:40:50.264948 2596 raft_consensus.cc:2229] T f65bd8447eab4bd987e27f21274f3d27 P 71378a822b0244288e2f95ad5e419c9a [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:40:50.265106 2598 raft_consensus.cc:2229] T f65bd8447eab4bd987e27f21274f3d27 P 75c56dc41c8f4599b49f3c31d0ef1d44 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:40:50.265259 2598 raft_consensus.cc:2258] T f65bd8447eab4bd987e27f21274f3d27 P 75c56dc41c8f4599b49f3c31d0ef1d44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:50.265396 2596 raft_consensus.cc:2258] T f65bd8447eab4bd987e27f21274f3d27 P 71378a822b0244288e2f95ad5e419c9a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:50.267503 2596 ts_tablet_manager.cc:1905] T f65bd8447eab4bd987e27f21274f3d27 P 71378a822b0244288e2f95ad5e419c9a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:50.268321 2598 ts_tablet_manager.cc:1905] T f65bd8447eab4bd987e27f21274f3d27 P 75c56dc41c8f4599b49f3c31d0ef1d44: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:50.269496 2596 ts_tablet_manager.cc:1918] T f65bd8447eab4bd987e27f21274f3d27 P 71378a822b0244288e2f95ad5e419c9a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:40:50.269647 2596 log.cc:1196] T f65bd8447eab4bd987e27f21274f3d27 P 71378a822b0244288e2f95ad5e419c9a: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-0/wal/wals/f65bd8447eab4bd987e27f21274f3d27
I20260807 22:40:50.269987 2596 ts_tablet_manager.cc:1939] T f65bd8447eab4bd987e27f21274f3d27 P 71378a822b0244288e2f95ad5e419c9a: Deleting consensus metadata
I20260807 22:40:50.270224 2598 ts_tablet_manager.cc:1918] T f65bd8447eab4bd987e27f21274f3d27 P 75c56dc41c8f4599b49f3c31d0ef1d44: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:40:50.270301 2598 log.cc:1196] T f65bd8447eab4bd987e27f21274f3d27 P 75c56dc41c8f4599b49f3c31d0ef1d44: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-2/wal/wals/f65bd8447eab4bd987e27f21274f3d27
I20260807 22:40:50.270576 2598 ts_tablet_manager.cc:1939] T f65bd8447eab4bd987e27f21274f3d27 P 75c56dc41c8f4599b49f3c31d0ef1d44: Deleting consensus metadata
W20260807 22:40:50.274919 1895 connection.cc:535] server connection from 127.0.0.1:32956 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 22:40:50.274947 2347 connection.cc:535] server connection from 127.0.0.1:60024 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 22:40:50.275578 2129 connection.cc:535] server connection from 127.0.0.1:34580 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 22:40:50.278244 2536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:50.247018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57794 (local address 127.22.212.124:37321)
0807 22:40:50.247074 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:50.247077 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:50.247351 (+ 274us) server_negotiation.cc:407] Connection header received
0807 22:40:50.271141 (+ 23790us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:50.271143 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:50.271159 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:50.271200 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:50.271937 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.272608 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.273347 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.273546 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.273623 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:50.274974 (+ 1351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:50.274975 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:50.274976 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:50.274985 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:50.276862 (+ 1877us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:50.277321 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:50.277323 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:50.277323 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:50.277386 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:50.277582 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:50.277584 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:50.277584 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:50.277750 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:50.277844 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:50.278042 (+ 198us) server_negotiation.cc:299] Negotiation successful
0807 22:40:50.278137 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260807 22:40:50.285228 2107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:50.277789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57806 (local address 127.22.212.124:37321)
0807 22:40:50.277831 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:50.277834 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:50.277988 (+ 154us) server_negotiation.cc:407] Connection header received
0807 22:40:50.278098 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:50.278099 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:50.278110 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:50.278139 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:50.278827 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.279580 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.280686 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.280980 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.281018 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:50.282479 (+ 1461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:50.282480 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:50.282480 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:50.282487 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:50.284024 (+ 1537us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:50.284425 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:50.284426 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:50.284427 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:50.284483 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:50.284697 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:50.284698 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:50.284698 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:50.284818 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:50.284920 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:50.285024 (+ 104us) server_negotiation.cc:299] Negotiation successful
0807 22:40:50.285106 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260807 22:40:50.285797 2544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:50.277462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44928 (local address 127.22.212.125:41083)
0807 22:40:50.277516 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:50.277518 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:50.277970 (+ 452us) server_negotiation.cc:407] Connection header received
0807 22:40:50.278672 (+ 702us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:50.278673 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:50.278687 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:50.278746 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:50.279266 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.279737 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.280490 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:50.280709 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:50.280795 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:50.282594 (+ 1799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:50.282595 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:50.282595 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:50.282603 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:50.284389 (+ 1786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:50.284795 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:50.284796 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:50.284797 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:50.284853 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:50.285057 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:50.285058 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:50.285059 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:50.285186 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:50.285254 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:50.285586 (+ 332us) server_negotiation.cc:299] Negotiation successful
0807 22:40:50.285682 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260807 22:40:51.242828 2609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:51.242220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.22.212.65:50901)
0807 22:40:51.242676 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:51.242770 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":110,"threads_started":1}
I20260807 22:40:51.243233 2613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:51.242900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.22.212.67:53697)
0807 22:40:51.243116 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:51.243186 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":59,"threads_started":1}
W20260807 22:40:51.243249 2090 heartbeater.cc:644] Failed to heartbeat to 127.22.212.126:43419 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
W20260807 22:40:51.243410 2521 heartbeater.cc:644] Failed to heartbeat to 127.22.212.126:43419 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
I20260807 22:40:51.243537 2610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:51.242549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.22.212.66:46887)
0807 22:40:51.242948 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:51.243038 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":56,"threads_started":1}
W20260807 22:40:51.243713 2311 heartbeater.cc:644] Failed to heartbeat to 127.22.212.126:43419 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
I20260807 22:40:51.745949 2614 raft_consensus.cc:482] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23677f8da61b48e59d3faf7ab7da7ea9)
I20260807 22:40:51.746104 2614 raft_consensus.cc:504] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: false } } peers { permanent_uuid: "29971711a8104e688dc096f5f926330c" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37321 } attrs { promote: false } }
I20260807 22:40:51.746454 2614 leader_election.cc:288] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23677f8da61b48e59d3faf7ab7da7ea9 (127.22.212.126:43419), 940825a01cf04921b576d61a33cb13dc (127.22.212.125:41083)
I20260807 22:40:51.746644 2616 raft_consensus.cc:482] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23677f8da61b48e59d3faf7ab7da7ea9)
I20260807 22:40:51.746762 2616 raft_consensus.cc:504] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: false } } peers { permanent_uuid: "29971711a8104e688dc096f5f926330c" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37321 } attrs { promote: false } }
I20260807 22:40:51.746821 2618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:51.746604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.0.0.1:58872)
0807 22:40:51.746719 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:51.746773 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":47,"threads_started":1}
W20260807 22:40:51.746944 1782 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
I20260807 22:40:51.747043 2616 leader_election.cc:288] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23677f8da61b48e59d3faf7ab7da7ea9 (127.22.212.126:43419), 29971711a8104e688dc096f5f926330c (127.22.212.124:37321)
I20260807 22:40:51.747359 2618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:51.747281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.0.0.1:58888)
0807 22:40:51.747319 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:51.747338 (+ 19us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260807 22:40:51.747349 2622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:51.747153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.0.0.1:58886)
0807 22:40:51.747252 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:51.747306 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84,"thread_start_us":48,"threads_started":1}
W20260807 22:40:51.747457 1510 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
W20260807 22:40:51.747582 1782 leader_election.cc:334] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23677f8da61b48e59d3faf7ab7da7ea9 (127.22.212.126:43419): Network error: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
I20260807 22:40:51.747948 2622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:51.747841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.0.0.1:58896)
0807 22:40:51.747890 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:51.747922 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260807 22:40:51.748023 1510 leader_election.cc:334] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 23677f8da61b48e59d3faf7ab7da7ea9 (127.22.212.126:43419): Network error: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
I20260807 22:40:51.750243 2625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:51.747435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57820 (local address 127.22.212.124:37321)
0807 22:40:51.747630 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:51.747632 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:51.747640 (+ 8us) server_negotiation.cc:407] Connection header received
0807 22:40:51.747669 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:51.747670 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:51.747681 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:51.747758 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:51.747930 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:51.748553 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:51.749498 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:51.749859 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:51.749949 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:51.749959 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:51.750111 (+ 152us) server_negotiation.cc:299] Negotiation successful
0807 22:40:51.750148 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":104,"threads_started":1}
I20260807 22:40:51.750254 2620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:51.746700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44934 (local address 127.22.212.125:41083)
0807 22:40:51.747670 (+ 970us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:51.747672 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:51.747681 (+ 9us) server_negotiation.cc:407] Connection header received
0807 22:40:51.747707 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:51.747708 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:51.747719 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:51.747841 (+ 122us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:51.747966 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:51.748576 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:51.749509 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:51.749881 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:51.749969 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:51.749977 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:51.750128 (+ 151us) server_negotiation.cc:299] Negotiation successful
0807 22:40:51.750167 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":952,"thread_start_us":52,"threads_started":1}
I20260807 22:40:51.750269 2617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:51.746625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.125:41083 (local address 127.0.0.1:44934)
0807 22:40:51.746816 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:51.746827 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:51.746892 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:51.747852 (+ 960us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:51.747853 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:51.747855 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:51.747900 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:51.747902 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:51.748658 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:51.748660 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:51.749419 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:51.749421 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:51.749968 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:51.749969 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:51.750032 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:51.750036 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 22:40:51.750118 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 22:40:51.750164 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":39,"threads_started":1}
I20260807 22:40:51.750278 2623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:51.747184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:37321 (local address 127.0.0.1:57820)
0807 22:40:51.747370 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:51.747380 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:51.747439 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:51.747777 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:51.747778 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:51.747780 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:51.747844 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:51.747847 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:51.748637 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:51.748638 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:51.749403 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:51.749405 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:51.749948 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:51.749949 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:51.750012 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:51.750016 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 22:40:51.750102 (+ 86us) client_negotiation.cc:240] Negotiation successful
0807 22:40:51.750147 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":49,"threads_started":1}
I20260807 22:40:51.750519 1550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29971711a8104e688dc096f5f926330c" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "940825a01cf04921b576d61a33cb13dc" is_pre_election: true
I20260807 22:40:51.750550 1816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "940825a01cf04921b576d61a33cb13dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "29971711a8104e688dc096f5f926330c" is_pre_election: true
I20260807 22:40:51.750628 1550 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29971711a8104e688dc096f5f926330c in term 1.
I20260807 22:40:51.750651 1816 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 940825a01cf04921b576d61a33cb13dc in term 1.
I20260807 22:40:51.750797 1511 leader_election.cc:302] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29971711a8104e688dc096f5f926330c, 940825a01cf04921b576d61a33cb13dc; no voters: 23677f8da61b48e59d3faf7ab7da7ea9
I20260807 22:40:51.750875 1786 leader_election.cc:302] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29971711a8104e688dc096f5f926330c, 940825a01cf04921b576d61a33cb13dc; no voters: 23677f8da61b48e59d3faf7ab7da7ea9
I20260807 22:40:51.750921 2616 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 22:40:51.750960 2616 raft_consensus.cc:482] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 23677f8da61b48e59d3faf7ab7da7ea9)
I20260807 22:40:51.750989 2616 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [term 1 FOLLOWER]: Advancing to term 2
I20260807 22:40:51.751012 2614 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 22:40:51.751049 2614 raft_consensus.cc:482] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 23677f8da61b48e59d3faf7ab7da7ea9)
I20260807 22:40:51.751080 2614 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [term 1 FOLLOWER]: Advancing to term 2
I20260807 22:40:51.751781 2614 raft_consensus.cc:504] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: false } } peers { permanent_uuid: "29971711a8104e688dc096f5f926330c" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37321 } attrs { promote: false } }
I20260807 22:40:51.751789 2616 raft_consensus.cc:504] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: false } } peers { permanent_uuid: "29971711a8104e688dc096f5f926330c" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37321 } attrs { promote: false } }
I20260807 22:40:51.751933 2614 leader_election.cc:288] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [CANDIDATE]: Term 2 election: Requested vote from peers 23677f8da61b48e59d3faf7ab7da7ea9 (127.22.212.126:43419), 940825a01cf04921b576d61a33cb13dc (127.22.212.125:41083)
I20260807 22:40:51.751936 2616 leader_election.cc:288] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [CANDIDATE]: Term 2 election: Requested vote from peers 23677f8da61b48e59d3faf7ab7da7ea9 (127.22.212.126:43419), 29971711a8104e688dc096f5f926330c (127.22.212.124:37321)
I20260807 22:40:51.752105 2617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:51.752004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.0.0.1:58910)
0807 22:40:51.752054 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:51.752078 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260807 22:40:51.752110 1550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29971711a8104e688dc096f5f926330c" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "940825a01cf04921b576d61a33cb13dc"
I20260807 22:40:51.752192 1550 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 29971711a8104e688dc096f5f926330c in current term 2: Already voted for candidate 940825a01cf04921b576d61a33cb13dc in this term.
I20260807 22:40:51.752238 1816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "940825a01cf04921b576d61a33cb13dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "29971711a8104e688dc096f5f926330c"
I20260807 22:40:51.752305 2623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:51.752130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.0.0.1:58924)
0807 22:40:51.752229 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:51.752282 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260807 22:40:51.752331 1816 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 940825a01cf04921b576d61a33cb13dc in current term 2: Already voted for candidate 29971711a8104e688dc096f5f926330c in this term.
I20260807 22:40:51.752502 2617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:51.752362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.0.0.1:58930)
0807 22:40:51.752455 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:51.752485 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
W20260807 22:40:51.752573 1782 leader_election.cc:334] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 23677f8da61b48e59d3faf7ab7da7ea9 (127.22.212.126:43419): Network error: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
I20260807 22:40:51.752620 1782 leader_election.cc:302] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29971711a8104e688dc096f5f926330c; no voters: 23677f8da61b48e59d3faf7ab7da7ea9, 940825a01cf04921b576d61a33cb13dc
I20260807 22:40:51.752735 2623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:51.752617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.0.0.1:58936)
0807 22:40:51.752686 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:51.752713 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260807 22:40:51.752755 2614 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260807 22:40:51.752811 1510 leader_election.cc:334] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 23677f8da61b48e59d3faf7ab7da7ea9 (127.22.212.126:43419): Network error: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
I20260807 22:40:51.752861 1510 leader_election.cc:302] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 940825a01cf04921b576d61a33cb13dc; no voters: 23677f8da61b48e59d3faf7ab7da7ea9, 29971711a8104e688dc096f5f926330c
I20260807 22:40:51.752919 2616 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 22:40:52.244278 2627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:52.243649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.22.212.65:39127)
0807 22:40:52.244158 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:52.244204 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":486,"thread_start_us":90,"threads_started":1}
I20260807 22:40:52.244278 2628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:52.243980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.22.212.66:40075)
0807 22:40:52.244182 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:52.244212 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":96,"threads_started":1}
I20260807 22:40:52.244343 2629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:52.244038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.22.212.67:37495)
0807 22:40:52.244217 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:52.244296 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":55,"threads_started":1}
I20260807 22:40:53.245044 2630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:53.244772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.22.212.67:49389)
0807 22:40:53.244945 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:53.244987 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":93,"threads_started":1}
I20260807 22:40:53.245082 2631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:53.244794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.22.212.65:44053)
0807 22:40:53.244986 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:53.245025 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":69,"threads_started":1}
I20260807 22:40:53.245254 2632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:53.244981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.22.212.66:56791)
0807 22:40:53.245121 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:53.245212 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":83,"threads_started":1}
I20260807 22:40:53.295459 2635 raft_consensus.cc:482] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:40:53.295557 2635 raft_consensus.cc:504] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: false } } peers { permanent_uuid: "29971711a8104e688dc096f5f926330c" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37321 } attrs { promote: false } }
I20260807 22:40:53.295720 2635 leader_election.cc:288] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23677f8da61b48e59d3faf7ab7da7ea9 (127.22.212.126:43419), 940825a01cf04921b576d61a33cb13dc (127.22.212.125:41083)
I20260807 22:40:53.295980 1550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29971711a8104e688dc096f5f926330c" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "940825a01cf04921b576d61a33cb13dc" is_pre_election: true
I20260807 22:40:53.296109 1550 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29971711a8104e688dc096f5f926330c in term 2.
I20260807 22:40:53.296133 2637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:53.295834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.0.0.1:59186)
0807 22:40:53.296039 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:53.296086 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":132,"threads_started":1}
I20260807 22:40:53.296271 1786 leader_election.cc:302] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29971711a8104e688dc096f5f926330c, 940825a01cf04921b576d61a33cb13dc; no voters:
I20260807 22:40:53.296406 2635 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 22:40:53.296464 2635 raft_consensus.cc:482] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:40:53.296489 2635 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [term 2 FOLLOWER]: Advancing to term 3
I20260807 22:40:53.296659 2637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:53.296558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.0.0.1:59188)
0807 22:40:53.296603 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:53.296628 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260807 22:40:53.296759 1782 leader_election.cc:334] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 23677f8da61b48e59d3faf7ab7da7ea9 (127.22.212.126:43419): Network error: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
I20260807 22:40:53.297658 2635 raft_consensus.cc:504] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: false } } peers { permanent_uuid: "29971711a8104e688dc096f5f926330c" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37321 } attrs { promote: false } }
I20260807 22:40:53.297821 2635 leader_election.cc:288] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [CANDIDATE]: Term 3 election: Requested vote from peers 23677f8da61b48e59d3faf7ab7da7ea9 (127.22.212.126:43419), 940825a01cf04921b576d61a33cb13dc (127.22.212.125:41083)
I20260807 22:40:53.298004 2637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:53.297906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.0.0.1:59200)
0807 22:40:53.297945 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:53.297979 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260807 22:40:53.298002 1550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "29971711a8104e688dc096f5f926330c" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "940825a01cf04921b576d61a33cb13dc"
I20260807 22:40:53.298085 1550 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [term 2 FOLLOWER]: Advancing to term 3
I20260807 22:40:53.298393 2637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:53.298285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.0.0.1:59204)
0807 22:40:53.298342 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:53.298373 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260807 22:40:53.298465 1782 leader_election.cc:334] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 23677f8da61b48e59d3faf7ab7da7ea9 (127.22.212.126:43419): Network error: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
I20260807 22:40:53.298923 1550 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29971711a8104e688dc096f5f926330c in term 3.
I20260807 22:40:53.299218 1786 leader_election.cc:302] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29971711a8104e688dc096f5f926330c, 940825a01cf04921b576d61a33cb13dc; no voters: 23677f8da61b48e59d3faf7ab7da7ea9
I20260807 22:40:53.299322 2635 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [term 3 FOLLOWER]: Leader election won for term 3
I20260807 22:40:53.299510 2635 raft_consensus.cc:686] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [term 3 LEADER]: Becoming Leader. State: Replica: 29971711a8104e688dc096f5f926330c, State: Running, Role: LEADER
I20260807 22:40:53.299618 2635 consensus_queue.cc:237] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: false } } peers { permanent_uuid: "29971711a8104e688dc096f5f926330c" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37321 } attrs { promote: false } }
I20260807 22:40:53.299984 2639 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 29971711a8104e688dc096f5f926330c. Latest consensus state: current_term: 3 leader_uuid: "29971711a8104e688dc096f5f926330c" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: false } } peers { permanent_uuid: "29971711a8104e688dc096f5f926330c" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37321 } attrs { promote: false } } }
I20260807 22:40:53.300091 2639 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:53.300328 2641 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:40:53.300837 2641 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:40:53.300949 2641 catalog_manager.cc:1259] Loaded cluster ID: aa01039e82474ddaafdc8d1334a2a8c8
I20260807 22:40:53.300982 2641 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:40:53.301175 2641 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:40:53.301281 2641 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c: Loaded TSK: 0
I20260807 22:40:53.301431 2641 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:40:53.369258 1799 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57806:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:40:53.371029 1799 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:40:53.372205 2637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:53.372073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.0.0.1:59222)
0807 22:40:53.372133 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:53.372172 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260807 22:40:53.372303 1550 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [term 3 FOLLOWER]: Refusing update from remote peer 29971711a8104e688dc096f5f926330c: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260807 22:40:53.372639 2637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:53.372514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.0.0.1:59224)
0807 22:40:53.372575 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:53.372604 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260807 22:40:53.372591 2639 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [LEADER]: Connected to new peer: Peer: permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260807 22:40:53.372722 1782 consensus_peers.cc:487] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c -> Peer 23677f8da61b48e59d3faf7ab7da7ea9 (127.22.212.126:43419): Couldn't send request to peer 23677f8da61b48e59d3faf7ab7da7ea9. Status: Network error: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 22:40:53.373224 2644 sys_catalog.cc:455] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 29971711a8104e688dc096f5f926330c. Latest consensus state: current_term: 3 leader_uuid: "29971711a8104e688dc096f5f926330c" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: false } } peers { permanent_uuid: "29971711a8104e688dc096f5f926330c" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37321 } attrs { promote: false } } }
I20260807 22:40:53.373308 2644 sys_catalog.cc:458] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:40:53.374003 2635 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "29971711a8104e688dc096f5f926330c" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: false } } peers { permanent_uuid: "29971711a8104e688dc096f5f926330c" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37321 } attrs { promote: false } } }
I20260807 22:40:53.374106 2635 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:53.374964 2644 sys_catalog.cc:455] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "29971711a8104e688dc096f5f926330c" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "23677f8da61b48e59d3faf7ab7da7ea9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43419 } } peers { permanent_uuid: "940825a01cf04921b576d61a33cb13dc" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 41083 } attrs { promote: false } } peers { permanent_uuid: "29971711a8104e688dc096f5f926330c" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37321 } attrs { promote: false } } }
I20260807 22:40:53.375017 2645 mvcc.cc:205] Tried to move back new op lower bound from 7316039489010405376 to 7316039488715939840. Current Snapshot: MvccSnapshot[applied={T|T < 7316039489010405376}]
I20260807 22:40:53.375077 2644 sys_catalog.cc:458] T 00000000000000000000000000000000 P 940825a01cf04921b576d61a33cb13dc [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:40:53.379446 2637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:53.376078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.67:38195 (local address 127.0.0.1:60030)
0807 22:40:53.376295 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:53.376307 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:53.376362 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:53.376719 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:53.376719 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:53.376721 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:53.376768 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:53.376769 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:53.377752 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:53.377753 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:53.378497 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:53.378499 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:53.379207 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:53.379208 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:53.379277 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:53.379282 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 22:40:53.379337 (+ 55us) client_negotiation.cc:240] Negotiation successful
0807 22:40:53.379379 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201}
I20260807 22:40:53.379472 2654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:53.376137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60030 (local address 127.22.212.67:38195)
0807 22:40:53.376543 (+ 406us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:53.376545 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:53.376554 (+ 9us) server_negotiation.cc:407] Connection header received
0807 22:40:53.376582 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:53.376583 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:53.376594 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:53.376708 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:53.376848 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:53.377638 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:53.378598 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:53.379126 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:53.379199 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:53.379211 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:53.379355 (+ 144us) server_negotiation.cc:299] Negotiation successful
0807 22:40:53.379392 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":58,"threads_started":1}
I20260807 22:40:53.379797 2658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:53.376158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:39385 (local address 127.0.0.1:32980)
0807 22:40:53.376484 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:53.376494 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:53.376529 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:53.376776 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:53.376777 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:53.376779 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:53.376853 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:53.376855 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:53.377720 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:53.377721 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:53.378794 (+ 1073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:53.378796 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:53.379567 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:53.379568 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:53.379628 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:53.379632 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 22:40:53.379678 (+ 46us) client_negotiation.cc:240] Negotiation successful
0807 22:40:53.379715 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"mutex_wait_us":3,"thread_start_us":77,"threads_started":1}
I20260807 22:40:53.379833 2424 tablet_service.cc:1467] Processing CreateTablet for tablet d143ffac22f34773bf8e7768b358cb85 (DEFAULT_TABLE table=test-table [id=efd1efe273d642eea0d391203229f6ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:53.379982 2424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d143ffac22f34773bf8e7768b358cb85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:53.380014 2655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:53.376131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.66:38741 (local address 127.0.0.1:34586)
0807 22:40:53.376368 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:53.376378 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:53.376419 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:53.376627 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:53.376629 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:53.376632 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:53.376705 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:53.376708 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:53.377540 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:53.377542 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:53.378976 (+ 1434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:53.378978 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:53.379778 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:53.379779 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:53.379839 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:53.379844 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 22:40:53.379892 (+ 48us) client_negotiation.cc:240] Negotiation successful
0807 22:40:53.379932 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":218,"mutex_wait_us":35,"thread_start_us":84,"threads_started":1}
I20260807 22:40:53.380048 2660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:53.376223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32980 (local address 127.22.212.65:39385)
0807 22:40:53.376624 (+ 401us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:53.376626 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:53.376633 (+ 7us) server_negotiation.cc:407] Connection header received
0807 22:40:53.376659 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:53.376660 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:53.376670 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:53.376733 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:53.376933 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:53.377649 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:53.378878 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:53.379449 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:53.379517 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:53.379529 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:53.379926 (+ 397us) server_negotiation.cc:299] Negotiation successful
0807 22:40:53.379975 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":376,"thread_start_us":90,"threads_started":1}
I20260807 22:40:53.380223 2661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:53.376329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34586 (local address 127.22.212.66:38741)
0807 22:40:53.376436 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:53.376438 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:53.376462 (+ 24us) server_negotiation.cc:407] Connection header received
0807 22:40:53.376491 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:53.376492 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:53.376501 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:53.376572 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:53.376796 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:53.377449 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:53.379059 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:53.379672 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:53.379733 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:53.379744 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:53.380117 (+ 373us) server_negotiation.cc:299] Negotiation successful
0807 22:40:53.380165 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88,"thread_start_us":65,"threads_started":1}
I20260807 22:40:53.380232 1974 tablet_service.cc:1467] Processing CreateTablet for tablet d143ffac22f34773bf8e7768b358cb85 (DEFAULT_TABLE table=test-table [id=efd1efe273d642eea0d391203229f6ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:53.380383 1974 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d143ffac22f34773bf8e7768b358cb85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:53.381342 2662 tablet_bootstrap.cc:492] T d143ffac22f34773bf8e7768b358cb85 P 75c56dc41c8f4599b49f3c31d0ef1d44: Bootstrap starting.
I20260807 22:40:53.381542 2201 tablet_service.cc:1467] Processing CreateTablet for tablet d143ffac22f34773bf8e7768b358cb85 (DEFAULT_TABLE table=test-table [id=efd1efe273d642eea0d391203229f6ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:53.381660 2665 tablet_bootstrap.cc:492] T d143ffac22f34773bf8e7768b358cb85 P 71378a822b0244288e2f95ad5e419c9a: Bootstrap starting.
I20260807 22:40:53.381698 2201 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d143ffac22f34773bf8e7768b358cb85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:53.381819 2662 tablet_bootstrap.cc:654] T d143ffac22f34773bf8e7768b358cb85 P 75c56dc41c8f4599b49f3c31d0ef1d44: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:53.381995 2665 tablet_bootstrap.cc:654] T d143ffac22f34773bf8e7768b358cb85 P 71378a822b0244288e2f95ad5e419c9a: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:53.382362 2662 tablet_bootstrap.cc:492] T d143ffac22f34773bf8e7768b358cb85 P 75c56dc41c8f4599b49f3c31d0ef1d44: No bootstrap required, opened a new log
I20260807 22:40:53.382416 2662 ts_tablet_manager.cc:1397] T d143ffac22f34773bf8e7768b358cb85 P 75c56dc41c8f4599b49f3c31d0ef1d44: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 22:40:53.382571 2662 raft_consensus.cc:348] T d143ffac22f34773bf8e7768b358cb85 P 75c56dc41c8f4599b49f3c31d0ef1d44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75c56dc41c8f4599b49f3c31d0ef1d44" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 38195 } } peers { permanent_uuid: "bef2621d444d4e0c8c964fd8a5e4a9c9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 38741 } } peers { permanent_uuid: "71378a822b0244288e2f95ad5e419c9a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 39385 } }
I20260807 22:40:53.382628 2665 tablet_bootstrap.cc:492] T d143ffac22f34773bf8e7768b358cb85 P 71378a822b0244288e2f95ad5e419c9a: No bootstrap required, opened a new log
I20260807 22:40:53.382659 2662 raft_consensus.cc:374] T d143ffac22f34773bf8e7768b358cb85 P 75c56dc41c8f4599b49f3c31d0ef1d44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:53.382675 2665 ts_tablet_manager.cc:1397] T d143ffac22f34773bf8e7768b358cb85 P 71378a822b0244288e2f95ad5e419c9a: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 22:40:53.382684 2662 raft_consensus.cc:729] T d143ffac22f34773bf8e7768b358cb85 P 75c56dc41c8f4599b49f3c31d0ef1d44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75c56dc41c8f4599b49f3c31d0ef1d44, State: Initialized, Role: FOLLOWER
I20260807 22:40:53.382740 2662 consensus_queue.cc:260] T d143ffac22f34773bf8e7768b358cb85 P 75c56dc41c8f4599b49f3c31d0ef1d44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75c56dc41c8f4599b49f3c31d0ef1d44" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 38195 } } peers { permanent_uuid: "bef2621d444d4e0c8c964fd8a5e4a9c9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 38741 } } peers { permanent_uuid: "71378a822b0244288e2f95ad5e419c9a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 39385 } }
I20260807 22:40:53.382768 2665 raft_consensus.cc:348] T d143ffac22f34773bf8e7768b358cb85 P 71378a822b0244288e2f95ad5e419c9a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75c56dc41c8f4599b49f3c31d0ef1d44" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 38195 } } peers { permanent_uuid: "bef2621d444d4e0c8c964fd8a5e4a9c9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 38741 } } peers { permanent_uuid: "71378a822b0244288e2f95ad5e419c9a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 39385 } }
I20260807 22:40:53.382827 2665 raft_consensus.cc:374] T d143ffac22f34773bf8e7768b358cb85 P 71378a822b0244288e2f95ad5e419c9a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:53.382846 2665 raft_consensus.cc:729] T d143ffac22f34773bf8e7768b358cb85 P 71378a822b0244288e2f95ad5e419c9a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71378a822b0244288e2f95ad5e419c9a, State: Initialized, Role: FOLLOWER
I20260807 22:40:53.382890 2665 consensus_queue.cc:260] T d143ffac22f34773bf8e7768b358cb85 P 71378a822b0244288e2f95ad5e419c9a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75c56dc41c8f4599b49f3c31d0ef1d44" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 38195 } } peers { permanent_uuid: "bef2621d444d4e0c8c964fd8a5e4a9c9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 38741 } } peers { permanent_uuid: "71378a822b0244288e2f95ad5e419c9a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 39385 } }
I20260807 22:40:53.382951 2662 ts_tablet_manager.cc:1428] T d143ffac22f34773bf8e7768b358cb85 P 75c56dc41c8f4599b49f3c31d0ef1d44: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260807 22:40:53.383081 2665 ts_tablet_manager.cc:1428] T d143ffac22f34773bf8e7768b358cb85 P 71378a822b0244288e2f95ad5e419c9a: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260807 22:40:53.383275 2630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:53.383180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.22.212.67:41685)
0807 22:40:53.383224 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:53.383250 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260807 22:40:53.383497 2673 tablet_bootstrap.cc:492] T d143ffac22f34773bf8e7768b358cb85 P bef2621d444d4e0c8c964fd8a5e4a9c9: Bootstrap starting.
I20260807 22:40:53.383806 2631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:53.383702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.22.212.65:57293)
0807 22:40:53.383747 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:53.383775 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260807 22:40:53.384124 2673 tablet_bootstrap.cc:654] T d143ffac22f34773bf8e7768b358cb85 P bef2621d444d4e0c8c964fd8a5e4a9c9: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:53.384322 2087 heartbeater.cc:503] Master 127.22.212.124:37321 was elected leader, sending a full tablet report...
I20260807 22:40:53.384491 2631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:53.384407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.22.212.65:58283)
0807 22:40:53.384445 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:53.384469 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
I20260807 22:40:53.384510 2520 heartbeater.cc:503] Master 127.22.212.124:37321 was elected leader, sending a full tablet report...
I20260807 22:40:53.384709 2630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:53.384616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.22.212.67:43063)
0807 22:40:53.384650 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:53.384681 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260807 22:40:53.385105 2673 tablet_bootstrap.cc:492] T d143ffac22f34773bf8e7768b358cb85 P bef2621d444d4e0c8c964fd8a5e4a9c9: No bootstrap required, opened a new log
I20260807 22:40:53.385147 2673 ts_tablet_manager.cc:1397] T d143ffac22f34773bf8e7768b358cb85 P bef2621d444d4e0c8c964fd8a5e4a9c9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 22:40:53.385279 2673 raft_consensus.cc:348] T d143ffac22f34773bf8e7768b358cb85 P bef2621d444d4e0c8c964fd8a5e4a9c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75c56dc41c8f4599b49f3c31d0ef1d44" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 38195 } } peers { permanent_uuid: "bef2621d444d4e0c8c964fd8a5e4a9c9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 38741 } } peers { permanent_uuid: "71378a822b0244288e2f95ad5e419c9a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 39385 } }
I20260807 22:40:53.385336 2673 raft_consensus.cc:374] T d143ffac22f34773bf8e7768b358cb85 P bef2621d444d4e0c8c964fd8a5e4a9c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:53.385380 2673 raft_consensus.cc:729] T d143ffac22f34773bf8e7768b358cb85 P bef2621d444d4e0c8c964fd8a5e4a9c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bef2621d444d4e0c8c964fd8a5e4a9c9, State: Initialized, Role: FOLLOWER
I20260807 22:40:53.385433 2673 consensus_queue.cc:260] T d143ffac22f34773bf8e7768b358cb85 P bef2621d444d4e0c8c964fd8a5e4a9c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75c56dc41c8f4599b49f3c31d0ef1d44" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 38195 } } peers { permanent_uuid: "bef2621d444d4e0c8c964fd8a5e4a9c9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 38741 } } peers { permanent_uuid: "71378a822b0244288e2f95ad5e419c9a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 39385 } }
I20260807 22:40:53.385624 2673 ts_tablet_manager.cc:1428] T d143ffac22f34773bf8e7768b358cb85 P bef2621d444d4e0c8c964fd8a5e4a9c9: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260807 22:40:53.385867 2632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:53.385782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.22.212.66:41435)
0807 22:40:53.385816 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:53.385841 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
I20260807 22:40:53.386008 2310 heartbeater.cc:503] Master 127.22.212.124:37321 was elected leader, sending a full tablet report...
I20260807 22:40:53.386293 2632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:53.386203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.22.212.66:34787)
0807 22:40:53.386235 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:53.386267 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260807 22:40:53.436100 2675 raft_consensus.cc:482] T d143ffac22f34773bf8e7768b358cb85 P bef2621d444d4e0c8c964fd8a5e4a9c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:40:53.436218 2675 raft_consensus.cc:504] T d143ffac22f34773bf8e7768b358cb85 P bef2621d444d4e0c8c964fd8a5e4a9c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75c56dc41c8f4599b49f3c31d0ef1d44" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 38195 } } peers { permanent_uuid: "bef2621d444d4e0c8c964fd8a5e4a9c9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 38741 } } peers { permanent_uuid: "71378a822b0244288e2f95ad5e419c9a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 39385 } }
I20260807 22:40:53.436638 2675 leader_election.cc:288] T d143ffac22f34773bf8e7768b358cb85 P bef2621d444d4e0c8c964fd8a5e4a9c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 75c56dc41c8f4599b49f3c31d0ef1d44 (127.22.212.67:38195), 71378a822b0244288e2f95ad5e419c9a (127.22.212.65:39385)
I20260807 22:40:53.439440 2654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:53.436880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:60273 (local address 127.22.212.67:38195)
0807 22:40:53.436935 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:53.436936 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:53.436945 (+ 9us) server_negotiation.cc:407] Connection header received
0807 22:40:53.436972 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:53.436972 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:53.436984 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:53.437055 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:53.437206 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:53.437710 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:53.438727 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:53.439102 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:53.439190 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:53.439201 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:53.439337 (+ 136us) server_negotiation.cc:299] Negotiation successful
0807 22:40:53.439376 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260807 22:40:53.439440 2632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:53.436795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.67:38195 (local address 127.22.212.66:60273)
0807 22:40:53.436851 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:53.436863 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:53.436914 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:53.437062 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:53.437063 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:53.437065 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:53.437132 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:53.437134 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:53.437801 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:53.437802 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:53.438629 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:53.438631 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:53.439189 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:53.439191 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:53.439258 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:53.439261 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:40:53.439330 (+ 69us) client_negotiation.cc:240] Negotiation successful
0807 22:40:53.439368 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":38}
I20260807 22:40:53.439520 2660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:53.436887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:60271 (local address 127.22.212.65:39385)
0807 22:40:53.436936 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:53.436938 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:53.437085 (+ 147us) server_negotiation.cc:407] Connection header received
0807 22:40:53.437157 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:53.437158 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:53.437169 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:53.437249 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:53.437390 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:53.437865 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:53.438771 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:53.439126 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:53.439211 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:53.439222 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:53.439390 (+ 168us) server_negotiation.cc:299] Negotiation successful
0807 22:40:53.439428 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260807 22:40:53.439863 2681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:53.436808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:39385 (local address 127.22.212.66:60271)
0807 22:40:53.436996 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:53.437008 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:53.437100 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:53.437254 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:53.437255 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:53.437257 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:53.437313 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:53.437315 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:53.437957 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:53.437958 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:53.438680 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:53.438682 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:53.439231 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:53.439233 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:53.439311 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:53.439314 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:40:53.439383 (+ 69us) client_negotiation.cc:240] Negotiation successful
0807 22:40:53.439422 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"mutex_wait_us":1,"thread_start_us":128,"threads_started":1}
I20260807 22:40:53.439828 2456 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d143ffac22f34773bf8e7768b358cb85" candidate_uuid: "bef2621d444d4e0c8c964fd8a5e4a9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75c56dc41c8f4599b49f3c31d0ef1d44" is_pre_election: true
I20260807 22:40:53.439924 2456 raft_consensus.cc:2454] T d143ffac22f34773bf8e7768b358cb85 P 75c56dc41c8f4599b49f3c31d0ef1d44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bef2621d444d4e0c8c964fd8a5e4a9c9 in term 0.
I20260807 22:40:53.440104 2129 leader_election.cc:302] T d143ffac22f34773bf8e7768b358cb85 P bef2621d444d4e0c8c964fd8a5e4a9c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75c56dc41c8f4599b49f3c31d0ef1d44, bef2621d444d4e0c8c964fd8a5e4a9c9; no voters:
I20260807 22:40:53.440143 2006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d143ffac22f34773bf8e7768b358cb85" candidate_uuid: "bef2621d444d4e0c8c964fd8a5e4a9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71378a822b0244288e2f95ad5e419c9a" is_pre_election: true
I20260807 22:40:53.440279 2675 raft_consensus.cc:2781] T d143ffac22f34773bf8e7768b358cb85 P bef2621d444d4e0c8c964fd8a5e4a9c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:40:53.440320 2675 raft_consensus.cc:482] T d143ffac22f34773bf8e7768b358cb85 P bef2621d444d4e0c8c964fd8a5e4a9c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:40:53.440330 2006 raft_consensus.cc:2454] T d143ffac22f34773bf8e7768b358cb85 P 71378a822b0244288e2f95ad5e419c9a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bef2621d444d4e0c8c964fd8a5e4a9c9 in term 0.
I20260807 22:40:53.440349 2675 raft_consensus.cc:3037] T d143ffac22f34773bf8e7768b358cb85 P bef2621d444d4e0c8c964fd8a5e4a9c9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:53.441092 2675 raft_consensus.cc:504] T d143ffac22f34773bf8e7768b358cb85 P bef2621d444d4e0c8c964fd8a5e4a9c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75c56dc41c8f4599b49f3c31d0ef1d44" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 38195 } } peers { permanent_uuid: "bef2621d444d4e0c8c964fd8a5e4a9c9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 38741 } } peers { permanent_uuid: "71378a822b0244288e2f95ad5e419c9a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 39385 } }
I20260807 22:40:53.441247 2675 leader_election.cc:288] T d143ffac22f34773bf8e7768b358cb85 P bef2621d444d4e0c8c964fd8a5e4a9c9 [CANDIDATE]: Term 1 election: Requested vote from peers 75c56dc41c8f4599b49f3c31d0ef1d44 (127.22.212.67:38195), 71378a822b0244288e2f95ad5e419c9a (127.22.212.65:39385)
I20260807 22:40:53.441401 2006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d143ffac22f34773bf8e7768b358cb85" candidate_uuid: "bef2621d444d4e0c8c964fd8a5e4a9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71378a822b0244288e2f95ad5e419c9a"
I20260807 22:40:53.441411 2456 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d143ffac22f34773bf8e7768b358cb85" candidate_uuid: "bef2621d444d4e0c8c964fd8a5e4a9c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75c56dc41c8f4599b49f3c31d0ef1d44"
I20260807 22:40:53.441483 2456 raft_consensus.cc:3037] T d143ffac22f34773bf8e7768b358cb85 P 75c56dc41c8f4599b49f3c31d0ef1d44 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:53.441483 2006 raft_consensus.cc:3037] T d143ffac22f34773bf8e7768b358cb85 P 71378a822b0244288e2f95ad5e419c9a [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:53.442237 2456 raft_consensus.cc:2454] T d143ffac22f34773bf8e7768b358cb85 P 75c56dc41c8f4599b49f3c31d0ef1d44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bef2621d444d4e0c8c964fd8a5e4a9c9 in term 1.
I20260807 22:40:53.442273 2006 raft_consensus.cc:2454] T d143ffac22f34773bf8e7768b358cb85 P 71378a822b0244288e2f95ad5e419c9a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bef2621d444d4e0c8c964fd8a5e4a9c9 in term 1.
I20260807 22:40:53.442441 2129 leader_election.cc:302] T d143ffac22f34773bf8e7768b358cb85 P bef2621d444d4e0c8c964fd8a5e4a9c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 71378a822b0244288e2f95ad5e419c9a, 75c56dc41c8f4599b49f3c31d0ef1d44, bef2621d444d4e0c8c964fd8a5e4a9c9; no voters:
I20260807 22:40:53.442569 2675 raft_consensus.cc:2781] T d143ffac22f34773bf8e7768b358cb85 P bef2621d444d4e0c8c964fd8a5e4a9c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:40:53.442761 2675 raft_consensus.cc:686] T d143ffac22f34773bf8e7768b358cb85 P bef2621d444d4e0c8c964fd8a5e4a9c9 [term 1 LEADER]: Becoming Leader. State: Replica: bef2621d444d4e0c8c964fd8a5e4a9c9, State: Running, Role: LEADER
I20260807 22:40:53.442871 2675 consensus_queue.cc:237] T d143ffac22f34773bf8e7768b358cb85 P bef2621d444d4e0c8c964fd8a5e4a9c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75c56dc41c8f4599b49f3c31d0ef1d44" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 38195 } } peers { permanent_uuid: "bef2621d444d4e0c8c964fd8a5e4a9c9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 38741 } } peers { permanent_uuid: "71378a822b0244288e2f95ad5e419c9a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 39385 } }
I20260807 22:40:53.443068 2681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:53.442978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.22.212.66:54721)
0807 22:40:53.443011 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:53.443040 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
I20260807 22:40:53.443660 1799 catalog_manager.cc:5495] T d143ffac22f34773bf8e7768b358cb85 P bef2621d444d4e0c8c964fd8a5e4a9c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to bef2621d444d4e0c8c964fd8a5e4a9c9 (127.22.212.66). New cstate: current_term: 1 leader_uuid: "bef2621d444d4e0c8c964fd8a5e4a9c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75c56dc41c8f4599b49f3c31d0ef1d44" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 38195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bef2621d444d4e0c8c964fd8a5e4a9c9" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 38741 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71378a822b0244288e2f95ad5e419c9a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 39385 } health_report { overall_health: UNKNOWN } } }
I20260807 22:40:53.454707 2661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:53.452649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34592 (local address 127.22.212.66:38741)
0807 22:40:53.452687 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:53.452689 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:53.452719 (+ 30us) server_negotiation.cc:407] Connection header received
0807 22:40:53.452779 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:53.452779 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:53.452795 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:53.452859 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:40:53.452942 (+ 83us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:53.453380 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:53.454092 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:53.454270 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:53.454326 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:53.454450 (+ 124us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:40:53.454548 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:40:53.454602 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:53.454642 (+ 40us) server_negotiation.cc:299] Negotiation successful
0807 22:40:53.454659 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 22:40:53.455701 2456 raft_consensus.cc:1261] T d143ffac22f34773bf8e7768b358cb85 P 75c56dc41c8f4599b49f3c31d0ef1d44 [term 1 FOLLOWER]: Refusing update from remote peer bef2621d444d4e0c8c964fd8a5e4a9c9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:40:53.455996 2006 raft_consensus.cc:1261] T d143ffac22f34773bf8e7768b358cb85 P 71378a822b0244288e2f95ad5e419c9a [term 1 FOLLOWER]: Refusing update from remote peer bef2621d444d4e0c8c964fd8a5e4a9c9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:40:53.455991 2675 consensus_queue.cc:1035] T d143ffac22f34773bf8e7768b358cb85 P bef2621d444d4e0c8c964fd8a5e4a9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75c56dc41c8f4599b49f3c31d0ef1d44" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 38195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:40:53.456298 2675 consensus_queue.cc:1035] T d143ffac22f34773bf8e7768b358cb85 P bef2621d444d4e0c8c964fd8a5e4a9c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71378a822b0244288e2f95ad5e419c9a" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 39385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:40:53.456849 2630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:53.456730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.22.212.67:36513)
0807 22:40:53.456784 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:53.456821 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260807 22:40:53.457813 2631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:53.457577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.22.212.65:41417)
0807 22:40:53.457728 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:53.457759 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135}
I20260807 22:40:53.458053 2681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:53.457879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.22.212.66:41031)
0807 22:40:53.457989 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:53.458018 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260807 22:40:53.458443 2686 mvcc.cc:205] Tried to move back new op lower bound from 7316039489352642560 to 7316039489302585344. Current Snapshot: MvccSnapshot[applied={T|T < 7316039489352642560}]
I20260807 22:40:53.458838 2630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:53.458710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.22.212.67:45697)
0807 22:40:53.458783 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:53.458810 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260807 22:40:53.460834 2631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:53.460746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.22.212.65:50315)
0807 22:40:53.460780 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:53.460804 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
I20260807 22:40:53.460950 2681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:53.460744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:43419 (local address 127.22.212.66:42449)
0807 22:40:53.460895 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:53.460923 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:43419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137}
I20260807 22:40:53.461127 1799 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57806:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:40:53.461213 1799 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57806:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:40:53.461200 2690 mvcc.cc:205] Tried to move back new op lower bound from 7316039489352642560 to 7316039489302585344. Current Snapshot: MvccSnapshot[applied={T|T < 7316039489352642560 or (T in {7316039489352642560})}]
I20260807 22:40:53.462498 1799 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29971711a8104e688dc096f5f926330c: Sending DeleteTablet for 3 replicas of tablet d143ffac22f34773bf8e7768b358cb85
I20260807 22:40:53.462802 2424 tablet_service.cc:1514] Processing DeleteTablet for tablet d143ffac22f34773bf8e7768b358cb85 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:53 UTC) from {username='oryx', principal='oryx/127.22.212.124@KRBTEST.COM'} at 127.0.0.1:60030
I20260807 22:40:53.462836 2201 tablet_service.cc:1514] Processing DeleteTablet for tablet d143ffac22f34773bf8e7768b358cb85 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:53 UTC) from {username='oryx', principal='oryx/127.22.212.124@KRBTEST.COM'} at 127.0.0.1:34586
I20260807 22:40:53.462965 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 1751
I20260807 22:40:53.463048 1974 tablet_service.cc:1514] Processing DeleteTablet for tablet d143ffac22f34773bf8e7768b358cb85 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:53 UTC) from {username='oryx', principal='oryx/127.22.212.124@KRBTEST.COM'} at 127.0.0.1:32980
I20260807 22:40:53.476776 2701 tablet_replica.cc:330] T d143ffac22f34773bf8e7768b358cb85 P 75c56dc41c8f4599b49f3c31d0ef1d44: stopping tablet replica
I20260807 22:40:53.476878 2701 raft_consensus.cc:2229] T d143ffac22f34773bf8e7768b358cb85 P 75c56dc41c8f4599b49f3c31d0ef1d44 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:40:53.476943 2701 raft_consensus.cc:2258] T d143ffac22f34773bf8e7768b358cb85 P 75c56dc41c8f4599b49f3c31d0ef1d44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:53.477085 2698 tablet_replica.cc:330] T d143ffac22f34773bf8e7768b358cb85 P bef2621d444d4e0c8c964fd8a5e4a9c9: stopping tablet replica
I20260807 22:40:53.477170 2698 raft_consensus.cc:2229] T d143ffac22f34773bf8e7768b358cb85 P bef2621d444d4e0c8c964fd8a5e4a9c9 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:40:53.477290 2698 raft_consensus.cc:2258] T d143ffac22f34773bf8e7768b358cb85 P bef2621d444d4e0c8c964fd8a5e4a9c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:53.477332 2701 ts_tablet_manager.cc:1905] T d143ffac22f34773bf8e7768b358cb85 P 75c56dc41c8f4599b49f3c31d0ef1d44: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:53.477705 2698 ts_tablet_manager.cc:1905] T d143ffac22f34773bf8e7768b358cb85 P bef2621d444d4e0c8c964fd8a5e4a9c9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:53.479290 2701 ts_tablet_manager.cc:1918] T d143ffac22f34773bf8e7768b358cb85 P 75c56dc41c8f4599b49f3c31d0ef1d44: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:40:53.479321 2698 ts_tablet_manager.cc:1918] T d143ffac22f34773bf8e7768b358cb85 P bef2621d444d4e0c8c964fd8a5e4a9c9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:40:53.479370 2698 log.cc:1196] T d143ffac22f34773bf8e7768b358cb85 P bef2621d444d4e0c8c964fd8a5e4a9c9: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-1/wal/wals/d143ffac22f34773bf8e7768b358cb85
I20260807 22:40:53.479454 2701 log.cc:1196] T d143ffac22f34773bf8e7768b358cb85 P 75c56dc41c8f4599b49f3c31d0ef1d44: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786142418640232-23377-0/minicluster-data/ts-2/wal/wals/d143ffac22f34773bf8e7768b358cb85
I20260807 22:40:53.479633 2698 ts_tablet_manager.cc:1939] T d143ffac22f34773bf8e7768b358cb85 P bef2621d444d4e0c8c964fd8a5e4a9c9: Deleting consensus metadata
I20260807 22:40:53.479967 2701 ts_tablet_manager.cc:1939] T d143ffac22f34773bf8e7768b358cb85 P 75c56dc41c8f4599b49f3c31d0ef1d44: Deleting consensus metadata
I20260807 22:40:53.479984 1785 catalog_manager.cc:4841] TS bef2621d444d4e0c8c964fd8a5e4a9c9 (127.22.212.66:38741): tablet d143ffac22f34773bf8e7768b358cb85 (table test-table [id=efd1efe273d642eea0d391203229f6ff]) successfully deleted
I20260807 22:40:53.480369 1783 catalog_manager.cc:4841] TS 75c56dc41c8f4599b49f3c31d0ef1d44 (127.22.212.67:38195): tablet d143ffac22f34773bf8e7768b358cb85 (table test-table [id=efd1efe273d642eea0d391203229f6ff]) successfully deleted
I20260807 22:40:53.482839 2655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:53.482731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:39385 (local address 127.0.0.1:32994)
0807 22:40:53.482775 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:53.482804 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.65:39385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
W20260807 22:40:53.483021 1786 catalog_manager.cc:4584] TS 71378a822b0244288e2f95ad5e419c9a (127.22.212.65:39385): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d143ffac22f34773bf8e7768b358cb85: Network error: Client connection negotiation failed: client connection to 127.22.212.65:39385: connect: Connection refused (error 111)
I20260807 22:40:53.483049 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 2108
I20260807 22:40:53.494460 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 2323
I20260807 22:40:53.512676 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 1334
I20260807 22:40:53.523329 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 1618
2026-08-07T22:40:53Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (6497 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:40:53 dist-test-slave-2d19 krb5kdc[2705](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:40:53 dist-test-slave-2d19 krb5kdc[2705](info): set up 2 sockets
Aug 07 22:40:53 dist-test-slave-2d19 krb5kdc[2705](info): commencing operation
krb5kdc: starting...
W20260807 22:40:54.785591 23377 mini_kdc.cc:121] Time spent starting KDC: real 1.236s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Aug 07 22:40:54 dist-test-slave-2d19 krb5kdc[2705](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142454, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:40:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:40:54Z Disabled control of system clock
WARNING: no policy specified for oryx/127.22.212.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.212.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.212.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.126.keytab.
Entry for principal oryx/127.22.212.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.126.keytab.
I20260807 22:40:54.911394 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:41613
--webserver_interface=127.22.212.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.126.keytab
--principal=oryx/127.22.212.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:40247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:41613
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:54.994553 2719 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:54.994803 2719 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:54.994840 2719 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:54.995999 2719 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:40:54.996069 2719 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 22:40:54.996091 2719 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:54.996114 2719 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:54.996145 2719 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:40:54.996167 2719 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:40:54.997736 2719 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:40247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:41613
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.126.keytab
--principal=oryx/127.22.212.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:41613
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2719
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:54.998025 2719 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:54.998258 2719 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:55.003311 2729 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:55.003288 2728 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:55.003417 2719 server_base.cc:1034] running on GCE node
W20260807 22:40:55.003306 2731 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:55.003929 2719 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:55.004302 2719 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:55.005486 2719 hybrid_clock.cc:648] HybridClock initialized: now 1786142455005466 us; error 35 us; skew 500 ppm
Aug 07 22:40:55 dist-test-slave-2d19 krb5kdc[2705](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142455, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.212.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:55.008075 2719 init.cc:377] Logged in from keytab as oryx/127.22.212.126@KRBTEST.COM (short username oryx)
I20260807 22:40:55.008569 2719 webserver.cc:460] Webserver started at http://127.22.212.126:42401/ using document root <none> and password file <none>
I20260807 22:40:55.008759 2719 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:55.008798 2719 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:55.008930 2719 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:55.009994 2719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "f4ad6f156ba44a968bb94ed62d557e32"
format_stamp: "Formatted at 2026-08-07 22:40:55 on dist-test-slave-2d19"
server_key: "45ea66e34f73f01c4a4be83f993a8216"
server_key_iv: "90aa843af247c41fe1c2b10185d4a5ed"
server_key_version: "encryptionkey@0"
I20260807 22:40:55.010315 2719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "f4ad6f156ba44a968bb94ed62d557e32"
format_stamp: "Formatted at 2026-08-07 22:40:55 on dist-test-slave-2d19"
server_key: "45ea66e34f73f01c4a4be83f993a8216"
server_key_iv: "90aa843af247c41fe1c2b10185d4a5ed"
server_key_version: "encryptionkey@0"
I20260807 22:40:55.011739 2719 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 22:40:55.012567 2741 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:55.012774 2719 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:40:55.012895 2719 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "f4ad6f156ba44a968bb94ed62d557e32"
format_stamp: "Formatted at 2026-08-07 22:40:55 on dist-test-slave-2d19"
server_key: "45ea66e34f73f01c4a4be83f993a8216"
server_key_iv: "90aa843af247c41fe1c2b10185d4a5ed"
server_key_version: "encryptionkey@0"
I20260807 22:40:55.013005 2719 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:55.028826 2719 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:55.030819 2719 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:55.031003 2719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:55.035892 2719 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:41613
I20260807 22:40:55.035946 2829 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:41613 every 8 connection(s)
I20260807 22:40:55.036334 2719 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:40:55.036742 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 2719
I20260807 22:40:55.036865 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:40:55.037091 23377 external_mini_cluster.cc:1428] Setting key 6fc04cc96559da366061c215b310a83c
I20260807 22:40:55.037272 2830 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:55.040738 2830 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4ad6f156ba44a968bb94ed62d557e32: Bootstrap starting.
I20260807 22:40:55.041472 2830 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f4ad6f156ba44a968bb94ed62d557e32: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:55.041786 2830 log.cc:824] T 00000000000000000000000000000000 P f4ad6f156ba44a968bb94ed62d557e32: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:55.042616 2830 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4ad6f156ba44a968bb94ed62d557e32: No bootstrap required, opened a new log
Aug 07 22:40:55 dist-test-slave-2d19 krb5kdc[2705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142454, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM
I20260807 22:40:55.044988 2830 raft_consensus.cc:348] T 00000000000000000000000000000000 P f4ad6f156ba44a968bb94ed62d557e32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4ad6f156ba44a968bb94ed62d557e32" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 41613 } }
I20260807 22:40:55.045168 2830 raft_consensus.cc:374] T 00000000000000000000000000000000 P f4ad6f156ba44a968bb94ed62d557e32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:55.045199 2830 raft_consensus.cc:729] T 00000000000000000000000000000000 P f4ad6f156ba44a968bb94ed62d557e32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ad6f156ba44a968bb94ed62d557e32, State: Initialized, Role: FOLLOWER
I20260807 22:40:55.045358 2830 consensus_queue.cc:260] T 00000000000000000000000000000000 P f4ad6f156ba44a968bb94ed62d557e32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4ad6f156ba44a968bb94ed62d557e32" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 41613 } }
I20260807 22:40:55.045460 2830 raft_consensus.cc:388] T 00000000000000000000000000000000 P f4ad6f156ba44a968bb94ed62d557e32 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:40:55.045506 2830 raft_consensus.cc:482] T 00000000000000000000000000000000 P f4ad6f156ba44a968bb94ed62d557e32 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:40:55.045555 2830 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f4ad6f156ba44a968bb94ed62d557e32 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:55.046051 2830 raft_consensus.cc:504] T 00000000000000000000000000000000 P f4ad6f156ba44a968bb94ed62d557e32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4ad6f156ba44a968bb94ed62d557e32" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 41613 } }
I20260807 22:40:55.046171 2830 leader_election.cc:302] T 00000000000000000000000000000000 P f4ad6f156ba44a968bb94ed62d557e32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f4ad6f156ba44a968bb94ed62d557e32; no voters:
I20260807 22:40:55.046361 2830 leader_election.cc:288] T 00000000000000000000000000000000 P f4ad6f156ba44a968bb94ed62d557e32 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:40:55.046423 2837 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f4ad6f156ba44a968bb94ed62d557e32 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:40:55.046603 2837 raft_consensus.cc:686] T 00000000000000000000000000000000 P f4ad6f156ba44a968bb94ed62d557e32 [term 1 LEADER]: Becoming Leader. State: Replica: f4ad6f156ba44a968bb94ed62d557e32, State: Running, Role: LEADER
I20260807 22:40:55.046651 2830 sys_catalog.cc:564] T 00000000000000000000000000000000 P f4ad6f156ba44a968bb94ed62d557e32 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:40:55.046732 2837 consensus_queue.cc:237] T 00000000000000000000000000000000 P f4ad6f156ba44a968bb94ed62d557e32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4ad6f156ba44a968bb94ed62d557e32" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 41613 } }
I20260807 22:40:55.047185 2842 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4ad6f156ba44a968bb94ed62d557e32 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f4ad6f156ba44a968bb94ed62d557e32. Latest consensus state: current_term: 1 leader_uuid: "f4ad6f156ba44a968bb94ed62d557e32" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4ad6f156ba44a968bb94ed62d557e32" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 41613 } } }
I20260807 22:40:55.047327 2842 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4ad6f156ba44a968bb94ed62d557e32 [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:55.047827 2839 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4ad6f156ba44a968bb94ed62d557e32 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f4ad6f156ba44a968bb94ed62d557e32" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4ad6f156ba44a968bb94ed62d557e32" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 41613 } } }
I20260807 22:40:55.047988 2839 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4ad6f156ba44a968bb94ed62d557e32 [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:55.048344 2853 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:40:55.048969 2853 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:40:55.049304 2834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:55.037669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49572 (local address 127.22.212.126:41613)
0807 22:40:55.037847 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:55.037856 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:55.037894 (+ 38us) server_negotiation.cc:407] Connection header received
0807 22:40:55.038411 (+ 517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:55.038417 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:55.038464 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:55.038577 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:55.039472 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.040605 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.041648 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.042124 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.042210 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:55.044833 (+ 2623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:55.044837 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:55.044838 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:55.044851 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:55.047023 (+ 2172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:55.047525 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:55.047528 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:55.047528 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:55.047638 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:55.047877 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:55.047878 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:55.047878 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:55.048236 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:55.048414 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:55.048954 (+ 540us) server_negotiation.cc:299] Negotiation successful
0807 22:40:55.049107 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":98,"threads_started":1}
I20260807 22:40:55.050840 2853 catalog_manager.cc:1347] Generated new cluster ID: d0c9d3aaec134c0a808660da0ece0789
I20260807 22:40:55.050901 2853 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:40:55.065399 2853 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:40:55.066023 2853 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:40:55.068982 2853 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f4ad6f156ba44a968bb94ed62d557e32: Generated new TSK 0
I20260807 22:40:55.069151 2853 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.22.212.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.212.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.212.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.65.keytab.
Entry for principal oryx/127.22.212.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.65.keytab.
I20260807 22:40:55.100059 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.65:0
--local_ip_for_outbound_sockets=127.22.212.65
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:41613
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.65.keytab
--principal=oryx/127.22.212.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:40247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:55.185627 2870 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:55.185833 2870 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:55.185858 2870 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:55.187032 2870 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:55.187079 2870 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:55.187099 2870 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 22:40:55.187158 2870 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.65
I20260807 22:40:55.188717 2870 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:40247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.65.keytab
--principal=oryx/127.22.212.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.212.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.22.212.126:41613
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2870
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.65
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:55.188982 2870 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:55.189240 2870 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:55.194476 2878 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:55.194481 2875 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:55.194491 2876 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:55.194631 2870 server_base.cc:1034] running on GCE node
I20260807 22:40:55.194927 2870 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:55.195142 2870 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:55.196306 2870 hybrid_clock.cc:648] HybridClock initialized: now 1786142455196290 us; error 30 us; skew 500 ppm
Aug 07 22:40:55 dist-test-slave-2d19 krb5kdc[2705](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142455, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.212.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:55.198873 2870 init.cc:377] Logged in from keytab as oryx/127.22.212.65@KRBTEST.COM (short username oryx)
I20260807 22:40:55.199323 2870 webserver.cc:460] Webserver started at http://127.22.212.65:34423/ using document root <none> and password file <none>
I20260807 22:40:55.199592 2870 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:55.199640 2870 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:55.199759 2870 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:55.200891 2870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-0/data/instance:
uuid: "97f0239d08c24e56b5327fee7aa03331"
format_stamp: "Formatted at 2026-08-07 22:40:55 on dist-test-slave-2d19"
server_key: "88b68bf2409cd9523f548c88c2d988c4"
server_key_iv: "c55c67872d6246b8ca89e5c08cdc8995"
server_key_version: "encryptionkey@0"
I20260807 22:40:55.201251 2870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance:
uuid: "97f0239d08c24e56b5327fee7aa03331"
format_stamp: "Formatted at 2026-08-07 22:40:55 on dist-test-slave-2d19"
server_key: "88b68bf2409cd9523f548c88c2d988c4"
server_key_iv: "c55c67872d6246b8ca89e5c08cdc8995"
server_key_version: "encryptionkey@0"
I20260807 22:40:55.202625 2870 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 22:40:55.203329 2893 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:55.203529 2870 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 22:40:55.203616 2870 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-0/wal
uuid: "97f0239d08c24e56b5327fee7aa03331"
format_stamp: "Formatted at 2026-08-07 22:40:55 on dist-test-slave-2d19"
server_key: "88b68bf2409cd9523f548c88c2d988c4"
server_key_iv: "c55c67872d6246b8ca89e5c08cdc8995"
server_key_version: "encryptionkey@0"
I20260807 22:40:55.203671 2870 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:55.225956 2870 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:55.227952 2870 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:55.228084 2870 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:55.228679 2870 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:55.228721 2870 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:55.228745 2870 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:55.228758 2870 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 22:40:55 dist-test-slave-2d19 krb5kdc[2705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142455, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.212.65@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM
I20260807 22:40:55.236742 2870 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.65:38699
I20260807 22:40:55.237195 2870 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
I20260807 22:40:55.238125 3065 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.65:38699 every 8 connection(s)
I20260807 22:40:55.241694 2834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:55.229161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:54519 (local address 127.22.212.126:41613)
0807 22:40:55.229240 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:55.229243 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:55.229418 (+ 175us) server_negotiation.cc:407] Connection header received
0807 22:40:55.230035 (+ 617us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:55.230036 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:55.230051 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:55.230145 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:55.231063 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.232029 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.233767 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.234277 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.234462 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:55.237376 (+ 2914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:55.237377 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:55.237378 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:55.237386 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:55.239982 (+ 2596us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:55.240599 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:55.240601 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:55.240601 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:55.240674 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:55.241036 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:55.241038 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:55.241038 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:55.241214 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:55.241293 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:55.241555 (+ 262us) server_negotiation.cc:299] Negotiation successful
0807 22:40:55.241628 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 22:40:55.241887 2908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:55.229132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:41613 (local address 127.22.212.65:54519)
0807 22:40:55.229280 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:55.229322 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:55.229908 (+ 586us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:55.230279 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:55.230285 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:55.230657 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:55.230944 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:55.230952 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.232157 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.232159 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:55.233658 (+ 1499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:55.233662 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.234573 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.234574 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:55.234721 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:55.235308 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:55.235319 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:55.237252 (+ 1933us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:55.240087 (+ 2835us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:55.240094 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:55.240096 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:55.240495 (+ 399us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:55.240753 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:55.240754 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:55.240755 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:55.240916 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:55.241300 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:55.241305 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:55.241428 (+ 123us) client_negotiation.cc:769] Sending connection context
0807 22:40:55.241515 (+ 87us) client_negotiation.cc:240] Negotiation successful
0807 22:40:55.241647 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":79,"threads_started":1}
I20260807 22:40:55.242452 3068 heartbeater.cc:347] Connected to a master server at 127.22.212.126:41613
I20260807 22:40:55.242563 3068 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:55.242749 3068 heartbeater.cc:511] Master 127.22.212.126:41613 requested a full tablet report, sending...
I20260807 22:40:55.243314 2762 ts_manager.cc:194] Registered new tserver with Master: 97f0239d08c24e56b5327fee7aa03331 (127.22.212.65:38699)
I20260807 22:40:55.244319 2762 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.22.212.65@KRBTEST.COM'} at 127.22.212.65:54519
I20260807 22:40:55.246057 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 2870
I20260807 22:40:55.246191 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance
I20260807 22:40:55.246398 23377 external_mini_cluster.cc:1428] Setting key a29ca1d86ab6f378157ea6a2e8f3a2ee
I20260807 22:40:55.249477 2834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:55.243577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:42913 (local address 127.22.212.126:41613)
0807 22:40:55.243621 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:55.243623 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:55.243710 (+ 87us) server_negotiation.cc:407] Connection header received
0807 22:40:55.243774 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:55.243774 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:55.243782 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:55.243822 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:55.244147 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.244742 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.245590 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.245763 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.245816 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:55.246814 (+ 998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:55.246815 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:55.246815 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:55.246822 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:55.248348 (+ 1526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:55.248716 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:55.248717 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:55.248717 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:55.248763 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:55.248961 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:55.248962 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:55.248962 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:55.249074 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:55.249153 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:55.249313 (+ 160us) server_negotiation.cc:299] Negotiation successful
0807 22:40:55.249388 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 22:40:55.249482 3079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:55.243493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:41613 (local address 127.22.212.65:42913)
0807 22:40:55.243647 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:55.243658 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:55.243720 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:55.243838 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:55.243839 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:55.244025 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:55.244085 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:55.244087 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.244809 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.244810 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:55.245503 (+ 693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:55.245506 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.245816 (+ 310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.245816 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:55.245857 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:55.246308 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:55.246313 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:55.246717 (+ 404us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:55.248431 (+ 1714us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:55.248432 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:55.248432 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:55.248647 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:55.248824 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:55.248824 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:55.248825 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:55.248883 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:55.249158 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:55.249159 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:55.249201 (+ 42us) client_negotiation.cc:769] Sending connection context
0807 22:40:55.249288 (+ 87us) client_negotiation.cc:240] Negotiation successful
0807 22:40:55.249390 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":97,"threads_started":1}
WARNING: no policy specified for oryx/127.22.212.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.212.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.212.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.66.keytab.
Entry for principal oryx/127.22.212.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.66.keytab.
I20260807 22:40:55.275111 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.66:0
--local_ip_for_outbound_sockets=127.22.212.66
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:41613
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.66.keytab
--principal=oryx/127.22.212.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:40247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:55.363467 3083 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:55.363740 3083 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:55.363783 3083 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:55.365064 3083 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:55.365141 3083 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:55.365177 3083 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 22:40:55.365240 3083 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.66
I20260807 22:40:55.366825 3083 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:40247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.66.keytab
--principal=oryx/127.22.212.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.212.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.22.212.126:41613
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3083
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.66
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:55.367120 3083 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:55.367363 3083 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:55.372805 3092 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:55.372794 3090 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:55.372889 3083 server_base.cc:1034] running on GCE node
W20260807 22:40:55.372813 3089 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:55.373360 3083 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:55.373688 3083 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:55.374867 3083 hybrid_clock.cc:648] HybridClock initialized: now 1786142455374856 us; error 29 us; skew 500 ppm
Aug 07 22:40:55 dist-test-slave-2d19 krb5kdc[2705](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142455, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.212.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:55.377532 3083 init.cc:377] Logged in from keytab as oryx/127.22.212.66@KRBTEST.COM (short username oryx)
I20260807 22:40:55.377936 3083 webserver.cc:460] Webserver started at http://127.22.212.66:43315/ using document root <none> and password file <none>
I20260807 22:40:55.378132 3083 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:55.378173 3083 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:55.378264 3083 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:55.379287 3083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-1/data/instance:
uuid: "242107e4cd7342ab8039f1231fd213f7"
format_stamp: "Formatted at 2026-08-07 22:40:55 on dist-test-slave-2d19"
server_key: "c1b03cc12ca98aacdcfcfea022370ac1"
server_key_iv: "aa3b1d1c22dd9f553acd24e2b71240ca"
server_key_version: "encryptionkey@0"
I20260807 22:40:55.379594 3083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance:
uuid: "242107e4cd7342ab8039f1231fd213f7"
format_stamp: "Formatted at 2026-08-07 22:40:55 on dist-test-slave-2d19"
server_key: "c1b03cc12ca98aacdcfcfea022370ac1"
server_key_iv: "aa3b1d1c22dd9f553acd24e2b71240ca"
server_key_version: "encryptionkey@0"
I20260807 22:40:55.381067 3083 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 22:40:55.381767 3104 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:55.381943 3083 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:55.382035 3083 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-1/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-1/wal
uuid: "242107e4cd7342ab8039f1231fd213f7"
format_stamp: "Formatted at 2026-08-07 22:40:55 on dist-test-slave-2d19"
server_key: "c1b03cc12ca98aacdcfcfea022370ac1"
server_key_iv: "aa3b1d1c22dd9f553acd24e2b71240ca"
server_key_version: "encryptionkey@0"
I20260807 22:40:55.382093 3083 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:55.402019 3083 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:55.404505 3083 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:55.404673 3083 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:55.405241 3083 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:55.405284 3083 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:55.405310 3083 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:55.405357 3083 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:55.412617 3083 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.66:46695
I20260807 22:40:55.412694 3293 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.66:46695 every 8 connection(s)
Aug 07 22:40:55 dist-test-slave-2d19 krb5kdc[2705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142455, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.212.66@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM
I20260807 22:40:55.413002 3083 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
I20260807 22:40:55.416182 2834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:55.405754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:40899 (local address 127.22.212.126:41613)
0807 22:40:55.405831 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:55.405833 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:55.406010 (+ 177us) server_negotiation.cc:407] Connection header received
0807 22:40:55.406706 (+ 696us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:55.406708 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:55.406722 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:55.406777 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:55.407805 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.408671 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.410439 (+ 1768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.410694 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.410747 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:55.413543 (+ 2796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:55.413545 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:55.413545 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:55.413554 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:55.414723 (+ 1169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:55.415137 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:55.415138 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:55.415139 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:55.415232 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:55.415500 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:55.415501 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:55.415501 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:55.415646 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:55.415724 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:55.415994 (+ 270us) server_negotiation.cc:299] Negotiation successful
0807 22:40:55.416092 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 22:40:55.416385 3119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:55.405734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:41613 (local address 127.22.212.66:40899)
0807 22:40:55.405896 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:55.405936 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:55.406601 (+ 665us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:55.406898 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:55.406904 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:55.407336 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:55.407681 (+ 345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:55.407689 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.408780 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.408781 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:55.410323 (+ 1542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:55.410327 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.410776 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.410777 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:55.410950 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:55.411577 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:55.411588 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:55.413458 (+ 1870us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:55.414810 (+ 1352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:55.414816 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:55.414819 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:55.415049 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:55.415306 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:55.415307 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:55.415308 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:55.415423 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:55.415714 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:55.415720 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:55.415861 (+ 141us) client_negotiation.cc:769] Sending connection context
0807 22:40:55.415973 (+ 112us) client_negotiation.cc:240] Negotiation successful
0807 22:40:55.416127 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":92,"threads_started":1}
I20260807 22:40:55.416906 3295 heartbeater.cc:347] Connected to a master server at 127.22.212.126:41613
I20260807 22:40:55.416999 3295 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:55.417201 3295 heartbeater.cc:511] Master 127.22.212.126:41613 requested a full tablet report, sending...
I20260807 22:40:55.417644 2763 ts_manager.cc:194] Registered new tserver with Master: 242107e4cd7342ab8039f1231fd213f7 (127.22.212.66:46695)
I20260807 22:40:55.418208 2763 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.22.212.66@KRBTEST.COM'} at 127.22.212.66:40899
I20260807 22:40:55.420815 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 3083
I20260807 22:40:55.420928 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance
I20260807 22:40:55.421161 23377 external_mini_cluster.cc:1428] Setting key eb9a16eb0683a086f6d6d48a081d20eb
I20260807 22:40:55.423916 2834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:55.418122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:34309 (local address 127.22.212.126:41613)
0807 22:40:55.418164 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:55.418166 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:55.418289 (+ 123us) server_negotiation.cc:407] Connection header received
0807 22:40:55.418399 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:55.418400 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:55.418412 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:55.418473 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:55.418775 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.419238 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.419960 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.420167 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.420242 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:55.421244 (+ 1002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:55.421245 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:55.421246 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:55.421254 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:55.422681 (+ 1427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:55.423075 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:55.423076 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:55.423076 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:55.423127 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:55.423321 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:55.423322 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:55.423322 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:55.423454 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:55.423580 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:55.423750 (+ 170us) server_negotiation.cc:299] Negotiation successful
0807 22:40:55.423828 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 22:40:55.423934 3307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:55.418040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:41613 (local address 127.22.212.66:34309)
0807 22:40:55.418202 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:55.418216 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:55.418305 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:55.418483 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:55.418484 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:55.418644 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:55.418698 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:55.418699 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.419334 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.419335 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:55.419874 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:55.419876 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.420242 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.420243 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:55.420344 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:55.420704 (+ 360us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:55.420709 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:55.421140 (+ 431us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:55.422767 (+ 1627us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:55.422768 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:55.422768 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:55.422994 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:55.423189 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:55.423189 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:55.423190 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:55.423260 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:55.423577 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:55.423578 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:55.423629 (+ 51us) client_negotiation.cc:769] Sending connection context
0807 22:40:55.423723 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 22:40:55.423831 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":74,"threads_started":1}
WARNING: no policy specified for oryx/127.22.212.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.212.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.212.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.67.keytab.
Entry for principal oryx/127.22.212.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.67.keytab.
I20260807 22:40:55.448302 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.67:0
--local_ip_for_outbound_sockets=127.22.212.67
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:41613
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.67.keytab
--principal=oryx/127.22.212.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:40247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:55.536072 3312 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:55.536358 3312 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:55.536393 3312 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:55.537680 3312 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:55.537724 3312 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:55.537743 3312 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 22:40:55.537804 3312 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.67
I20260807 22:40:55.539371 3312 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:40247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.67.keytab
--principal=oryx/127.22.212.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.212.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.22.212.126:41613
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3312
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.67
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:55.539619 3312 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:55.539853 3312 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:55.545352 3326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:55.545361 3320 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:55.545418 3321 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:55.545382 3312 server_base.cc:1034] running on GCE node
I20260807 22:40:55.545754 3312 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:55.545946 3312 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:55.547070 3312 hybrid_clock.cc:648] HybridClock initialized: now 1786142455547060 us; error 46 us; skew 500 ppm
Aug 07 22:40:55 dist-test-slave-2d19 krb5kdc[2705](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142455, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.212.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:55.550011 3312 init.cc:377] Logged in from keytab as oryx/127.22.212.67@KRBTEST.COM (short username oryx)
I20260807 22:40:55.550467 3312 webserver.cc:460] Webserver started at http://127.22.212.67:42615/ using document root <none> and password file <none>
I20260807 22:40:55.550714 3312 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:55.550784 3312 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:55.550933 3312 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:55.552037 3312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-2/data/instance:
uuid: "f3e105e565d24ab390d4d3738bcc87c6"
format_stamp: "Formatted at 2026-08-07 22:40:55 on dist-test-slave-2d19"
server_key: "c25e8bd741de580e887791fcce24cf39"
server_key_iv: "a2a3220bac6e16742e7e0a3523f3c299"
server_key_version: "encryptionkey@0"
I20260807 22:40:55.552449 3312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance:
uuid: "f3e105e565d24ab390d4d3738bcc87c6"
format_stamp: "Formatted at 2026-08-07 22:40:55 on dist-test-slave-2d19"
server_key: "c25e8bd741de580e887791fcce24cf39"
server_key_iv: "a2a3220bac6e16742e7e0a3523f3c299"
server_key_version: "encryptionkey@0"
I20260807 22:40:55.553843 3312 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 22:40:55.554623 3334 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:55.554792 3312 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 22:40:55.554905 3312 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-2/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-2/wal
uuid: "f3e105e565d24ab390d4d3738bcc87c6"
format_stamp: "Formatted at 2026-08-07 22:40:55 on dist-test-slave-2d19"
server_key: "c25e8bd741de580e887791fcce24cf39"
server_key_iv: "a2a3220bac6e16742e7e0a3523f3c299"
server_key_version: "encryptionkey@0"
I20260807 22:40:55.554983 3312 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:55.562938 3312 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:55.564886 3312 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:55.565053 3312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:55.565608 3312 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:40:55.565672 3312 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:55.565721 3312 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:40:55.565745 3312 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 22:40:55 dist-test-slave-2d19 krb5kdc[2705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142455, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.212.67@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM
I20260807 22:40:55.572911 3312 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.67:42511
I20260807 22:40:55.573053 3494 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.67:42511 every 8 connection(s)
I20260807 22:40:55.573319 3312 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
I20260807 22:40:55.573848 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 3312
I20260807 22:40:55.573937 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance
I20260807 22:40:55.574155 23377 external_mini_cluster.cc:1428] Setting key e874a1fd6bf47224a25dbbd6e40ee513
I20260807 22:40:55.576495 2834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:55.566168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:46773 (local address 127.22.212.126:41613)
0807 22:40:55.566247 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:55.566249 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:55.566454 (+ 205us) server_negotiation.cc:407] Connection header received
0807 22:40:55.566943 (+ 489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:55.566945 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:55.566958 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:55.567042 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:55.567948 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.568829 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.570324 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.570687 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.570773 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:55.573398 (+ 2625us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:55.573400 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:55.573400 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:55.573409 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:55.574981 (+ 1572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:55.575408 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:55.575409 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:55.575409 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:55.575472 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:55.575752 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:55.575753 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:55.575753 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:55.575921 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:55.575998 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:55.576320 (+ 322us) server_negotiation.cc:299] Negotiation successful
0807 22:40:55.576408 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 22:40:55.576686 3345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:55.566142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:41613 (local address 127.22.212.67:46773)
0807 22:40:55.566317 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:55.566356 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:55.566843 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:55.567132 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:55.567136 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:55.567545 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:55.567838 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:55.567844 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.568954 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.568956 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:55.570250 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:55.570253 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.570792 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.570793 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:55.570934 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:55.571501 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:55.571511 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:55.573304 (+ 1793us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:55.575090 (+ 1786us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:55.575097 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:55.575099 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:55.575327 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:55.575553 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:55.575554 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:55.575554 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:55.575673 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:55.576002 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:55.576010 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:55.576153 (+ 143us) client_negotiation.cc:769] Sending connection context
0807 22:40:55.576259 (+ 106us) client_negotiation.cc:240] Negotiation successful
0807 22:40:55.576445 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":97,"threads_started":1}
I20260807 22:40:55.577178 3495 heartbeater.cc:347] Connected to a master server at 127.22.212.126:41613
I20260807 22:40:55.577303 3495 heartbeater.cc:464] Registering TS with master...
I20260807 22:40:55.577504 3495 heartbeater.cc:511] Master 127.22.212.126:41613 requested a full tablet report, sending...
I20260807 22:40:55.577991 2763 ts_manager.cc:194] Registered new tserver with Master: f3e105e565d24ab390d4d3738bcc87c6 (127.22.212.67:42511)
I20260807 22:40:55.578539 2763 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.22.212.67@KRBTEST.COM'} at 127.22.212.67:46773
I20260807 22:40:55.583668 2834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:55.578383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:60439 (local address 127.22.212.126:41613)
0807 22:40:55.578423 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:55.578425 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:55.578433 (+ 8us) server_negotiation.cc:407] Connection header received
0807 22:40:55.578455 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:55.578456 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:55.578465 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:55.578530 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:55.578919 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.579455 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.580290 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.580505 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.580599 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:55.581468 (+ 869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:55.581469 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:55.581470 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:55.581477 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:55.582573 (+ 1096us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:55.582905 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:55.582906 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:55.582906 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:55.582965 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:55.583172 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:55.583173 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:55.583173 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:55.583278 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:55.583355 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:55.583507 (+ 152us) server_negotiation.cc:299] Negotiation successful
0807 22:40:55.583581 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 22:40:55.583683 3502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:55.578175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:41613 (local address 127.22.212.67:60439)
0807 22:40:55.578334 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:55.578347 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:55.578406 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:55.578533 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:55.578534 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:55.578762 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:55.578823 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:55.578825 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.579568 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.579569 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:55.580157 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:55.580159 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.580602 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.580604 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:55.580681 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:55.581079 (+ 398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:55.581083 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:55.581347 (+ 264us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:55.582660 (+ 1313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:55.582661 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:55.582661 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:55.582831 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:55.583040 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:55.583041 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:55.583042 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:55.583100 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:55.583348 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:55.583348 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:55.583394 (+ 46us) client_negotiation.cc:769] Sending connection context
0807 22:40:55.583482 (+ 88us) client_negotiation.cc:240] Negotiation successful
0807 22:40:55.583583 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":103,"threads_started":1}
I20260807 22:40:55.585633 23377 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 22:40:55 dist-test-slave-2d19 krb5kdc[2705](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142455, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 22:40:55 dist-test-slave-2d19 krb5kdc[2705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:40:55 dist-test-slave-2d19 krb5kdc[2705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
W20260807 22:40:55.608270 2834 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:40:55.602336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49574 (local address 127.22.212.126:41613)
0807 22:40:55.602410 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:55.602412 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:55.602423 (+ 11us) server_negotiation.cc:407] Connection header received
0807 22:40:55.602486 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:55.602487 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:55.602503 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:55.602579 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:55.603154 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.603654 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.604491 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.604685 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.604763 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:55.608141 (+ 3378us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49574: BlockingRecv error: recv got EOF from 127.0.0.1:49574 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 07 22:40:55 dist-test-slave-2d19 krb5kdc[2705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142455, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM
I20260807 22:40:55.615701 2834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:55.609130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49578 (local address 127.22.212.126:41613)
0807 22:40:55.609169 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:55.609172 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:55.609188 (+ 16us) server_negotiation.cc:407] Connection header received
0807 22:40:55.609226 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:55.609227 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:55.609234 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:55.609290 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:55.609732 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.610235 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.610871 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.611087 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.611142 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:55.613217 (+ 2075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:55.613218 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:55.613218 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:55.613226 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:55.614436 (+ 1210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:55.614766 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:55.614767 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:55.614768 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:55.614833 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:55.615127 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:55.615128 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:55.615128 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:55.615311 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:55.615403 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:55.615487 (+ 84us) server_negotiation.cc:299] Negotiation successful
0807 22:40:55.615566 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 22:40:55.617600 2763 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49578:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:40:55.619272 2763 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:40:55.626262 3526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:55.621907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.66:46695 (local address 127.0.0.1:56038)
0807 22:40:55.622408 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:55.622417 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:55.622467 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:55.622661 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:55.622662 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:55.622664 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:55.622725 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:55.622728 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.623690 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.623691 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:55.624988 (+ 1297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:55.624991 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.625958 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.625959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:55.626046 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:55.626062 (+ 16us) client_negotiation.cc:769] Sending connection context
0807 22:40:55.626115 (+ 53us) client_negotiation.cc:240] Negotiation successful
0807 22:40:55.626179 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":485,"mutex_wait_us":5,"thread_start_us":96,"threads_started":1}
I20260807 22:40:55.626430 3531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:55.622408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37318 (local address 127.22.212.65:38699)
0807 22:40:55.622577 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:55.622582 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:55.622592 (+ 10us) server_negotiation.cc:407] Connection header received
0807 22:40:55.622696 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:55.622699 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:55.622717 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:55.622946 (+ 229us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:55.623003 (+ 57us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.624019 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.625167 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.625850 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.626166 (+ 316us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:55.626250 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:55.626276 (+ 26us) server_negotiation.cc:299] Negotiation successful
0807 22:40:55.626318 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":91,"threads_started":1}
I20260807 22:40:55.626463 3529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:55.622195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54208 (local address 127.22.212.67:42511)
0807 22:40:55.622410 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:55.622414 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:55.622424 (+ 10us) server_negotiation.cc:407] Connection header received
0807 22:40:55.622489 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:55.622492 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:55.622509 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:55.622606 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:55.622797 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.623901 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.625178 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.625838 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.626174 (+ 336us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:55.626283 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:55.626313 (+ 30us) server_negotiation.cc:299] Negotiation successful
0807 22:40:55.626367 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":88,"threads_started":1}
I20260807 22:40:55.626884 3527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:55.621890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:38699 (local address 127.0.0.1:37318)
0807 22:40:55.622077 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:55.622122 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:55.622190 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:55.622816 (+ 626us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:55.622817 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:55.622820 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:55.622873 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:55.622874 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.624111 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.624112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:55.625061 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:55.625064 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.625958 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.625959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:55.626065 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:55.626073 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 22:40:55.626115 (+ 42us) client_negotiation.cc:240] Negotiation successful
0807 22:40:55.626794 (+ 679us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"mutex_wait_us":615,"thread_start_us":86,"threads_started":1}
I20260807 22:40:55.626945 3525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:55.621890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.67:42511 (local address 127.0.0.1:54208)
0807 22:40:55.622293 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:55.622302 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:55.622339 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:55.622623 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:55.622627 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:55.622630 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:55.622701 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:55.622703 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.623989 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.623989 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:55.625100 (+ 1111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:55.625102 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.625953 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.625954 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:55.626042 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:55.626061 (+ 19us) client_negotiation.cc:769] Sending connection context
0807 22:40:55.626119 (+ 58us) client_negotiation.cc:240] Negotiation successful
0807 22:40:55.626827 (+ 708us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":390,"mutex_wait_us":652,"thread_start_us":69,"threads_started":1}
I20260807 22:40:55.627282 3528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:55.622189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56038 (local address 127.22.212.66:46695)
0807 22:40:55.622357 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:55.622363 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:55.622476 (+ 113us) server_negotiation.cc:407] Connection header received
0807 22:40:55.622539 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:55.622542 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:55.622558 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:55.622806 (+ 248us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:55.622869 (+ 63us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.623588 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.625079 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.625850 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.627020 (+ 1170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:55.627119 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:55.627146 (+ 27us) server_negotiation.cc:299] Negotiation successful
0807 22:40:55.627189 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":98,"threads_started":1}
I20260807 22:40:55.627758 2964 tablet_service.cc:1467] Processing CreateTablet for tablet 0c18d50436f84117ab66d3599f9d4493 (DEFAULT_TABLE table=test-table [id=c24d8dcbb7d041abbbad5857e7b3bd18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:55.627863 3190 tablet_service.cc:1467] Processing CreateTablet for tablet 0c18d50436f84117ab66d3599f9d4493 (DEFAULT_TABLE table=test-table [id=c24d8dcbb7d041abbbad5857e7b3bd18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:55.627863 3404 tablet_service.cc:1467] Processing CreateTablet for tablet 0c18d50436f84117ab66d3599f9d4493 (DEFAULT_TABLE table=test-table [id=c24d8dcbb7d041abbbad5857e7b3bd18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:55.628172 2964 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c18d50436f84117ab66d3599f9d4493. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:55.628226 3190 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c18d50436f84117ab66d3599f9d4493. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:55.628226 3404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c18d50436f84117ab66d3599f9d4493. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:55.631331 3532 tablet_bootstrap.cc:492] T 0c18d50436f84117ab66d3599f9d4493 P 97f0239d08c24e56b5327fee7aa03331: Bootstrap starting.
I20260807 22:40:55.631953 3533 tablet_bootstrap.cc:492] T 0c18d50436f84117ab66d3599f9d4493 P f3e105e565d24ab390d4d3738bcc87c6: Bootstrap starting.
I20260807 22:40:55.632129 3532 tablet_bootstrap.cc:654] T 0c18d50436f84117ab66d3599f9d4493 P 97f0239d08c24e56b5327fee7aa03331: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:55.632507 3532 log.cc:824] T 0c18d50436f84117ab66d3599f9d4493 P 97f0239d08c24e56b5327fee7aa03331: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:55.632617 3533 tablet_bootstrap.cc:654] T 0c18d50436f84117ab66d3599f9d4493 P f3e105e565d24ab390d4d3738bcc87c6: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:55.632918 3533 log.cc:824] T 0c18d50436f84117ab66d3599f9d4493 P f3e105e565d24ab390d4d3738bcc87c6: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:55.633277 3534 tablet_bootstrap.cc:492] T 0c18d50436f84117ab66d3599f9d4493 P 242107e4cd7342ab8039f1231fd213f7: Bootstrap starting.
I20260807 22:40:55.633443 3532 tablet_bootstrap.cc:492] T 0c18d50436f84117ab66d3599f9d4493 P 97f0239d08c24e56b5327fee7aa03331: No bootstrap required, opened a new log
I20260807 22:40:55.633520 3532 ts_tablet_manager.cc:1397] T 0c18d50436f84117ab66d3599f9d4493 P 97f0239d08c24e56b5327fee7aa03331: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260807 22:40:55.633733 3533 tablet_bootstrap.cc:492] T 0c18d50436f84117ab66d3599f9d4493 P f3e105e565d24ab390d4d3738bcc87c6: No bootstrap required, opened a new log
I20260807 22:40:55.633814 3533 ts_tablet_manager.cc:1397] T 0c18d50436f84117ab66d3599f9d4493 P f3e105e565d24ab390d4d3738bcc87c6: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260807 22:40:55.633878 3534 tablet_bootstrap.cc:654] T 0c18d50436f84117ab66d3599f9d4493 P 242107e4cd7342ab8039f1231fd213f7: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:55.634207 3534 log.cc:824] T 0c18d50436f84117ab66d3599f9d4493 P 242107e4cd7342ab8039f1231fd213f7: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:55.635015 3534 tablet_bootstrap.cc:492] T 0c18d50436f84117ab66d3599f9d4493 P 242107e4cd7342ab8039f1231fd213f7: No bootstrap required, opened a new log
I20260807 22:40:55.635099 3534 ts_tablet_manager.cc:1397] T 0c18d50436f84117ab66d3599f9d4493 P 242107e4cd7342ab8039f1231fd213f7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 22:40:55.635491 3533 raft_consensus.cc:348] T 0c18d50436f84117ab66d3599f9d4493 P f3e105e565d24ab390d4d3738bcc87c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } }
I20260807 22:40:55.635649 3533 raft_consensus.cc:374] T 0c18d50436f84117ab66d3599f9d4493 P f3e105e565d24ab390d4d3738bcc87c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:55.635692 3533 raft_consensus.cc:729] T 0c18d50436f84117ab66d3599f9d4493 P f3e105e565d24ab390d4d3738bcc87c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3e105e565d24ab390d4d3738bcc87c6, State: Initialized, Role: FOLLOWER
I20260807 22:40:55.635674 3532 raft_consensus.cc:348] T 0c18d50436f84117ab66d3599f9d4493 P 97f0239d08c24e56b5327fee7aa03331 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } }
I20260807 22:40:55.635835 3532 raft_consensus.cc:374] T 0c18d50436f84117ab66d3599f9d4493 P 97f0239d08c24e56b5327fee7aa03331 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:55.635807 3533 consensus_queue.cc:260] T 0c18d50436f84117ab66d3599f9d4493 P f3e105e565d24ab390d4d3738bcc87c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } }
I20260807 22:40:55.635879 3532 raft_consensus.cc:729] T 0c18d50436f84117ab66d3599f9d4493 P 97f0239d08c24e56b5327fee7aa03331 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97f0239d08c24e56b5327fee7aa03331, State: Initialized, Role: FOLLOWER
I20260807 22:40:55.635993 3532 consensus_queue.cc:260] T 0c18d50436f84117ab66d3599f9d4493 P 97f0239d08c24e56b5327fee7aa03331 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } }
I20260807 22:40:55.636163 3495 heartbeater.cc:503] Master 127.22.212.126:41613 was elected leader, sending a full tablet report...
I20260807 22:40:55.636294 3532 ts_tablet_manager.cc:1428] T 0c18d50436f84117ab66d3599f9d4493 P 97f0239d08c24e56b5327fee7aa03331: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260807 22:40:55.636341 3068 heartbeater.cc:503] Master 127.22.212.126:41613 was elected leader, sending a full tablet report...
I20260807 22:40:55.636113 3533 ts_tablet_manager.cc:1428] T 0c18d50436f84117ab66d3599f9d4493 P f3e105e565d24ab390d4d3738bcc87c6: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260807 22:40:55.637235 3534 raft_consensus.cc:348] T 0c18d50436f84117ab66d3599f9d4493 P 242107e4cd7342ab8039f1231fd213f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } }
I20260807 22:40:55.637396 3534 raft_consensus.cc:374] T 0c18d50436f84117ab66d3599f9d4493 P 242107e4cd7342ab8039f1231fd213f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:55.637444 3534 raft_consensus.cc:729] T 0c18d50436f84117ab66d3599f9d4493 P 242107e4cd7342ab8039f1231fd213f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 242107e4cd7342ab8039f1231fd213f7, State: Initialized, Role: FOLLOWER
I20260807 22:40:55.637557 3534 consensus_queue.cc:260] T 0c18d50436f84117ab66d3599f9d4493 P 242107e4cd7342ab8039f1231fd213f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } }
I20260807 22:40:55.637831 3534 ts_tablet_manager.cc:1428] T 0c18d50436f84117ab66d3599f9d4493 P 242107e4cd7342ab8039f1231fd213f7: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 22:40:55.637878 3295 heartbeater.cc:503] Master 127.22.212.126:41613 was elected leader, sending a full tablet report...
I20260807 22:40:55.641824 3543 raft_consensus.cc:482] T 0c18d50436f84117ab66d3599f9d4493 P 242107e4cd7342ab8039f1231fd213f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:40:55.641893 3543 raft_consensus.cc:504] T 0c18d50436f84117ab66d3599f9d4493 P 242107e4cd7342ab8039f1231fd213f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } }
I20260807 22:40:55.642247 3543 leader_election.cc:288] T 0c18d50436f84117ab66d3599f9d4493 P 242107e4cd7342ab8039f1231fd213f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97f0239d08c24e56b5327fee7aa03331 (127.22.212.65:38699), f3e105e565d24ab390d4d3738bcc87c6 (127.22.212.67:42511)
I20260807 22:40:55.645126 3529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:55.642469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:48991 (local address 127.22.212.67:42511)
0807 22:40:55.642512 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:55.642514 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:55.642543 (+ 29us) server_negotiation.cc:407] Connection header received
0807 22:40:55.642619 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:55.642620 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:55.642631 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:55.642681 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:55.642824 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.643395 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.644357 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.644720 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.644815 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:55.644825 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:55.645030 (+ 205us) server_negotiation.cc:299] Negotiation successful
0807 22:40:55.645066 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 22:40:55.645143 3119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:55.642409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.67:42511 (local address 127.22.212.66:48991)
0807 22:40:55.642487 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:55.642500 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:55.642543 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:55.642684 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:55.642685 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:55.642687 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:55.642746 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:55.642748 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.643470 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.643471 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:55.644236 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:55.644239 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.644816 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.644817 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:55.644915 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:55.644920 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 22:40:55.645009 (+ 89us) client_negotiation.cc:240] Negotiation successful
0807 22:40:55.645047 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61,"mutex_wait_us":18}
I20260807 22:40:55.645200 3531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:55.642508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:55025 (local address 127.22.212.65:38699)
0807 22:40:55.642549 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:55.642551 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:55.642658 (+ 107us) server_negotiation.cc:407] Connection header received
0807 22:40:55.642745 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:55.642746 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:55.642761 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:55.642847 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:55.643046 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.643496 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.644477 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.644817 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.644905 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:55.644920 (+ 15us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:55.645097 (+ 177us) server_negotiation.cc:299] Negotiation successful
0807 22:40:55.645131 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 22:40:55.645260 3545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:55.642413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:38699 (local address 127.22.212.66:55025)
0807 22:40:55.642599 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:55.642609 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:55.642682 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:55.642868 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:55.642869 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:55.642897 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:55.642982 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:55.642984 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.643581 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.643582 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:55.644391 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:55.644393 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.644905 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.644906 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:55.645003 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:55.645006 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:40:55.645086 (+ 80us) client_negotiation.cc:240] Negotiation successful
0807 22:40:55.645130 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"mutex_wait_us":41,"thread_start_us":101,"threads_started":1}
I20260807 22:40:55.645517 3434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c18d50436f84117ab66d3599f9d4493" candidate_uuid: "242107e4cd7342ab8039f1231fd213f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3e105e565d24ab390d4d3738bcc87c6" is_pre_election: true
I20260807 22:40:55.645578 2989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c18d50436f84117ab66d3599f9d4493" candidate_uuid: "242107e4cd7342ab8039f1231fd213f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97f0239d08c24e56b5327fee7aa03331" is_pre_election: true
I20260807 22:40:55.645671 3434 raft_consensus.cc:2454] T 0c18d50436f84117ab66d3599f9d4493 P f3e105e565d24ab390d4d3738bcc87c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 242107e4cd7342ab8039f1231fd213f7 in term 0.
I20260807 22:40:55.645685 2989 raft_consensus.cc:2454] T 0c18d50436f84117ab66d3599f9d4493 P 97f0239d08c24e56b5327fee7aa03331 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 242107e4cd7342ab8039f1231fd213f7 in term 0.
I20260807 22:40:55.645912 3107 leader_election.cc:302] T 0c18d50436f84117ab66d3599f9d4493 P 242107e4cd7342ab8039f1231fd213f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 242107e4cd7342ab8039f1231fd213f7, 97f0239d08c24e56b5327fee7aa03331; no voters:
I20260807 22:40:55.646083 3543 raft_consensus.cc:2781] T 0c18d50436f84117ab66d3599f9d4493 P 242107e4cd7342ab8039f1231fd213f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:40:55.646155 3543 raft_consensus.cc:482] T 0c18d50436f84117ab66d3599f9d4493 P 242107e4cd7342ab8039f1231fd213f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:40:55.646191 3543 raft_consensus.cc:3037] T 0c18d50436f84117ab66d3599f9d4493 P 242107e4cd7342ab8039f1231fd213f7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:55.647423 3543 raft_consensus.cc:504] T 0c18d50436f84117ab66d3599f9d4493 P 242107e4cd7342ab8039f1231fd213f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } }
I20260807 22:40:55.647567 3543 leader_election.cc:288] T 0c18d50436f84117ab66d3599f9d4493 P 242107e4cd7342ab8039f1231fd213f7 [CANDIDATE]: Term 1 election: Requested vote from peers 97f0239d08c24e56b5327fee7aa03331 (127.22.212.65:38699), f3e105e565d24ab390d4d3738bcc87c6 (127.22.212.67:42511)
I20260807 22:40:55.647710 3434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c18d50436f84117ab66d3599f9d4493" candidate_uuid: "242107e4cd7342ab8039f1231fd213f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3e105e565d24ab390d4d3738bcc87c6"
I20260807 22:40:55.647729 2989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c18d50436f84117ab66d3599f9d4493" candidate_uuid: "242107e4cd7342ab8039f1231fd213f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97f0239d08c24e56b5327fee7aa03331"
I20260807 22:40:55.647822 3434 raft_consensus.cc:3037] T 0c18d50436f84117ab66d3599f9d4493 P f3e105e565d24ab390d4d3738bcc87c6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:55.647822 2989 raft_consensus.cc:3037] T 0c18d50436f84117ab66d3599f9d4493 P 97f0239d08c24e56b5327fee7aa03331 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:55.648761 3434 raft_consensus.cc:2454] T 0c18d50436f84117ab66d3599f9d4493 P f3e105e565d24ab390d4d3738bcc87c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 242107e4cd7342ab8039f1231fd213f7 in term 1.
I20260807 22:40:55.648792 2989 raft_consensus.cc:2454] T 0c18d50436f84117ab66d3599f9d4493 P 97f0239d08c24e56b5327fee7aa03331 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 242107e4cd7342ab8039f1231fd213f7 in term 1.
I20260807 22:40:55.648937 3111 leader_election.cc:302] T 0c18d50436f84117ab66d3599f9d4493 P 242107e4cd7342ab8039f1231fd213f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 242107e4cd7342ab8039f1231fd213f7, f3e105e565d24ab390d4d3738bcc87c6; no voters:
I20260807 22:40:55.649057 3543 raft_consensus.cc:2781] T 0c18d50436f84117ab66d3599f9d4493 P 242107e4cd7342ab8039f1231fd213f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:40:55.649211 3543 raft_consensus.cc:686] T 0c18d50436f84117ab66d3599f9d4493 P 242107e4cd7342ab8039f1231fd213f7 [term 1 LEADER]: Becoming Leader. State: Replica: 242107e4cd7342ab8039f1231fd213f7, State: Running, Role: LEADER
I20260807 22:40:55.649303 3543 consensus_queue.cc:237] T 0c18d50436f84117ab66d3599f9d4493 P 242107e4cd7342ab8039f1231fd213f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } }
I20260807 22:40:55.650156 2763 catalog_manager.cc:5495] T 0c18d50436f84117ab66d3599f9d4493 P 242107e4cd7342ab8039f1231fd213f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 242107e4cd7342ab8039f1231fd213f7 (127.22.212.66). New cstate: current_term: 1 leader_uuid: "242107e4cd7342ab8039f1231fd213f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } health_report { overall_health: HEALTHY } } }
I20260807 22:40:55.662456 3528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:55.660145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56042 (local address 127.22.212.66:46695)
0807 22:40:55.660207 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:55.660209 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:55.660219 (+ 10us) server_negotiation.cc:407] Connection header received
0807 22:40:55.660275 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:55.660276 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:55.660295 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:55.660369 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:40:55.660510 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.661040 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.661781 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.661962 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.662020 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:55.662159 (+ 139us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:40:55.662252 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:40:55.662310 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:55.662342 (+ 32us) server_negotiation.cc:299] Negotiation successful
0807 22:40:55.662359 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
W20260807 22:40:55.663611 3298 tablet.cc:2369] T 0c18d50436f84117ab66d3599f9d4493 P 242107e4cd7342ab8039f1231fd213f7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:40:55.664230 3434 raft_consensus.cc:1261] T 0c18d50436f84117ab66d3599f9d4493 P f3e105e565d24ab390d4d3738bcc87c6 [term 1 FOLLOWER]: Refusing update from remote peer 242107e4cd7342ab8039f1231fd213f7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:40:55.664302 2989 raft_consensus.cc:1261] T 0c18d50436f84117ab66d3599f9d4493 P 97f0239d08c24e56b5327fee7aa03331 [term 1 FOLLOWER]: Refusing update from remote peer 242107e4cd7342ab8039f1231fd213f7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:40:55.664633 3546 consensus_queue.cc:1035] T 0c18d50436f84117ab66d3599f9d4493 P 242107e4cd7342ab8039f1231fd213f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:40:55.664757 3543 consensus_queue.cc:1035] T 0c18d50436f84117ab66d3599f9d4493 P 242107e4cd7342ab8039f1231fd213f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:40:55.667393 3552 mvcc.cc:205] Tried to move back new op lower bound from 7316039498397982720 to 7316039498340188160. Current Snapshot: MvccSnapshot[applied={T|T < 7316039498397982720}]
I20260807 22:40:55.668092 3550 mvcc.cc:205] Tried to move back new op lower bound from 7316039498397982720 to 7316039498340188160. Current Snapshot: MvccSnapshot[applied={T|T < 7316039498397982720}]
I20260807 22:40:55.669694 2762 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49578:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:40:55.669804 2762 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49578:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:40:55.670641 2762 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f4ad6f156ba44a968bb94ed62d557e32: Sending DeleteTablet for 3 replicas of tablet 0c18d50436f84117ab66d3599f9d4493
I20260807 22:40:55.670982 3404 tablet_service.cc:1514] Processing DeleteTablet for tablet 0c18d50436f84117ab66d3599f9d4493 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:55 UTC) from {username='oryx', principal='oryx/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:54208
I20260807 22:40:55.670980 3190 tablet_service.cc:1514] Processing DeleteTablet for tablet 0c18d50436f84117ab66d3599f9d4493 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:55 UTC) from {username='oryx', principal='oryx/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:56038
I20260807 22:40:55.671017 2964 tablet_service.cc:1514] Processing DeleteTablet for tablet 0c18d50436f84117ab66d3599f9d4493 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:55 UTC) from {username='oryx', principal='oryx/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:37318
I20260807 22:40:55.671480 3564 tablet_replica.cc:330] T 0c18d50436f84117ab66d3599f9d4493 P 97f0239d08c24e56b5327fee7aa03331: stopping tablet replica
I20260807 22:40:55.671604 3564 raft_consensus.cc:2229] T 0c18d50436f84117ab66d3599f9d4493 P 97f0239d08c24e56b5327fee7aa03331 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:40:55.671622 3563 tablet_replica.cc:330] T 0c18d50436f84117ab66d3599f9d4493 P f3e105e565d24ab390d4d3738bcc87c6: stopping tablet replica
I20260807 22:40:55.671586 2762 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49578:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 22:40:55.671736 3564 raft_consensus.cc:2258] T 0c18d50436f84117ab66d3599f9d4493 P 97f0239d08c24e56b5327fee7aa03331 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260807 22:40:55.671748 2762 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:40:55.671845 3563 raft_consensus.cc:2229] T 0c18d50436f84117ab66d3599f9d4493 P f3e105e565d24ab390d4d3738bcc87c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:40:55.672201 3563 raft_consensus.cc:2258] T 0c18d50436f84117ab66d3599f9d4493 P f3e105e565d24ab390d4d3738bcc87c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:55.672406 3562 tablet_replica.cc:330] T 0c18d50436f84117ab66d3599f9d4493 P 242107e4cd7342ab8039f1231fd213f7: stopping tablet replica
I20260807 22:40:55.672513 3562 raft_consensus.cc:2229] T 0c18d50436f84117ab66d3599f9d4493 P 242107e4cd7342ab8039f1231fd213f7 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:40:55.672638 3562 raft_consensus.cc:2258] T 0c18d50436f84117ab66d3599f9d4493 P 242107e4cd7342ab8039f1231fd213f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:55.673091 3562 ts_tablet_manager.cc:1905] T 0c18d50436f84117ab66d3599f9d4493 P 242107e4cd7342ab8039f1231fd213f7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:55.673434 2964 tablet_service.cc:1467] Processing CreateTablet for tablet 961f39d49b734d608334b8b3c9df2b9e (DEFAULT_TABLE table=test-table [id=ec239d91366449d89b7a6376e9c900df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:55.673453 3190 tablet_service.cc:1467] Processing CreateTablet for tablet 961f39d49b734d608334b8b3c9df2b9e (DEFAULT_TABLE table=test-table [id=ec239d91366449d89b7a6376e9c900df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:55.673462 3404 tablet_service.cc:1467] Processing CreateTablet for tablet 961f39d49b734d608334b8b3c9df2b9e (DEFAULT_TABLE table=test-table [id=ec239d91366449d89b7a6376e9c900df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:55.673564 3190 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 961f39d49b734d608334b8b3c9df2b9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:55.673573 3404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 961f39d49b734d608334b8b3c9df2b9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:55.673570 2964 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 961f39d49b734d608334b8b3c9df2b9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:55.674851 3534 tablet_bootstrap.cc:492] T 961f39d49b734d608334b8b3c9df2b9e P 242107e4cd7342ab8039f1231fd213f7: Bootstrap starting.
I20260807 22:40:55.674851 3533 tablet_bootstrap.cc:492] T 961f39d49b734d608334b8b3c9df2b9e P f3e105e565d24ab390d4d3738bcc87c6: Bootstrap starting.
I20260807 22:40:55.675297 3534 tablet_bootstrap.cc:654] T 961f39d49b734d608334b8b3c9df2b9e P 242107e4cd7342ab8039f1231fd213f7: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:55.675297 3533 tablet_bootstrap.cc:654] T 961f39d49b734d608334b8b3c9df2b9e P f3e105e565d24ab390d4d3738bcc87c6: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:55.675464 3563 ts_tablet_manager.cc:1905] T 0c18d50436f84117ab66d3599f9d4493 P f3e105e565d24ab390d4d3738bcc87c6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:55.675623 3532 tablet_bootstrap.cc:492] T 961f39d49b734d608334b8b3c9df2b9e P 97f0239d08c24e56b5327fee7aa03331: Bootstrap starting.
I20260807 22:40:55.676034 3532 tablet_bootstrap.cc:654] T 961f39d49b734d608334b8b3c9df2b9e P 97f0239d08c24e56b5327fee7aa03331: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:55.677222 3563 ts_tablet_manager.cc:1918] T 0c18d50436f84117ab66d3599f9d4493 P f3e105e565d24ab390d4d3738bcc87c6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:40:55.677309 3563 log.cc:1196] T 0c18d50436f84117ab66d3599f9d4493 P f3e105e565d24ab390d4d3738bcc87c6: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-2/wal/wals/0c18d50436f84117ab66d3599f9d4493
I20260807 22:40:55.677542 3564 ts_tablet_manager.cc:1905] T 0c18d50436f84117ab66d3599f9d4493 P 97f0239d08c24e56b5327fee7aa03331: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:55.677610 3563 ts_tablet_manager.cc:1939] T 0c18d50436f84117ab66d3599f9d4493 P f3e105e565d24ab390d4d3738bcc87c6: Deleting consensus metadata
I20260807 22:40:55.678112 3562 ts_tablet_manager.cc:1918] T 0c18d50436f84117ab66d3599f9d4493 P 242107e4cd7342ab8039f1231fd213f7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:40:55.678115 2747 catalog_manager.cc:4841] TS f3e105e565d24ab390d4d3738bcc87c6 (127.22.212.67:42511): tablet 0c18d50436f84117ab66d3599f9d4493 (table test-table [id=c24d8dcbb7d041abbbad5857e7b3bd18]) successfully deleted
I20260807 22:40:55.678252 3562 log.cc:1196] T 0c18d50436f84117ab66d3599f9d4493 P 242107e4cd7342ab8039f1231fd213f7: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-1/wal/wals/0c18d50436f84117ab66d3599f9d4493
I20260807 22:40:55.678519 3562 ts_tablet_manager.cc:1939] T 0c18d50436f84117ab66d3599f9d4493 P 242107e4cd7342ab8039f1231fd213f7: Deleting consensus metadata
I20260807 22:40:55.678929 2745 catalog_manager.cc:4841] TS 242107e4cd7342ab8039f1231fd213f7 (127.22.212.66:46695): tablet 0c18d50436f84117ab66d3599f9d4493 (table test-table [id=c24d8dcbb7d041abbbad5857e7b3bd18]) successfully deleted
I20260807 22:40:55.679059 3564 ts_tablet_manager.cc:1918] T 0c18d50436f84117ab66d3599f9d4493 P 97f0239d08c24e56b5327fee7aa03331: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:40:55.679138 3564 log.cc:1196] T 0c18d50436f84117ab66d3599f9d4493 P 97f0239d08c24e56b5327fee7aa03331: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-0/wal/wals/0c18d50436f84117ab66d3599f9d4493
I20260807 22:40:55.679345 3534 tablet_bootstrap.cc:492] T 961f39d49b734d608334b8b3c9df2b9e P 242107e4cd7342ab8039f1231fd213f7: No bootstrap required, opened a new log
I20260807 22:40:55.679345 3533 tablet_bootstrap.cc:492] T 961f39d49b734d608334b8b3c9df2b9e P f3e105e565d24ab390d4d3738bcc87c6: No bootstrap required, opened a new log
I20260807 22:40:55.679392 3534 ts_tablet_manager.cc:1397] T 961f39d49b734d608334b8b3c9df2b9e P 242107e4cd7342ab8039f1231fd213f7: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260807 22:40:55.679392 3533 ts_tablet_manager.cc:1397] T 961f39d49b734d608334b8b3c9df2b9e P f3e105e565d24ab390d4d3738bcc87c6: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20260807 22:40:55.679556 3534 raft_consensus.cc:348] T 961f39d49b734d608334b8b3c9df2b9e P 242107e4cd7342ab8039f1231fd213f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } }
I20260807 22:40:55.679553 3533 raft_consensus.cc:348] T 961f39d49b734d608334b8b3c9df2b9e P f3e105e565d24ab390d4d3738bcc87c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } }
I20260807 22:40:55.679618 3534 raft_consensus.cc:374] T 961f39d49b734d608334b8b3c9df2b9e P 242107e4cd7342ab8039f1231fd213f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:55.679618 3533 raft_consensus.cc:374] T 961f39d49b734d608334b8b3c9df2b9e P f3e105e565d24ab390d4d3738bcc87c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:55.679641 3533 raft_consensus.cc:729] T 961f39d49b734d608334b8b3c9df2b9e P f3e105e565d24ab390d4d3738bcc87c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3e105e565d24ab390d4d3738bcc87c6, State: Initialized, Role: FOLLOWER
I20260807 22:40:55.679641 3534 raft_consensus.cc:729] T 961f39d49b734d608334b8b3c9df2b9e P 242107e4cd7342ab8039f1231fd213f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 242107e4cd7342ab8039f1231fd213f7, State: Initialized, Role: FOLLOWER
I20260807 22:40:55.679682 3534 consensus_queue.cc:260] T 961f39d49b734d608334b8b3c9df2b9e P 242107e4cd7342ab8039f1231fd213f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } }
I20260807 22:40:55.679683 3533 consensus_queue.cc:260] T 961f39d49b734d608334b8b3c9df2b9e P f3e105e565d24ab390d4d3738bcc87c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } }
I20260807 22:40:55.679754 3564 ts_tablet_manager.cc:1939] T 0c18d50436f84117ab66d3599f9d4493 P 97f0239d08c24e56b5327fee7aa03331: Deleting consensus metadata
I20260807 22:40:55.679767 3534 ts_tablet_manager.cc:1428] T 961f39d49b734d608334b8b3c9df2b9e P 242107e4cd7342ab8039f1231fd213f7: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260807 22:40:55.679768 3533 ts_tablet_manager.cc:1428] T 961f39d49b734d608334b8b3c9df2b9e P f3e105e565d24ab390d4d3738bcc87c6: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:55.680650 2743 catalog_manager.cc:4841] TS 97f0239d08c24e56b5327fee7aa03331 (127.22.212.65:38699): tablet 0c18d50436f84117ab66d3599f9d4493 (table test-table [id=c24d8dcbb7d041abbbad5857e7b3bd18]) successfully deleted
I20260807 22:40:55.681069 3532 tablet_bootstrap.cc:492] T 961f39d49b734d608334b8b3c9df2b9e P 97f0239d08c24e56b5327fee7aa03331: No bootstrap required, opened a new log
I20260807 22:40:55.681134 3532 ts_tablet_manager.cc:1397] T 961f39d49b734d608334b8b3c9df2b9e P 97f0239d08c24e56b5327fee7aa03331: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260807 22:40:55.681285 3532 raft_consensus.cc:348] T 961f39d49b734d608334b8b3c9df2b9e P 97f0239d08c24e56b5327fee7aa03331 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } }
I20260807 22:40:55.681360 3532 raft_consensus.cc:374] T 961f39d49b734d608334b8b3c9df2b9e P 97f0239d08c24e56b5327fee7aa03331 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:55.681383 3532 raft_consensus.cc:729] T 961f39d49b734d608334b8b3c9df2b9e P 97f0239d08c24e56b5327fee7aa03331 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97f0239d08c24e56b5327fee7aa03331, State: Initialized, Role: FOLLOWER
I20260807 22:40:55.681438 3532 consensus_queue.cc:260] T 961f39d49b734d608334b8b3c9df2b9e P 97f0239d08c24e56b5327fee7aa03331 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } }
I20260807 22:40:55.681536 3532 ts_tablet_manager.cc:1428] T 961f39d49b734d608334b8b3c9df2b9e P 97f0239d08c24e56b5327fee7aa03331: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
W20260807 22:40:55.738291 3069 tablet.cc:2369] T 961f39d49b734d608334b8b3c9df2b9e P 97f0239d08c24e56b5327fee7aa03331: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 22:40:55.824290 3497 tablet.cc:2369] T 961f39d49b734d608334b8b3c9df2b9e P f3e105e565d24ab390d4d3738bcc87c6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:40:55.922412 3558 raft_consensus.cc:482] T 961f39d49b734d608334b8b3c9df2b9e P 242107e4cd7342ab8039f1231fd213f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:40:55.922555 3558 raft_consensus.cc:504] T 961f39d49b734d608334b8b3c9df2b9e P 242107e4cd7342ab8039f1231fd213f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } }
I20260807 22:40:55.922783 3558 leader_election.cc:288] T 961f39d49b734d608334b8b3c9df2b9e P 242107e4cd7342ab8039f1231fd213f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97f0239d08c24e56b5327fee7aa03331 (127.22.212.65:38699), f3e105e565d24ab390d4d3738bcc87c6 (127.22.212.67:42511)
I20260807 22:40:55.923084 2989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "961f39d49b734d608334b8b3c9df2b9e" candidate_uuid: "242107e4cd7342ab8039f1231fd213f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97f0239d08c24e56b5327fee7aa03331" is_pre_election: true
I20260807 22:40:55.923192 2989 raft_consensus.cc:2454] T 961f39d49b734d608334b8b3c9df2b9e P 97f0239d08c24e56b5327fee7aa03331 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 242107e4cd7342ab8039f1231fd213f7 in term 0.
I20260807 22:40:55.923149 3434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "961f39d49b734d608334b8b3c9df2b9e" candidate_uuid: "242107e4cd7342ab8039f1231fd213f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3e105e565d24ab390d4d3738bcc87c6" is_pre_election: true
I20260807 22:40:55.923307 3434 raft_consensus.cc:2454] T 961f39d49b734d608334b8b3c9df2b9e P f3e105e565d24ab390d4d3738bcc87c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 242107e4cd7342ab8039f1231fd213f7 in term 0.
I20260807 22:40:55.923382 3107 leader_election.cc:302] T 961f39d49b734d608334b8b3c9df2b9e P 242107e4cd7342ab8039f1231fd213f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 242107e4cd7342ab8039f1231fd213f7, 97f0239d08c24e56b5327fee7aa03331; no voters:
I20260807 22:40:55.923480 3558 raft_consensus.cc:2781] T 961f39d49b734d608334b8b3c9df2b9e P 242107e4cd7342ab8039f1231fd213f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:40:55.923514 3558 raft_consensus.cc:482] T 961f39d49b734d608334b8b3c9df2b9e P 242107e4cd7342ab8039f1231fd213f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:40:55.923568 3558 raft_consensus.cc:3037] T 961f39d49b734d608334b8b3c9df2b9e P 242107e4cd7342ab8039f1231fd213f7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:55.924492 3558 raft_consensus.cc:504] T 961f39d49b734d608334b8b3c9df2b9e P 242107e4cd7342ab8039f1231fd213f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } }
I20260807 22:40:55.924644 3558 leader_election.cc:288] T 961f39d49b734d608334b8b3c9df2b9e P 242107e4cd7342ab8039f1231fd213f7 [CANDIDATE]: Term 1 election: Requested vote from peers 97f0239d08c24e56b5327fee7aa03331 (127.22.212.65:38699), f3e105e565d24ab390d4d3738bcc87c6 (127.22.212.67:42511)
I20260807 22:40:55.924822 2989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "961f39d49b734d608334b8b3c9df2b9e" candidate_uuid: "242107e4cd7342ab8039f1231fd213f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97f0239d08c24e56b5327fee7aa03331"
I20260807 22:40:55.924902 2989 raft_consensus.cc:3037] T 961f39d49b734d608334b8b3c9df2b9e P 97f0239d08c24e56b5327fee7aa03331 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:55.924985 3434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "961f39d49b734d608334b8b3c9df2b9e" candidate_uuid: "242107e4cd7342ab8039f1231fd213f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3e105e565d24ab390d4d3738bcc87c6"
I20260807 22:40:55.925060 3434 raft_consensus.cc:3037] T 961f39d49b734d608334b8b3c9df2b9e P f3e105e565d24ab390d4d3738bcc87c6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:55.925576 2989 raft_consensus.cc:2454] T 961f39d49b734d608334b8b3c9df2b9e P 97f0239d08c24e56b5327fee7aa03331 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 242107e4cd7342ab8039f1231fd213f7 in term 1.
I20260807 22:40:55.925710 3434 raft_consensus.cc:2454] T 961f39d49b734d608334b8b3c9df2b9e P f3e105e565d24ab390d4d3738bcc87c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 242107e4cd7342ab8039f1231fd213f7 in term 1.
I20260807 22:40:55.925818 3107 leader_election.cc:302] T 961f39d49b734d608334b8b3c9df2b9e P 242107e4cd7342ab8039f1231fd213f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 242107e4cd7342ab8039f1231fd213f7, 97f0239d08c24e56b5327fee7aa03331; no voters:
I20260807 22:40:55.925961 3558 raft_consensus.cc:2781] T 961f39d49b734d608334b8b3c9df2b9e P 242107e4cd7342ab8039f1231fd213f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:40:55.926060 3558 raft_consensus.cc:686] T 961f39d49b734d608334b8b3c9df2b9e P 242107e4cd7342ab8039f1231fd213f7 [term 1 LEADER]: Becoming Leader. State: Replica: 242107e4cd7342ab8039f1231fd213f7, State: Running, Role: LEADER
I20260807 22:40:55.926146 3558 consensus_queue.cc:237] T 961f39d49b734d608334b8b3c9df2b9e P 242107e4cd7342ab8039f1231fd213f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } }
I20260807 22:40:55.926771 2763 catalog_manager.cc:5495] T 961f39d49b734d608334b8b3c9df2b9e P 242107e4cd7342ab8039f1231fd213f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 242107e4cd7342ab8039f1231fd213f7 (127.22.212.66). New cstate: current_term: 1 leader_uuid: "242107e4cd7342ab8039f1231fd213f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } health_report { overall_health: UNKNOWN } } }
Aug 07 22:40:55 dist-test-slave-2d19 krb5kdc[2705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142455, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.212.126@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM
I20260807 22:40:55.995777 3579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:55.989115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:41613 (local address 127.0.0.1:49580)
0807 22:40:55.989315 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:55.989325 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:55.989395 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:55.989540 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:55.989541 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:55.989859 (+ 318us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:40:55.989911 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:55.989913 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.990555 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.990556 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:55.991088 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:55.991090 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.991415 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.991416 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:55.991479 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:55.992027 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:40:55.992032 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:40:55.993510 (+ 1478us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:40:55.994828 (+ 1318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:55.994834 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:55.994837 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:55.995040 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:55.995215 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:40:55.995216 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:40:55.995216 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:40:55.995275 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:40:55.995479 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:40:55.995486 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:40:55.995534 (+ 48us) client_negotiation.cc:769] Sending connection context
0807 22:40:55.995588 (+ 54us) client_negotiation.cc:240] Negotiation successful
0807 22:40:55.995682 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":111,"threads_started":1}
I20260807 22:40:55.995826 2834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:55.989187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49580 (local address 127.22.212.126:41613)
0807 22:40:55.989250 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:55.989252 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:55.989398 (+ 146us) server_negotiation.cc:407] Connection header received
0807 22:40:55.989445 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:55.989445 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:55.989456 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:55.989508 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:55.989983 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.990473 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.991165 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:55.991338 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:55.991387 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:55.993587 (+ 2200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:55.993588 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:55.993588 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:55.993595 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:55.994756 (+ 1161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:55.995104 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:55.995105 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:55.995105 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:55.995155 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:55.995327 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:55.995327 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:55.995327 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:55.995424 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:55.995473 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:55.995622 (+ 149us) server_negotiation.cc:299] Negotiation successful
0807 22:40:55.995729 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":44,"server-negotiator.queue_time_us":37}
I20260807 22:40:55.998083 2763 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:49580:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 22:40:55.998284 2763 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:40:55.999780 3190 tablet_service.cc:1467] Processing CreateTablet for tablet 7ca8e18e713347b0abf659fe56b868c4 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e72ef11cc8ca43d1a678995f0196f807]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 22:40:55.999794 2964 tablet_service.cc:1467] Processing CreateTablet for tablet 7ca8e18e713347b0abf659fe56b868c4 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e72ef11cc8ca43d1a678995f0196f807]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 22:40:55.999953 2964 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ca8e18e713347b0abf659fe56b868c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:55.999953 3190 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ca8e18e713347b0abf659fe56b868c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:56.001549 3534 tablet_bootstrap.cc:492] T 7ca8e18e713347b0abf659fe56b868c4 P 242107e4cd7342ab8039f1231fd213f7: Bootstrap starting.
I20260807 22:40:56.001605 3404 tablet_service.cc:1467] Processing CreateTablet for tablet 7ca8e18e713347b0abf659fe56b868c4 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e72ef11cc8ca43d1a678995f0196f807]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 22:40:56.001775 3404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ca8e18e713347b0abf659fe56b868c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:56.001989 3534 tablet_bootstrap.cc:654] T 7ca8e18e713347b0abf659fe56b868c4 P 242107e4cd7342ab8039f1231fd213f7: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:56.002272 3532 tablet_bootstrap.cc:492] T 7ca8e18e713347b0abf659fe56b868c4 P 97f0239d08c24e56b5327fee7aa03331: Bootstrap starting.
I20260807 22:40:56.002628 3534 tablet_bootstrap.cc:492] T 7ca8e18e713347b0abf659fe56b868c4 P 242107e4cd7342ab8039f1231fd213f7: No bootstrap required, opened a new log
I20260807 22:40:56.002689 3534 ts_tablet_manager.cc:1397] T 7ca8e18e713347b0abf659fe56b868c4 P 242107e4cd7342ab8039f1231fd213f7: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 22:40:56.002710 3532 tablet_bootstrap.cc:654] T 7ca8e18e713347b0abf659fe56b868c4 P 97f0239d08c24e56b5327fee7aa03331: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:56.002817 3534 raft_consensus.cc:348] T 7ca8e18e713347b0abf659fe56b868c4 P 242107e4cd7342ab8039f1231fd213f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } }
I20260807 22:40:56.002909 3534 raft_consensus.cc:374] T 7ca8e18e713347b0abf659fe56b868c4 P 242107e4cd7342ab8039f1231fd213f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:56.002934 3534 raft_consensus.cc:729] T 7ca8e18e713347b0abf659fe56b868c4 P 242107e4cd7342ab8039f1231fd213f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 242107e4cd7342ab8039f1231fd213f7, State: Initialized, Role: FOLLOWER
I20260807 22:40:56.003014 3534 consensus_queue.cc:260] T 7ca8e18e713347b0abf659fe56b868c4 P 242107e4cd7342ab8039f1231fd213f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } }
I20260807 22:40:56.003131 3534 ts_tablet_manager.cc:1428] T 7ca8e18e713347b0abf659fe56b868c4 P 242107e4cd7342ab8039f1231fd213f7: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260807 22:40:56.003146 3558 tablet_replica.cc:439] T 7ca8e18e713347b0abf659fe56b868c4 P 242107e4cd7342ab8039f1231fd213f7: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } } }
I20260807 22:40:56.003222 3558 tablet_replica.cc:442] T 7ca8e18e713347b0abf659fe56b868c4 P 242107e4cd7342ab8039f1231fd213f7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:40:56.003337 3533 tablet_bootstrap.cc:492] T 7ca8e18e713347b0abf659fe56b868c4 P f3e105e565d24ab390d4d3738bcc87c6: Bootstrap starting.
I20260807 22:40:56.003588 3532 tablet_bootstrap.cc:492] T 7ca8e18e713347b0abf659fe56b868c4 P 97f0239d08c24e56b5327fee7aa03331: No bootstrap required, opened a new log
I20260807 22:40:56.003629 3532 ts_tablet_manager.cc:1397] T 7ca8e18e713347b0abf659fe56b868c4 P 97f0239d08c24e56b5327fee7aa03331: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260807 22:40:56.003756 3533 tablet_bootstrap.cc:654] T 7ca8e18e713347b0abf659fe56b868c4 P f3e105e565d24ab390d4d3738bcc87c6: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:56.003743 3532 raft_consensus.cc:348] T 7ca8e18e713347b0abf659fe56b868c4 P 97f0239d08c24e56b5327fee7aa03331 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } }
I20260807 22:40:56.003789 3532 raft_consensus.cc:374] T 7ca8e18e713347b0abf659fe56b868c4 P 97f0239d08c24e56b5327fee7aa03331 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:56.003803 3532 raft_consensus.cc:729] T 7ca8e18e713347b0abf659fe56b868c4 P 97f0239d08c24e56b5327fee7aa03331 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97f0239d08c24e56b5327fee7aa03331, State: Initialized, Role: FOLLOWER
I20260807 22:40:56.003867 3532 consensus_queue.cc:260] T 7ca8e18e713347b0abf659fe56b868c4 P 97f0239d08c24e56b5327fee7aa03331 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } }
I20260807 22:40:56.003976 3532 ts_tablet_manager.cc:1428] T 7ca8e18e713347b0abf659fe56b868c4 P 97f0239d08c24e56b5327fee7aa03331: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:56.004017 3540 tablet_replica.cc:439] T 7ca8e18e713347b0abf659fe56b868c4 P 97f0239d08c24e56b5327fee7aa03331: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } } }
I20260807 22:40:56.004112 3540 tablet_replica.cc:442] T 7ca8e18e713347b0abf659fe56b868c4 P 97f0239d08c24e56b5327fee7aa03331: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:40:56.004526 3533 tablet_bootstrap.cc:492] T 7ca8e18e713347b0abf659fe56b868c4 P f3e105e565d24ab390d4d3738bcc87c6: No bootstrap required, opened a new log
I20260807 22:40:56.004603 3533 ts_tablet_manager.cc:1397] T 7ca8e18e713347b0abf659fe56b868c4 P f3e105e565d24ab390d4d3738bcc87c6: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260807 22:40:56.004748 3533 raft_consensus.cc:348] T 7ca8e18e713347b0abf659fe56b868c4 P f3e105e565d24ab390d4d3738bcc87c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } }
I20260807 22:40:56.004823 3533 raft_consensus.cc:374] T 7ca8e18e713347b0abf659fe56b868c4 P f3e105e565d24ab390d4d3738bcc87c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:56.004848 3533 raft_consensus.cc:729] T 7ca8e18e713347b0abf659fe56b868c4 P f3e105e565d24ab390d4d3738bcc87c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3e105e565d24ab390d4d3738bcc87c6, State: Initialized, Role: FOLLOWER
I20260807 22:40:56.004895 3533 consensus_queue.cc:260] T 7ca8e18e713347b0abf659fe56b868c4 P f3e105e565d24ab390d4d3738bcc87c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } }
I20260807 22:40:56.004981 3533 ts_tablet_manager.cc:1428] T 7ca8e18e713347b0abf659fe56b868c4 P f3e105e565d24ab390d4d3738bcc87c6: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260807 22:40:56.005095 3538 tablet_replica.cc:439] T 7ca8e18e713347b0abf659fe56b868c4 P f3e105e565d24ab390d4d3738bcc87c6: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } } }
I20260807 22:40:56.005209 3538 tablet_replica.cc:442] T 7ca8e18e713347b0abf659fe56b868c4 P f3e105e565d24ab390d4d3738bcc87c6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:40:56.108228 3540 raft_consensus.cc:482] T 7ca8e18e713347b0abf659fe56b868c4 P 97f0239d08c24e56b5327fee7aa03331 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:40:56.108434 3540 raft_consensus.cc:504] T 7ca8e18e713347b0abf659fe56b868c4 P 97f0239d08c24e56b5327fee7aa03331 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } }
I20260807 22:40:56.108820 3540 leader_election.cc:288] T 7ca8e18e713347b0abf659fe56b868c4 P 97f0239d08c24e56b5327fee7aa03331 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 242107e4cd7342ab8039f1231fd213f7 (127.22.212.66:46695), f3e105e565d24ab390d4d3738bcc87c6 (127.22.212.67:42511)
I20260807 22:40:56.111893 3586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:56.109061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.67:42511 (local address 127.22.212.65:57719)
0807 22:40:56.109223 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:56.109236 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:56.109302 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:56.109468 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:56.109469 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:56.109470 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:56.109540 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:56.109542 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:56.110196 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:56.110197 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:56.111024 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:56.111026 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:56.111583 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:56.111583 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:56.111658 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:56.111661 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:40:56.111738 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 22:40:56.111779 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":72,"threads_started":1}
I20260807 22:40:56.111862 3529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:56.109151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:57719 (local address 127.22.212.67:42511)
0807 22:40:56.109200 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:56.109203 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:56.109313 (+ 110us) server_negotiation.cc:407] Connection header received
0807 22:40:56.109350 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:56.109351 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:56.109363 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:56.109425 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:56.109612 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:56.110103 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:56.111127 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:56.111495 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:56.111582 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:56.111591 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:56.111746 (+ 155us) server_negotiation.cc:299] Negotiation successful
0807 22:40:56.111796 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 22:40:56.111980 3528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:56.109140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:52367 (local address 127.22.212.66:46695)
0807 22:40:56.109200 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:56.109203 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:56.109385 (+ 182us) server_negotiation.cc:407] Connection header received
0807 22:40:56.109453 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:56.109454 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:56.109467 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:56.109546 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:40:56.109701 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:56.110234 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:56.111232 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:56.111611 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:56.111700 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:56.111708 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:56.111860 (+ 152us) server_negotiation.cc:299] Negotiation successful
0807 22:40:56.111916 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260807 22:40:56.112013 3585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:56.109061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.66:46695 (local address 127.22.212.65:52367)
0807 22:40:56.109269 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:56.109279 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:56.109378 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:56.109551 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:56.109552 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:56.109553 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:40:56.109619 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:56.109621 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:56.110319 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:56.110320 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:56.111138 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:56.111141 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:56.111700 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:56.111701 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:56.111763 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:56.111767 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 22:40:56.111852 (+ 85us) client_negotiation.cc:240] Negotiation successful
0807 22:40:56.111905 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"mutex_wait_us":15,"thread_start_us":68,"threads_started":1}
I20260807 22:40:56.112284 3434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ca8e18e713347b0abf659fe56b868c4" candidate_uuid: "97f0239d08c24e56b5327fee7aa03331" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3e105e565d24ab390d4d3738bcc87c6" is_pre_election: true
I20260807 22:40:56.112334 3225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ca8e18e713347b0abf659fe56b868c4" candidate_uuid: "97f0239d08c24e56b5327fee7aa03331" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "242107e4cd7342ab8039f1231fd213f7" is_pre_election: true
I20260807 22:40:56.112407 3434 raft_consensus.cc:2454] T 7ca8e18e713347b0abf659fe56b868c4 P f3e105e565d24ab390d4d3738bcc87c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97f0239d08c24e56b5327fee7aa03331 in term 0.
I20260807 22:40:56.112471 3225 raft_consensus.cc:2454] T 7ca8e18e713347b0abf659fe56b868c4 P 242107e4cd7342ab8039f1231fd213f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97f0239d08c24e56b5327fee7aa03331 in term 0.
I20260807 22:40:56.112593 2898 leader_election.cc:302] T 7ca8e18e713347b0abf659fe56b868c4 P 97f0239d08c24e56b5327fee7aa03331 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97f0239d08c24e56b5327fee7aa03331, f3e105e565d24ab390d4d3738bcc87c6; no voters:
I20260807 22:40:56.112762 3540 raft_consensus.cc:2781] T 7ca8e18e713347b0abf659fe56b868c4 P 97f0239d08c24e56b5327fee7aa03331 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:40:56.112831 3540 raft_consensus.cc:482] T 7ca8e18e713347b0abf659fe56b868c4 P 97f0239d08c24e56b5327fee7aa03331 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:40:56.112865 3540 raft_consensus.cc:3037] T 7ca8e18e713347b0abf659fe56b868c4 P 97f0239d08c24e56b5327fee7aa03331 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:56.113595 3540 raft_consensus.cc:504] T 7ca8e18e713347b0abf659fe56b868c4 P 97f0239d08c24e56b5327fee7aa03331 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } }
I20260807 22:40:56.113752 3540 leader_election.cc:288] T 7ca8e18e713347b0abf659fe56b868c4 P 97f0239d08c24e56b5327fee7aa03331 [CANDIDATE]: Term 1 election: Requested vote from peers 242107e4cd7342ab8039f1231fd213f7 (127.22.212.66:46695), f3e105e565d24ab390d4d3738bcc87c6 (127.22.212.67:42511)
I20260807 22:40:56.113926 3225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ca8e18e713347b0abf659fe56b868c4" candidate_uuid: "97f0239d08c24e56b5327fee7aa03331" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "242107e4cd7342ab8039f1231fd213f7"
I20260807 22:40:56.113929 3434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ca8e18e713347b0abf659fe56b868c4" candidate_uuid: "97f0239d08c24e56b5327fee7aa03331" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3e105e565d24ab390d4d3738bcc87c6"
I20260807 22:40:56.114007 3434 raft_consensus.cc:3037] T 7ca8e18e713347b0abf659fe56b868c4 P f3e105e565d24ab390d4d3738bcc87c6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:56.114007 3225 raft_consensus.cc:3037] T 7ca8e18e713347b0abf659fe56b868c4 P 242107e4cd7342ab8039f1231fd213f7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:56.114774 3434 raft_consensus.cc:2454] T 7ca8e18e713347b0abf659fe56b868c4 P f3e105e565d24ab390d4d3738bcc87c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97f0239d08c24e56b5327fee7aa03331 in term 1.
I20260807 22:40:56.114861 3225 raft_consensus.cc:2454] T 7ca8e18e713347b0abf659fe56b868c4 P 242107e4cd7342ab8039f1231fd213f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97f0239d08c24e56b5327fee7aa03331 in term 1.
I20260807 22:40:56.115005 2898 leader_election.cc:302] T 7ca8e18e713347b0abf659fe56b868c4 P 97f0239d08c24e56b5327fee7aa03331 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97f0239d08c24e56b5327fee7aa03331, f3e105e565d24ab390d4d3738bcc87c6; no voters:
I20260807 22:40:56.115221 3540 raft_consensus.cc:2781] T 7ca8e18e713347b0abf659fe56b868c4 P 97f0239d08c24e56b5327fee7aa03331 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:40:56.115407 3540 raft_consensus.cc:686] T 7ca8e18e713347b0abf659fe56b868c4 P 97f0239d08c24e56b5327fee7aa03331 [term 1 LEADER]: Becoming Leader. State: Replica: 97f0239d08c24e56b5327fee7aa03331, State: Running, Role: LEADER
I20260807 22:40:56.115499 3540 consensus_queue.cc:237] T 7ca8e18e713347b0abf659fe56b868c4 P 97f0239d08c24e56b5327fee7aa03331 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } }
I20260807 22:40:56.115981 3587 tablet_replica.cc:439] T 7ca8e18e713347b0abf659fe56b868c4 P 97f0239d08c24e56b5327fee7aa03331: TxnStatusTablet state changed. Reason: New leader 97f0239d08c24e56b5327fee7aa03331. Latest consensus state: current_term: 1 leader_uuid: "97f0239d08c24e56b5327fee7aa03331" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } } }
I20260807 22:40:56.116114 3587 tablet_replica.cc:442] T 7ca8e18e713347b0abf659fe56b868c4 P 97f0239d08c24e56b5327fee7aa03331: This TxnStatusTablet replica's current role is: LEADER
I20260807 22:40:56.116357 3590 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 22:40:56.116475 3590 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 22:40:56.116518 2763 catalog_manager.cc:5495] T 7ca8e18e713347b0abf659fe56b868c4 P 97f0239d08c24e56b5327fee7aa03331 reported cstate change: term changed from 0 to 1, leader changed from <none> to 97f0239d08c24e56b5327fee7aa03331 (127.22.212.65). New cstate: current_term: 1 leader_uuid: "97f0239d08c24e56b5327fee7aa03331" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } health_report { overall_health: UNKNOWN } } }
I20260807 22:40:56.151681 3579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:56.148310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:38699 (local address 127.0.0.1:37322)
0807 22:40:56.148420 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:56.148435 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:56.148493 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:56.148816 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:56.148818 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:56.148819 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 22:40:56.148880 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:56.148882 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:56.149969 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:56.149970 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:56.150544 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:56.150546 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:56.151096 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:56.151097 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:56.151145 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:56.151161 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 22:40:56.151522 (+ 361us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 22:40:56.151530 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 22:40:56.151570 (+ 40us) client_negotiation.cc:240] Negotiation successful
0807 22:40:56.151613 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260807 22:40:56.151710 3597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:56.148436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37322 (local address 127.22.212.65:38699)
0807 22:40:56.148581 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:56.148583 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:56.148593 (+ 10us) server_negotiation.cc:407] Connection header received
0807 22:40:56.148636 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:56.148637 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:56.148678 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:56.148778 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:40:56.148963 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:56.149850 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:56.150629 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:56.151008 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:56.151082 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:56.151289 (+ 207us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:40:56.151431 (+ 142us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:40:56.151516 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:56.151575 (+ 59us) server_negotiation.cc:299] Negotiation successful
0807 22:40:56.151599 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":77,"threads_started":1}
I20260807 22:40:56.153201 3434 raft_consensus.cc:1261] T 7ca8e18e713347b0abf659fe56b868c4 P f3e105e565d24ab390d4d3738bcc87c6 [term 1 FOLLOWER]: Refusing update from remote peer 97f0239d08c24e56b5327fee7aa03331: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:40:56.153506 3225 raft_consensus.cc:1261] T 7ca8e18e713347b0abf659fe56b868c4 P 242107e4cd7342ab8039f1231fd213f7 [term 1 FOLLOWER]: Refusing update from remote peer 97f0239d08c24e56b5327fee7aa03331: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:40:56.153481 3587 consensus_queue.cc:1035] T 7ca8e18e713347b0abf659fe56b868c4 P 97f0239d08c24e56b5327fee7aa03331 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:40:56.153843 3587 consensus_queue.cc:1035] T 7ca8e18e713347b0abf659fe56b868c4 P 97f0239d08c24e56b5327fee7aa03331 [LEADER]: Connected to new peer: Peer: permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:40:56.154165 3538 tablet_replica.cc:439] T 7ca8e18e713347b0abf659fe56b868c4 P f3e105e565d24ab390d4d3738bcc87c6: TxnStatusTablet state changed. Reason: New leader 97f0239d08c24e56b5327fee7aa03331. Latest consensus state: current_term: 1 leader_uuid: "97f0239d08c24e56b5327fee7aa03331" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } } }
I20260807 22:40:56.154265 3538 tablet_replica.cc:442] T 7ca8e18e713347b0abf659fe56b868c4 P f3e105e565d24ab390d4d3738bcc87c6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:40:56.154572 3558 tablet_replica.cc:439] T 7ca8e18e713347b0abf659fe56b868c4 P 242107e4cd7342ab8039f1231fd213f7: TxnStatusTablet state changed. Reason: New leader 97f0239d08c24e56b5327fee7aa03331. Latest consensus state: current_term: 1 leader_uuid: "97f0239d08c24e56b5327fee7aa03331" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } } }
I20260807 22:40:56.154682 3558 tablet_replica.cc:442] T 7ca8e18e713347b0abf659fe56b868c4 P 242107e4cd7342ab8039f1231fd213f7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:40:56.155171 3587 tablet_replica.cc:439] T 7ca8e18e713347b0abf659fe56b868c4 P 97f0239d08c24e56b5327fee7aa03331: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "97f0239d08c24e56b5327fee7aa03331" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } } }
I20260807 22:40:56.155263 3587 tablet_replica.cc:442] T 7ca8e18e713347b0abf659fe56b868c4 P 97f0239d08c24e56b5327fee7aa03331: This TxnStatusTablet replica's current role is: LEADER
I20260807 22:40:56.155645 3538 tablet_replica.cc:439] T 7ca8e18e713347b0abf659fe56b868c4 P f3e105e565d24ab390d4d3738bcc87c6: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "97f0239d08c24e56b5327fee7aa03331" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } } }
I20260807 22:40:56.155738 3538 tablet_replica.cc:442] T 7ca8e18e713347b0abf659fe56b868c4 P f3e105e565d24ab390d4d3738bcc87c6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:40:56.156246 3540 tablet_replica.cc:439] T 7ca8e18e713347b0abf659fe56b868c4 P 97f0239d08c24e56b5327fee7aa03331: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "97f0239d08c24e56b5327fee7aa03331" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } } }
I20260807 22:40:56.156373 3540 tablet_replica.cc:442] T 7ca8e18e713347b0abf659fe56b868c4 P 97f0239d08c24e56b5327fee7aa03331: This TxnStatusTablet replica's current role is: LEADER
I20260807 22:40:56.156769 3549 mvcc.cc:205] Tried to move back new op lower bound from 7316039500401033216 to 7316039500249735168. Current Snapshot: MvccSnapshot[applied={T|T < 7316039500401033216}]
I20260807 22:40:56.156859 3558 tablet_replica.cc:439] T 7ca8e18e713347b0abf659fe56b868c4 P 242107e4cd7342ab8039f1231fd213f7: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "97f0239d08c24e56b5327fee7aa03331" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } } }
I20260807 22:40:56.156960 3558 tablet_replica.cc:442] T 7ca8e18e713347b0abf659fe56b868c4 P 242107e4cd7342ab8039f1231fd213f7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 22:40:56.162309 3604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:56.159368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:38699 (local address 127.22.212.66:43983)
0807 22:40:56.159482 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:56.159494 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:56.159546 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:56.159688 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:56.159689 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:56.159690 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 22:40:56.159730 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:56.159731 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:56.160746 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:56.160747 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:56.161329 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:56.161331 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:56.161847 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:56.161848 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:56.161889 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:56.161902 (+ 13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 22:40:56.162170 (+ 268us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 22:40:56.162172 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 22:40:56.162209 (+ 37us) client_negotiation.cc:240] Negotiation successful
0807 22:40:56.162251 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77,"thread_start_us":57,"threads_started":1}
I20260807 22:40:56.162313 3597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:56.159484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:43983 (local address 127.22.212.65:38699)
0807 22:40:56.159558 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:56.159561 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:56.159570 (+ 9us) server_negotiation.cc:407] Connection header received
0807 22:40:56.159597 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:56.159598 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:56.159609 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:56.159677 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:40:56.159788 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:56.160662 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:56.161417 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:56.161763 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:56.161842 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:56.162024 (+ 182us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:40:56.162059 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:40:56.162163 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:56.162215 (+ 52us) server_negotiation.cc:299] Negotiation successful
0807 22:40:56.162238 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 22:40:56.164711 3434 raft_consensus.cc:1261] T 961f39d49b734d608334b8b3c9df2b9e P f3e105e565d24ab390d4d3738bcc87c6 [term 1 FOLLOWER]: Refusing update from remote peer 242107e4cd7342ab8039f1231fd213f7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:40:56.164796 2989 raft_consensus.cc:1261] T 961f39d49b734d608334b8b3c9df2b9e P 97f0239d08c24e56b5327fee7aa03331 [term 1 FOLLOWER]: Refusing update from remote peer 242107e4cd7342ab8039f1231fd213f7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:40:56.164945 3559 consensus_queue.cc:1035] T 961f39d49b734d608334b8b3c9df2b9e P 242107e4cd7342ab8039f1231fd213f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:40:56.165067 3558 consensus_queue.cc:1035] T 961f39d49b734d608334b8b3c9df2b9e P 242107e4cd7342ab8039f1231fd213f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:40:56.174285 3528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:56.171344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:55989 (local address 127.22.212.66:46695)
0807 22:40:56.171389 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:56.171392 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:56.171514 (+ 122us) server_negotiation.cc:407] Connection header received
0807 22:40:56.171595 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:56.171596 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:56.171604 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:56.171644 (+ 40us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:40:56.171781 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:56.172333 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:56.173665 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:56.173843 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:56.173900 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:56.174098 (+ 198us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:40:56.174125 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:40:56.174163 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:56.174216 (+ 53us) server_negotiation.cc:299] Negotiation successful
0807 22:40:56.174233 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 22:40:56.174362 3609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:56.171289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.66:46695 (local address 127.22.212.65:55989)
0807 22:40:56.171451 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:56.171463 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:56.171537 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:56.171658 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:56.171659 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:56.171660 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 22:40:56.171719 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:56.171721 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:56.172397 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:56.172398 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:56.173576 (+ 1178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:56.173579 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:56.173926 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:56.173927 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:56.173995 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:56.174015 (+ 20us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 22:40:56.174164 (+ 149us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 22:40:56.174166 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 22:40:56.174214 (+ 48us) client_negotiation.cc:240] Negotiation successful
0807 22:40:56.174257 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":91,"threads_started":1}
I20260807 22:40:56.182281 2762 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49578:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:40:56.182404 2762 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49578:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:40:56.183058 2762 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f4ad6f156ba44a968bb94ed62d557e32: Sending DeleteTablet for 3 replicas of tablet 961f39d49b734d608334b8b3c9df2b9e
I20260807 22:40:56.183314 3190 tablet_service.cc:1514] Processing DeleteTablet for tablet 961f39d49b734d608334b8b3c9df2b9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:56 UTC) from {username='oryx', principal='oryx/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:56038
I20260807 22:40:56.183343 3404 tablet_service.cc:1514] Processing DeleteTablet for tablet 961f39d49b734d608334b8b3c9df2b9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:56 UTC) from {username='oryx', principal='oryx/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:54208
I20260807 22:40:56.183385 2964 tablet_service.cc:1514] Processing DeleteTablet for tablet 961f39d49b734d608334b8b3c9df2b9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:56 UTC) from {username='oryx', principal='oryx/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:37318
I20260807 22:40:56.183614 3615 tablet_replica.cc:330] T 961f39d49b734d608334b8b3c9df2b9e P 97f0239d08c24e56b5327fee7aa03331: stopping tablet replica
I20260807 22:40:56.183703 3615 raft_consensus.cc:2229] T 961f39d49b734d608334b8b3c9df2b9e P 97f0239d08c24e56b5327fee7aa03331 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:40:56.183749 3615 raft_consensus.cc:2258] T 961f39d49b734d608334b8b3c9df2b9e P 97f0239d08c24e56b5327fee7aa03331 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:56.183995 3615 ts_tablet_manager.cc:1905] T 961f39d49b734d608334b8b3c9df2b9e P 97f0239d08c24e56b5327fee7aa03331: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:56.185863 3615 ts_tablet_manager.cc:1918] T 961f39d49b734d608334b8b3c9df2b9e P 97f0239d08c24e56b5327fee7aa03331: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 22:40:56.185933 3615 log.cc:1196] T 961f39d49b734d608334b8b3c9df2b9e P 97f0239d08c24e56b5327fee7aa03331: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-0/wal/wals/961f39d49b734d608334b8b3c9df2b9e
I20260807 22:40:56.186185 3615 ts_tablet_manager.cc:1939] T 961f39d49b734d608334b8b3c9df2b9e P 97f0239d08c24e56b5327fee7aa03331: Deleting consensus metadata
I20260807 22:40:56.186575 3612 tablet_replica.cc:330] T 961f39d49b734d608334b8b3c9df2b9e P 242107e4cd7342ab8039f1231fd213f7: stopping tablet replica
I20260807 22:40:56.186654 3612 raft_consensus.cc:2229] T 961f39d49b734d608334b8b3c9df2b9e P 242107e4cd7342ab8039f1231fd213f7 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:40:56.186717 3612 raft_consensus.cc:2258] T 961f39d49b734d608334b8b3c9df2b9e P 242107e4cd7342ab8039f1231fd213f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:56.187044 3612 ts_tablet_manager.cc:1905] T 961f39d49b734d608334b8b3c9df2b9e P 242107e4cd7342ab8039f1231fd213f7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:56.188594 2743 catalog_manager.cc:4841] TS 97f0239d08c24e56b5327fee7aa03331 (127.22.212.65:38699): tablet 961f39d49b734d608334b8b3c9df2b9e (table test-table [id=ec239d91366449d89b7a6376e9c900df]) successfully deleted
I20260807 22:40:56.189271 3612 ts_tablet_manager.cc:1918] T 961f39d49b734d608334b8b3c9df2b9e P 242107e4cd7342ab8039f1231fd213f7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 22:40:56.189348 3612 log.cc:1196] T 961f39d49b734d608334b8b3c9df2b9e P 242107e4cd7342ab8039f1231fd213f7: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-1/wal/wals/961f39d49b734d608334b8b3c9df2b9e
I20260807 22:40:56.189623 3612 ts_tablet_manager.cc:1939] T 961f39d49b734d608334b8b3c9df2b9e P 242107e4cd7342ab8039f1231fd213f7: Deleting consensus metadata
I20260807 22:40:56.190081 2745 catalog_manager.cc:4841] TS 242107e4cd7342ab8039f1231fd213f7 (127.22.212.66:46695): tablet 961f39d49b734d608334b8b3c9df2b9e (table test-table [id=ec239d91366449d89b7a6376e9c900df]) successfully deleted
I20260807 22:40:56.192382 3614 tablet_replica.cc:330] T 961f39d49b734d608334b8b3c9df2b9e P f3e105e565d24ab390d4d3738bcc87c6: stopping tablet replica
I20260807 22:40:56.192468 3614 raft_consensus.cc:2229] T 961f39d49b734d608334b8b3c9df2b9e P f3e105e565d24ab390d4d3738bcc87c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:40:56.192523 3614 raft_consensus.cc:2258] T 961f39d49b734d608334b8b3c9df2b9e P f3e105e565d24ab390d4d3738bcc87c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:56.192816 3614 ts_tablet_manager.cc:1905] T 961f39d49b734d608334b8b3c9df2b9e P f3e105e565d24ab390d4d3738bcc87c6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:56.194519 3614 ts_tablet_manager.cc:1918] T 961f39d49b734d608334b8b3c9df2b9e P f3e105e565d24ab390d4d3738bcc87c6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 22:40:56.194588 3614 log.cc:1196] T 961f39d49b734d608334b8b3c9df2b9e P f3e105e565d24ab390d4d3738bcc87c6: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-2/wal/wals/961f39d49b734d608334b8b3c9df2b9e
I20260807 22:40:56.194823 3614 ts_tablet_manager.cc:1939] T 961f39d49b734d608334b8b3c9df2b9e P f3e105e565d24ab390d4d3738bcc87c6: Deleting consensus metadata
I20260807 22:40:56.195206 2747 catalog_manager.cc:4841] TS f3e105e565d24ab390d4d3738bcc87c6 (127.22.212.67:42511): tablet 961f39d49b734d608334b8b3c9df2b9e (table test-table [id=ec239d91366449d89b7a6376e9c900df]) successfully deleted
Aug 07 22:40:56 dist-test-slave-2d19 krb5kdc[2705](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142456, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 22:40:56 dist-test-slave-2d19 krb5kdc[2705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:40:56 dist-test-slave-2d19 krb5kdc[2705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
W20260807 22:40:56.212833 2834 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:40:56.206873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49594 (local address 127.22.212.126:41613)
0807 22:40:56.206958 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:56.206960 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:56.207102 (+ 142us) server_negotiation.cc:407] Connection header received
0807 22:40:56.207182 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:56.207183 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:56.207195 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:56.207252 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:56.207863 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:56.208447 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:56.209229 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:56.209429 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:56.209506 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:56.212761 (+ 3255us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49594: BlockingRecv error: recv got EOF from 127.0.0.1:49594 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 07 22:40:56 dist-test-slave-2d19 krb5kdc[2705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142456, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM
I20260807 22:40:56.221095 2834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:56.213672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49608 (local address 127.22.212.126:41613)
0807 22:40:56.213725 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:56.213726 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:56.213752 (+ 26us) server_negotiation.cc:407] Connection header received
0807 22:40:56.213829 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:56.213830 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:56.213839 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:56.213894 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:56.214367 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:56.214839 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:56.215588 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:56.215822 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:56.215883 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:56.218319 (+ 2436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:56.218321 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:56.218321 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:56.218329 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:56.219901 (+ 1572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:56.220278 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:56.220279 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:56.220280 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:56.220340 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:56.220561 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:56.220562 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:56.220562 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:56.220672 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:56.220772 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:56.220893 (+ 121us) server_negotiation.cc:299] Negotiation successful
0807 22:40:56.220972 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260807 22:40:56.222762 2762 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49608:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:40:56.222944 2762 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:40:56.224457 2964 tablet_service.cc:1467] Processing CreateTablet for tablet e7d1074660a040fbad4aa902b279900e (DEFAULT_TABLE table=test-table [id=fad84c942e004ab5af934552e54bdd65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:56.224615 2964 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7d1074660a040fbad4aa902b279900e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:56.224628 3404 tablet_service.cc:1467] Processing CreateTablet for tablet e7d1074660a040fbad4aa902b279900e (DEFAULT_TABLE table=test-table [id=fad84c942e004ab5af934552e54bdd65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:56.224738 3404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7d1074660a040fbad4aa902b279900e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:56.226040 3533 tablet_bootstrap.cc:492] T e7d1074660a040fbad4aa902b279900e P f3e105e565d24ab390d4d3738bcc87c6: Bootstrap starting.
I20260807 22:40:56.226039 3532 tablet_bootstrap.cc:492] T e7d1074660a040fbad4aa902b279900e P 97f0239d08c24e56b5327fee7aa03331: Bootstrap starting.
I20260807 22:40:56.226080 3190 tablet_service.cc:1467] Processing CreateTablet for tablet e7d1074660a040fbad4aa902b279900e (DEFAULT_TABLE table=test-table [id=fad84c942e004ab5af934552e54bdd65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:56.226217 3190 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7d1074660a040fbad4aa902b279900e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:56.226538 3533 tablet_bootstrap.cc:654] T e7d1074660a040fbad4aa902b279900e P f3e105e565d24ab390d4d3738bcc87c6: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:56.226547 3532 tablet_bootstrap.cc:654] T e7d1074660a040fbad4aa902b279900e P 97f0239d08c24e56b5327fee7aa03331: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:56.227438 3532 tablet_bootstrap.cc:492] T e7d1074660a040fbad4aa902b279900e P 97f0239d08c24e56b5327fee7aa03331: No bootstrap required, opened a new log
I20260807 22:40:56.227507 3532 ts_tablet_manager.cc:1397] T e7d1074660a040fbad4aa902b279900e P 97f0239d08c24e56b5327fee7aa03331: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260807 22:40:56.227547 3533 tablet_bootstrap.cc:492] T e7d1074660a040fbad4aa902b279900e P f3e105e565d24ab390d4d3738bcc87c6: No bootstrap required, opened a new log
I20260807 22:40:56.227600 3534 tablet_bootstrap.cc:492] T e7d1074660a040fbad4aa902b279900e P 242107e4cd7342ab8039f1231fd213f7: Bootstrap starting.
I20260807 22:40:56.227609 3533 ts_tablet_manager.cc:1397] T e7d1074660a040fbad4aa902b279900e P f3e105e565d24ab390d4d3738bcc87c6: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260807 22:40:56.227681 3532 raft_consensus.cc:348] T e7d1074660a040fbad4aa902b279900e P 97f0239d08c24e56b5327fee7aa03331 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } }
I20260807 22:40:56.227766 3532 raft_consensus.cc:374] T e7d1074660a040fbad4aa902b279900e P 97f0239d08c24e56b5327fee7aa03331 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:56.227792 3532 raft_consensus.cc:729] T e7d1074660a040fbad4aa902b279900e P 97f0239d08c24e56b5327fee7aa03331 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97f0239d08c24e56b5327fee7aa03331, State: Initialized, Role: FOLLOWER
I20260807 22:40:56.227782 3533 raft_consensus.cc:348] T e7d1074660a040fbad4aa902b279900e P f3e105e565d24ab390d4d3738bcc87c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } }
I20260807 22:40:56.227852 3533 raft_consensus.cc:374] T e7d1074660a040fbad4aa902b279900e P f3e105e565d24ab390d4d3738bcc87c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:56.227833 3532 consensus_queue.cc:260] T e7d1074660a040fbad4aa902b279900e P 97f0239d08c24e56b5327fee7aa03331 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } }
I20260807 22:40:56.227885 3533 raft_consensus.cc:729] T e7d1074660a040fbad4aa902b279900e P f3e105e565d24ab390d4d3738bcc87c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3e105e565d24ab390d4d3738bcc87c6, State: Initialized, Role: FOLLOWER
I20260807 22:40:56.227952 3532 ts_tablet_manager.cc:1428] T e7d1074660a040fbad4aa902b279900e P 97f0239d08c24e56b5327fee7aa03331: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:56.227931 3533 consensus_queue.cc:260] T e7d1074660a040fbad4aa902b279900e P f3e105e565d24ab390d4d3738bcc87c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } }
I20260807 22:40:56.227970 3534 tablet_bootstrap.cc:654] T e7d1074660a040fbad4aa902b279900e P 242107e4cd7342ab8039f1231fd213f7: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:56.228036 3533 ts_tablet_manager.cc:1428] T e7d1074660a040fbad4aa902b279900e P f3e105e565d24ab390d4d3738bcc87c6: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:56.228932 3534 tablet_bootstrap.cc:492] T e7d1074660a040fbad4aa902b279900e P 242107e4cd7342ab8039f1231fd213f7: No bootstrap required, opened a new log
I20260807 22:40:56.229013 3534 ts_tablet_manager.cc:1397] T e7d1074660a040fbad4aa902b279900e P 242107e4cd7342ab8039f1231fd213f7: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 22:40:56.229143 3534 raft_consensus.cc:348] T e7d1074660a040fbad4aa902b279900e P 242107e4cd7342ab8039f1231fd213f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } }
I20260807 22:40:56.229230 3534 raft_consensus.cc:374] T e7d1074660a040fbad4aa902b279900e P 242107e4cd7342ab8039f1231fd213f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:56.229259 3534 raft_consensus.cc:729] T e7d1074660a040fbad4aa902b279900e P 242107e4cd7342ab8039f1231fd213f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 242107e4cd7342ab8039f1231fd213f7, State: Initialized, Role: FOLLOWER
I20260807 22:40:56.229305 3534 consensus_queue.cc:260] T e7d1074660a040fbad4aa902b279900e P 242107e4cd7342ab8039f1231fd213f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } }
I20260807 22:40:56.229401 3534 ts_tablet_manager.cc:1428] T e7d1074660a040fbad4aa902b279900e P 242107e4cd7342ab8039f1231fd213f7: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:56.374892 3558 raft_consensus.cc:482] T e7d1074660a040fbad4aa902b279900e P 242107e4cd7342ab8039f1231fd213f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:40:56.374995 3558 raft_consensus.cc:504] T e7d1074660a040fbad4aa902b279900e P 242107e4cd7342ab8039f1231fd213f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } }
I20260807 22:40:56.375218 3558 leader_election.cc:288] T e7d1074660a040fbad4aa902b279900e P 242107e4cd7342ab8039f1231fd213f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97f0239d08c24e56b5327fee7aa03331 (127.22.212.65:38699), f3e105e565d24ab390d4d3738bcc87c6 (127.22.212.67:42511)
I20260807 22:40:56.375458 2989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7d1074660a040fbad4aa902b279900e" candidate_uuid: "242107e4cd7342ab8039f1231fd213f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97f0239d08c24e56b5327fee7aa03331" is_pre_election: true
I20260807 22:40:56.375478 3432 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7d1074660a040fbad4aa902b279900e" candidate_uuid: "242107e4cd7342ab8039f1231fd213f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3e105e565d24ab390d4d3738bcc87c6" is_pre_election: true
I20260807 22:40:56.375568 2989 raft_consensus.cc:2454] T e7d1074660a040fbad4aa902b279900e P 97f0239d08c24e56b5327fee7aa03331 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 242107e4cd7342ab8039f1231fd213f7 in term 0.
I20260807 22:40:56.375577 3432 raft_consensus.cc:2454] T e7d1074660a040fbad4aa902b279900e P f3e105e565d24ab390d4d3738bcc87c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 242107e4cd7342ab8039f1231fd213f7 in term 0.
I20260807 22:40:56.375732 3107 leader_election.cc:302] T e7d1074660a040fbad4aa902b279900e P 242107e4cd7342ab8039f1231fd213f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 242107e4cd7342ab8039f1231fd213f7, 97f0239d08c24e56b5327fee7aa03331; no voters:
I20260807 22:40:56.375874 3558 raft_consensus.cc:2781] T e7d1074660a040fbad4aa902b279900e P 242107e4cd7342ab8039f1231fd213f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:40:56.375923 3558 raft_consensus.cc:482] T e7d1074660a040fbad4aa902b279900e P 242107e4cd7342ab8039f1231fd213f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:40:56.375938 3558 raft_consensus.cc:3037] T e7d1074660a040fbad4aa902b279900e P 242107e4cd7342ab8039f1231fd213f7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:56.376652 3558 raft_consensus.cc:504] T e7d1074660a040fbad4aa902b279900e P 242107e4cd7342ab8039f1231fd213f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } }
I20260807 22:40:56.376796 3558 leader_election.cc:288] T e7d1074660a040fbad4aa902b279900e P 242107e4cd7342ab8039f1231fd213f7 [CANDIDATE]: Term 1 election: Requested vote from peers 97f0239d08c24e56b5327fee7aa03331 (127.22.212.65:38699), f3e105e565d24ab390d4d3738bcc87c6 (127.22.212.67:42511)
I20260807 22:40:56.376973 2989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7d1074660a040fbad4aa902b279900e" candidate_uuid: "242107e4cd7342ab8039f1231fd213f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97f0239d08c24e56b5327fee7aa03331"
I20260807 22:40:56.377065 2989 raft_consensus.cc:3037] T e7d1074660a040fbad4aa902b279900e P 97f0239d08c24e56b5327fee7aa03331 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:56.377787 2989 raft_consensus.cc:2454] T e7d1074660a040fbad4aa902b279900e P 97f0239d08c24e56b5327fee7aa03331 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 242107e4cd7342ab8039f1231fd213f7 in term 1.
I20260807 22:40:56.377923 3432 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7d1074660a040fbad4aa902b279900e" candidate_uuid: "242107e4cd7342ab8039f1231fd213f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3e105e565d24ab390d4d3738bcc87c6"
I20260807 22:40:56.377961 3107 leader_election.cc:302] T e7d1074660a040fbad4aa902b279900e P 242107e4cd7342ab8039f1231fd213f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 242107e4cd7342ab8039f1231fd213f7, 97f0239d08c24e56b5327fee7aa03331; no voters:
I20260807 22:40:56.378003 3432 raft_consensus.cc:3037] T e7d1074660a040fbad4aa902b279900e P f3e105e565d24ab390d4d3738bcc87c6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:56.378062 3558 raft_consensus.cc:2781] T e7d1074660a040fbad4aa902b279900e P 242107e4cd7342ab8039f1231fd213f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:40:56.378118 3558 raft_consensus.cc:686] T e7d1074660a040fbad4aa902b279900e P 242107e4cd7342ab8039f1231fd213f7 [term 1 LEADER]: Becoming Leader. State: Replica: 242107e4cd7342ab8039f1231fd213f7, State: Running, Role: LEADER
I20260807 22:40:56.378175 3558 consensus_queue.cc:237] T e7d1074660a040fbad4aa902b279900e P 242107e4cd7342ab8039f1231fd213f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } }
I20260807 22:40:56.378762 2762 catalog_manager.cc:5495] T e7d1074660a040fbad4aa902b279900e P 242107e4cd7342ab8039f1231fd213f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 242107e4cd7342ab8039f1231fd213f7 (127.22.212.66). New cstate: current_term: 1 leader_uuid: "242107e4cd7342ab8039f1231fd213f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } health_report { overall_health: UNKNOWN } } }
I20260807 22:40:56.378844 3432 raft_consensus.cc:2454] T e7d1074660a040fbad4aa902b279900e P f3e105e565d24ab390d4d3738bcc87c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 242107e4cd7342ab8039f1231fd213f7 in term 1.
I20260807 22:40:56.414979 3528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:56.412041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51696 (local address 127.22.212.66:46695)
0807 22:40:56.412109 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:56.412111 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:56.412121 (+ 10us) server_negotiation.cc:407] Connection header received
0807 22:40:56.412171 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:56.412171 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:56.412184 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:56.412234 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:40:56.412455 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:56.413060 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:56.414221 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:56.414487 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:56.414553 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:56.414727 (+ 174us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:40:56.414754 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:40:56.414792 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:56.414877 (+ 85us) server_negotiation.cc:299] Negotiation successful
0807 22:40:56.414898 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 22:40:56.415795 3432 raft_consensus.cc:1261] T e7d1074660a040fbad4aa902b279900e P f3e105e565d24ab390d4d3738bcc87c6 [term 1 FOLLOWER]: Refusing update from remote peer 242107e4cd7342ab8039f1231fd213f7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:40:56.415796 2989 raft_consensus.cc:1261] T e7d1074660a040fbad4aa902b279900e P 97f0239d08c24e56b5327fee7aa03331 [term 1 FOLLOWER]: Refusing update from remote peer 242107e4cd7342ab8039f1231fd213f7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:40:56.416035 3543 consensus_queue.cc:1035] T e7d1074660a040fbad4aa902b279900e P 242107e4cd7342ab8039f1231fd213f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:40:56.416132 3558 consensus_queue.cc:1035] T e7d1074660a040fbad4aa902b279900e P 242107e4cd7342ab8039f1231fd213f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:40:56.419910 2763 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49608:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:40:56.420009 2763 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49608:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:40:56.420687 2763 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f4ad6f156ba44a968bb94ed62d557e32: Sending DeleteTablet for 3 replicas of tablet e7d1074660a040fbad4aa902b279900e
I20260807 22:40:56.420933 2964 tablet_service.cc:1514] Processing DeleteTablet for tablet e7d1074660a040fbad4aa902b279900e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:56 UTC) from {username='oryx', principal='oryx/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:37318
I20260807 22:40:56.420950 3190 tablet_service.cc:1514] Processing DeleteTablet for tablet e7d1074660a040fbad4aa902b279900e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:56 UTC) from {username='oryx', principal='oryx/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:56038
I20260807 22:40:56.420977 3404 tablet_service.cc:1514] Processing DeleteTablet for tablet e7d1074660a040fbad4aa902b279900e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:56 UTC) from {username='oryx', principal='oryx/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:54208
I20260807 22:40:56.421062 3612 tablet_replica.cc:330] T e7d1074660a040fbad4aa902b279900e P 242107e4cd7342ab8039f1231fd213f7: stopping tablet replica
I20260807 22:40:56.421070 3615 tablet_replica.cc:330] T e7d1074660a040fbad4aa902b279900e P 97f0239d08c24e56b5327fee7aa03331: stopping tablet replica
I20260807 22:40:56.421109 3612 raft_consensus.cc:2229] T e7d1074660a040fbad4aa902b279900e P 242107e4cd7342ab8039f1231fd213f7 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:40:56.421123 3615 raft_consensus.cc:2229] T e7d1074660a040fbad4aa902b279900e P 97f0239d08c24e56b5327fee7aa03331 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:40:56.421165 3612 raft_consensus.cc:2258] T e7d1074660a040fbad4aa902b279900e P 242107e4cd7342ab8039f1231fd213f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:56.421172 3615 raft_consensus.cc:2258] T e7d1074660a040fbad4aa902b279900e P 97f0239d08c24e56b5327fee7aa03331 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:56.421254 3614 tablet_replica.cc:330] T e7d1074660a040fbad4aa902b279900e P f3e105e565d24ab390d4d3738bcc87c6: stopping tablet replica
I20260807 22:40:56.421316 3614 raft_consensus.cc:2229] T e7d1074660a040fbad4aa902b279900e P f3e105e565d24ab390d4d3738bcc87c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:40:56.421283 2763 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49608:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 22:40:56.421373 3614 raft_consensus.cc:2258] T e7d1074660a040fbad4aa902b279900e P f3e105e565d24ab390d4d3738bcc87c6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260807 22:40:56.421438 2763 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:40:56.421803 3614 ts_tablet_manager.cc:1905] T e7d1074660a040fbad4aa902b279900e P f3e105e565d24ab390d4d3738bcc87c6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:56.421876 3612 ts_tablet_manager.cc:1905] T e7d1074660a040fbad4aa902b279900e P 242107e4cd7342ab8039f1231fd213f7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:56.421984 3615 ts_tablet_manager.cc:1905] T e7d1074660a040fbad4aa902b279900e P 97f0239d08c24e56b5327fee7aa03331: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:56.422782 2964 tablet_service.cc:1467] Processing CreateTablet for tablet 8834951b7bf04988bb849d5e55e5408d (DEFAULT_TABLE table=test-table [id=6fc87a38c96447969d59369fb1a6e035]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:56.422897 2964 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8834951b7bf04988bb849d5e55e5408d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:56.423660 3190 tablet_service.cc:1467] Processing CreateTablet for tablet 8834951b7bf04988bb849d5e55e5408d (DEFAULT_TABLE table=test-table [id=6fc87a38c96447969d59369fb1a6e035]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:56.423729 3614 ts_tablet_manager.cc:1918] T e7d1074660a040fbad4aa902b279900e P f3e105e565d24ab390d4d3738bcc87c6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:40:56.423763 3615 ts_tablet_manager.cc:1918] T e7d1074660a040fbad4aa902b279900e P 97f0239d08c24e56b5327fee7aa03331: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:40:56.423785 3614 log.cc:1196] T e7d1074660a040fbad4aa902b279900e P f3e105e565d24ab390d4d3738bcc87c6: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-2/wal/wals/e7d1074660a040fbad4aa902b279900e
I20260807 22:40:56.423812 3615 log.cc:1196] T e7d1074660a040fbad4aa902b279900e P 97f0239d08c24e56b5327fee7aa03331: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-0/wal/wals/e7d1074660a040fbad4aa902b279900e
I20260807 22:40:56.423812 3612 ts_tablet_manager.cc:1918] T e7d1074660a040fbad4aa902b279900e P 242107e4cd7342ab8039f1231fd213f7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:40:56.423856 3612 log.cc:1196] T e7d1074660a040fbad4aa902b279900e P 242107e4cd7342ab8039f1231fd213f7: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-1/wal/wals/e7d1074660a040fbad4aa902b279900e
I20260807 22:40:56.424032 3614 ts_tablet_manager.cc:1939] T e7d1074660a040fbad4aa902b279900e P f3e105e565d24ab390d4d3738bcc87c6: Deleting consensus metadata
I20260807 22:40:56.424043 3615 ts_tablet_manager.cc:1939] T e7d1074660a040fbad4aa902b279900e P 97f0239d08c24e56b5327fee7aa03331: Deleting consensus metadata
I20260807 22:40:56.424093 3612 ts_tablet_manager.cc:1939] T e7d1074660a040fbad4aa902b279900e P 242107e4cd7342ab8039f1231fd213f7: Deleting consensus metadata
I20260807 22:40:56.424234 3190 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8834951b7bf04988bb849d5e55e5408d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:56.424489 2747 catalog_manager.cc:4841] TS f3e105e565d24ab390d4d3738bcc87c6 (127.22.212.67:42511): tablet e7d1074660a040fbad4aa902b279900e (table test-table [id=fad84c942e004ab5af934552e54bdd65]) successfully deleted
I20260807 22:40:56.424593 3404 tablet_service.cc:1467] Processing CreateTablet for tablet 8834951b7bf04988bb849d5e55e5408d (DEFAULT_TABLE table=test-table [id=6fc87a38c96447969d59369fb1a6e035]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:40:56.424717 3404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8834951b7bf04988bb849d5e55e5408d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:56.424800 3532 tablet_bootstrap.cc:492] T 8834951b7bf04988bb849d5e55e5408d P 97f0239d08c24e56b5327fee7aa03331: Bootstrap starting.
I20260807 22:40:56.425115 3532 tablet_bootstrap.cc:654] T 8834951b7bf04988bb849d5e55e5408d P 97f0239d08c24e56b5327fee7aa03331: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:56.425482 2743 catalog_manager.cc:4841] TS 97f0239d08c24e56b5327fee7aa03331 (127.22.212.65:38699): tablet e7d1074660a040fbad4aa902b279900e (table test-table [id=fad84c942e004ab5af934552e54bdd65]) successfully deleted
I20260807 22:40:56.425760 3533 tablet_bootstrap.cc:492] T 8834951b7bf04988bb849d5e55e5408d P f3e105e565d24ab390d4d3738bcc87c6: Bootstrap starting.
I20260807 22:40:56.425787 3534 tablet_bootstrap.cc:492] T 8834951b7bf04988bb849d5e55e5408d P 242107e4cd7342ab8039f1231fd213f7: Bootstrap starting.
I20260807 22:40:56.425803 2745 catalog_manager.cc:4841] TS 242107e4cd7342ab8039f1231fd213f7 (127.22.212.66:46695): tablet e7d1074660a040fbad4aa902b279900e (table test-table [id=fad84c942e004ab5af934552e54bdd65]) successfully deleted
I20260807 22:40:56.426102 3534 tablet_bootstrap.cc:654] T 8834951b7bf04988bb849d5e55e5408d P 242107e4cd7342ab8039f1231fd213f7: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:56.426177 3533 tablet_bootstrap.cc:654] T 8834951b7bf04988bb849d5e55e5408d P f3e105e565d24ab390d4d3738bcc87c6: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:56.426210 3532 tablet_bootstrap.cc:492] T 8834951b7bf04988bb849d5e55e5408d P 97f0239d08c24e56b5327fee7aa03331: No bootstrap required, opened a new log
I20260807 22:40:56.426244 3532 ts_tablet_manager.cc:1397] T 8834951b7bf04988bb849d5e55e5408d P 97f0239d08c24e56b5327fee7aa03331: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260807 22:40:56.426362 3532 raft_consensus.cc:348] T 8834951b7bf04988bb849d5e55e5408d P 97f0239d08c24e56b5327fee7aa03331 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } }
I20260807 22:40:56.426440 3532 raft_consensus.cc:374] T 8834951b7bf04988bb849d5e55e5408d P 97f0239d08c24e56b5327fee7aa03331 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:56.426476 3532 raft_consensus.cc:729] T 8834951b7bf04988bb849d5e55e5408d P 97f0239d08c24e56b5327fee7aa03331 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97f0239d08c24e56b5327fee7aa03331, State: Initialized, Role: FOLLOWER
I20260807 22:40:56.426528 3532 consensus_queue.cc:260] T 8834951b7bf04988bb849d5e55e5408d P 97f0239d08c24e56b5327fee7aa03331 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } }
I20260807 22:40:56.426654 3532 ts_tablet_manager.cc:1428] T 8834951b7bf04988bb849d5e55e5408d P 97f0239d08c24e56b5327fee7aa03331: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:56.426671 3534 tablet_bootstrap.cc:492] T 8834951b7bf04988bb849d5e55e5408d P 242107e4cd7342ab8039f1231fd213f7: No bootstrap required, opened a new log
I20260807 22:40:56.426713 3534 ts_tablet_manager.cc:1397] T 8834951b7bf04988bb849d5e55e5408d P 242107e4cd7342ab8039f1231fd213f7: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 22:40:56.426826 3534 raft_consensus.cc:348] T 8834951b7bf04988bb849d5e55e5408d P 242107e4cd7342ab8039f1231fd213f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } }
I20260807 22:40:56.426891 3534 raft_consensus.cc:374] T 8834951b7bf04988bb849d5e55e5408d P 242107e4cd7342ab8039f1231fd213f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:56.426918 3534 raft_consensus.cc:729] T 8834951b7bf04988bb849d5e55e5408d P 242107e4cd7342ab8039f1231fd213f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 242107e4cd7342ab8039f1231fd213f7, State: Initialized, Role: FOLLOWER
I20260807 22:40:56.426961 3534 consensus_queue.cc:260] T 8834951b7bf04988bb849d5e55e5408d P 242107e4cd7342ab8039f1231fd213f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } }
I20260807 22:40:56.427102 3534 ts_tablet_manager.cc:1428] T 8834951b7bf04988bb849d5e55e5408d P 242107e4cd7342ab8039f1231fd213f7: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:56.427460 3533 tablet_bootstrap.cc:492] T 8834951b7bf04988bb849d5e55e5408d P f3e105e565d24ab390d4d3738bcc87c6: No bootstrap required, opened a new log
I20260807 22:40:56.427526 3533 ts_tablet_manager.cc:1397] T 8834951b7bf04988bb849d5e55e5408d P f3e105e565d24ab390d4d3738bcc87c6: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260807 22:40:56.427677 3533 raft_consensus.cc:348] T 8834951b7bf04988bb849d5e55e5408d P f3e105e565d24ab390d4d3738bcc87c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } }
I20260807 22:40:56.427783 3533 raft_consensus.cc:374] T 8834951b7bf04988bb849d5e55e5408d P f3e105e565d24ab390d4d3738bcc87c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:56.427814 3533 raft_consensus.cc:729] T 8834951b7bf04988bb849d5e55e5408d P f3e105e565d24ab390d4d3738bcc87c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3e105e565d24ab390d4d3738bcc87c6, State: Initialized, Role: FOLLOWER
I20260807 22:40:56.427855 3533 consensus_queue.cc:260] T 8834951b7bf04988bb849d5e55e5408d P f3e105e565d24ab390d4d3738bcc87c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } }
I20260807 22:40:56.427955 3533 ts_tablet_manager.cc:1428] T 8834951b7bf04988bb849d5e55e5408d P f3e105e565d24ab390d4d3738bcc87c6: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:56.707261 3605 raft_consensus.cc:482] T 8834951b7bf04988bb849d5e55e5408d P 97f0239d08c24e56b5327fee7aa03331 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:40:56.707407 3605 raft_consensus.cc:504] T 8834951b7bf04988bb849d5e55e5408d P 97f0239d08c24e56b5327fee7aa03331 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } }
I20260807 22:40:56.707664 3605 leader_election.cc:288] T 8834951b7bf04988bb849d5e55e5408d P 97f0239d08c24e56b5327fee7aa03331 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 242107e4cd7342ab8039f1231fd213f7 (127.22.212.66:46695), f3e105e565d24ab390d4d3738bcc87c6 (127.22.212.67:42511)
I20260807 22:40:56.707942 3432 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8834951b7bf04988bb849d5e55e5408d" candidate_uuid: "97f0239d08c24e56b5327fee7aa03331" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3e105e565d24ab390d4d3738bcc87c6" is_pre_election: true
I20260807 22:40:56.707934 3225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8834951b7bf04988bb849d5e55e5408d" candidate_uuid: "97f0239d08c24e56b5327fee7aa03331" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "242107e4cd7342ab8039f1231fd213f7" is_pre_election: true
I20260807 22:40:56.708057 3432 raft_consensus.cc:2454] T 8834951b7bf04988bb849d5e55e5408d P f3e105e565d24ab390d4d3738bcc87c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97f0239d08c24e56b5327fee7aa03331 in term 0.
I20260807 22:40:56.708057 3225 raft_consensus.cc:2454] T 8834951b7bf04988bb849d5e55e5408d P 242107e4cd7342ab8039f1231fd213f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97f0239d08c24e56b5327fee7aa03331 in term 0.
I20260807 22:40:56.708233 2897 leader_election.cc:302] T 8834951b7bf04988bb849d5e55e5408d P 97f0239d08c24e56b5327fee7aa03331 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 242107e4cd7342ab8039f1231fd213f7, 97f0239d08c24e56b5327fee7aa03331, f3e105e565d24ab390d4d3738bcc87c6; no voters:
I20260807 22:40:56.708374 3605 raft_consensus.cc:2781] T 8834951b7bf04988bb849d5e55e5408d P 97f0239d08c24e56b5327fee7aa03331 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:40:56.708434 3605 raft_consensus.cc:482] T 8834951b7bf04988bb849d5e55e5408d P 97f0239d08c24e56b5327fee7aa03331 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:40:56.708458 3605 raft_consensus.cc:3037] T 8834951b7bf04988bb849d5e55e5408d P 97f0239d08c24e56b5327fee7aa03331 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:56.709257 3605 raft_consensus.cc:504] T 8834951b7bf04988bb849d5e55e5408d P 97f0239d08c24e56b5327fee7aa03331 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } }
I20260807 22:40:56.709403 3605 leader_election.cc:288] T 8834951b7bf04988bb849d5e55e5408d P 97f0239d08c24e56b5327fee7aa03331 [CANDIDATE]: Term 1 election: Requested vote from peers 242107e4cd7342ab8039f1231fd213f7 (127.22.212.66:46695), f3e105e565d24ab390d4d3738bcc87c6 (127.22.212.67:42511)
I20260807 22:40:56.709594 3225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8834951b7bf04988bb849d5e55e5408d" candidate_uuid: "97f0239d08c24e56b5327fee7aa03331" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "242107e4cd7342ab8039f1231fd213f7"
I20260807 22:40:56.709645 3432 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8834951b7bf04988bb849d5e55e5408d" candidate_uuid: "97f0239d08c24e56b5327fee7aa03331" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3e105e565d24ab390d4d3738bcc87c6"
I20260807 22:40:56.709697 3225 raft_consensus.cc:3037] T 8834951b7bf04988bb849d5e55e5408d P 242107e4cd7342ab8039f1231fd213f7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:56.709705 3432 raft_consensus.cc:3037] T 8834951b7bf04988bb849d5e55e5408d P f3e105e565d24ab390d4d3738bcc87c6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:56.710307 3225 raft_consensus.cc:2454] T 8834951b7bf04988bb849d5e55e5408d P 242107e4cd7342ab8039f1231fd213f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97f0239d08c24e56b5327fee7aa03331 in term 1.
I20260807 22:40:56.710387 3432 raft_consensus.cc:2454] T 8834951b7bf04988bb849d5e55e5408d P f3e105e565d24ab390d4d3738bcc87c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97f0239d08c24e56b5327fee7aa03331 in term 1.
I20260807 22:40:56.710531 2897 leader_election.cc:302] T 8834951b7bf04988bb849d5e55e5408d P 97f0239d08c24e56b5327fee7aa03331 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 242107e4cd7342ab8039f1231fd213f7, 97f0239d08c24e56b5327fee7aa03331; no voters:
I20260807 22:40:56.710652 3605 raft_consensus.cc:2781] T 8834951b7bf04988bb849d5e55e5408d P 97f0239d08c24e56b5327fee7aa03331 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:40:56.710796 3605 raft_consensus.cc:686] T 8834951b7bf04988bb849d5e55e5408d P 97f0239d08c24e56b5327fee7aa03331 [term 1 LEADER]: Becoming Leader. State: Replica: 97f0239d08c24e56b5327fee7aa03331, State: Running, Role: LEADER
I20260807 22:40:56.710861 3605 consensus_queue.cc:237] T 8834951b7bf04988bb849d5e55e5408d P 97f0239d08c24e56b5327fee7aa03331 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } }
I20260807 22:40:56.711442 2763 catalog_manager.cc:5495] T 8834951b7bf04988bb849d5e55e5408d P 97f0239d08c24e56b5327fee7aa03331 reported cstate change: term changed from 0 to 1, leader changed from <none> to 97f0239d08c24e56b5327fee7aa03331 (127.22.212.65). New cstate: current_term: 1 leader_uuid: "97f0239d08c24e56b5327fee7aa03331" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97f0239d08c24e56b5327fee7aa03331" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 } health_report { overall_health: UNKNOWN } } }
I20260807 22:40:56.784348 3653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:56.781955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59812 (local address 127.22.212.65:38699)
0807 22:40:56.782078 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:56.782080 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:56.782087 (+ 7us) server_negotiation.cc:407] Connection header received
0807 22:40:56.782109 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:56.782110 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:56.782129 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:56.782202 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:40:56.782314 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:56.782810 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:56.783585 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:56.783794 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:56.783874 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:56.784041 (+ 167us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:40:56.784080 (+ 39us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:40:56.784138 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:56.784203 (+ 65us) server_negotiation.cc:299] Negotiation successful
0807 22:40:56.784228 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":57,"threads_started":1}
I20260807 22:40:56.788695 3653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:56.786691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:47615 (local address 127.22.212.65:38699)
0807 22:40:56.786734 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:56.786736 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:56.786804 (+ 68us) server_negotiation.cc:407] Connection header received
0807 22:40:56.786853 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:56.786853 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:56.786862 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:56.786906 (+ 44us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:40:56.786980 (+ 74us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:56.787409 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:56.788109 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:56.788299 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:56.788353 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:56.788476 (+ 123us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:40:56.788499 (+ 23us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:40:56.788554 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:56.788597 (+ 43us) server_negotiation.cc:299] Negotiation successful
0807 22:40:56.788615 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 22:40:56.788708 3658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:56.786619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:38699 (local address 127.22.212.65:47615)
0807 22:40:56.786744 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0807 22:40:56.786754 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 22:40:56.786811 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:40:56.786910 (+ 99us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:40:56.786911 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:40:56.786912 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 22:40:56.786945 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:56.786946 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:56.787471 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:56.787472 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:56.788026 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:40:56.788027 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:40:56.788367 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:40:56.788368 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:40:56.788410 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:56.788414 (+ 4us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 22:40:56.788562 (+ 148us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 22:40:56.788563 (+ 1us) client_negotiation.cc:769] Sending connection context
0807 22:40:56.788595 (+ 32us) client_negotiation.cc:240] Negotiation successful
0807 22:40:56.788635 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":79,"threads_started":1}
I20260807 22:40:56.790772 3432 raft_consensus.cc:1261] T 8834951b7bf04988bb849d5e55e5408d P f3e105e565d24ab390d4d3738bcc87c6 [term 1 FOLLOWER]: Refusing update from remote peer 97f0239d08c24e56b5327fee7aa03331: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:40:56.790797 3225 raft_consensus.cc:1261] T 8834951b7bf04988bb849d5e55e5408d P 242107e4cd7342ab8039f1231fd213f7 [term 1 FOLLOWER]: Refusing update from remote peer 97f0239d08c24e56b5327fee7aa03331: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:40:56.791023 3605 consensus_queue.cc:1035] T 8834951b7bf04988bb849d5e55e5408d P 97f0239d08c24e56b5327fee7aa03331 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3e105e565d24ab390d4d3738bcc87c6" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:40:56.791157 3605 consensus_queue.cc:1035] T 8834951b7bf04988bb849d5e55e5408d P 97f0239d08c24e56b5327fee7aa03331 [LEADER]: Connected to new peer: Peer: permanent_uuid: "242107e4cd7342ab8039f1231fd213f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:40:56.801836 2762 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49608:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:40:56.801954 2762 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49608:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:40:56.802551 2762 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f4ad6f156ba44a968bb94ed62d557e32: Sending DeleteTablet for 3 replicas of tablet 8834951b7bf04988bb849d5e55e5408d
I20260807 22:40:56.802827 2964 tablet_service.cc:1514] Processing DeleteTablet for tablet 8834951b7bf04988bb849d5e55e5408d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:56 UTC) from {username='oryx', principal='oryx/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:37318
I20260807 22:40:56.802860 3190 tablet_service.cc:1514] Processing DeleteTablet for tablet 8834951b7bf04988bb849d5e55e5408d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:56 UTC) from {username='oryx', principal='oryx/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:56038
I20260807 22:40:56.802860 3404 tablet_service.cc:1514] Processing DeleteTablet for tablet 8834951b7bf04988bb849d5e55e5408d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:40:56 UTC) from {username='oryx', principal='oryx/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:54208
I20260807 22:40:56.802963 3612 tablet_replica.cc:330] T 8834951b7bf04988bb849d5e55e5408d P 242107e4cd7342ab8039f1231fd213f7: stopping tablet replica
I20260807 22:40:56.802963 3615 tablet_replica.cc:330] T 8834951b7bf04988bb849d5e55e5408d P 97f0239d08c24e56b5327fee7aa03331: stopping tablet replica
I20260807 22:40:56.803027 3615 raft_consensus.cc:2229] T 8834951b7bf04988bb849d5e55e5408d P 97f0239d08c24e56b5327fee7aa03331 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:40:56.803033 3612 raft_consensus.cc:2229] T 8834951b7bf04988bb849d5e55e5408d P 242107e4cd7342ab8039f1231fd213f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:40:56.803071 3612 raft_consensus.cc:2258] T 8834951b7bf04988bb849d5e55e5408d P 242107e4cd7342ab8039f1231fd213f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:56.803114 3615 raft_consensus.cc:2258] T 8834951b7bf04988bb849d5e55e5408d P 97f0239d08c24e56b5327fee7aa03331 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:56.803193 3614 tablet_replica.cc:330] T 8834951b7bf04988bb849d5e55e5408d P f3e105e565d24ab390d4d3738bcc87c6: stopping tablet replica
I20260807 22:40:56.803256 3614 raft_consensus.cc:2229] T 8834951b7bf04988bb849d5e55e5408d P f3e105e565d24ab390d4d3738bcc87c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:40:56.803296 3614 raft_consensus.cc:2258] T 8834951b7bf04988bb849d5e55e5408d P f3e105e565d24ab390d4d3738bcc87c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:40:56.803375 3612 ts_tablet_manager.cc:1905] T 8834951b7bf04988bb849d5e55e5408d P 242107e4cd7342ab8039f1231fd213f7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:56.803594 3615 ts_tablet_manager.cc:1905] T 8834951b7bf04988bb849d5e55e5408d P 97f0239d08c24e56b5327fee7aa03331: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:56.803706 3614 ts_tablet_manager.cc:1905] T 8834951b7bf04988bb849d5e55e5408d P f3e105e565d24ab390d4d3738bcc87c6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:40:56.805160 3612 ts_tablet_manager.cc:1918] T 8834951b7bf04988bb849d5e55e5408d P 242107e4cd7342ab8039f1231fd213f7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 22:40:56.805173 3614 ts_tablet_manager.cc:1918] T 8834951b7bf04988bb849d5e55e5408d P f3e105e565d24ab390d4d3738bcc87c6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 22:40:56.805227 3614 log.cc:1196] T 8834951b7bf04988bb849d5e55e5408d P f3e105e565d24ab390d4d3738bcc87c6: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-2/wal/wals/8834951b7bf04988bb849d5e55e5408d
I20260807 22:40:56.805226 3612 log.cc:1196] T 8834951b7bf04988bb849d5e55e5408d P 242107e4cd7342ab8039f1231fd213f7: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-1/wal/wals/8834951b7bf04988bb849d5e55e5408d
I20260807 22:40:56.805457 3614 ts_tablet_manager.cc:1939] T 8834951b7bf04988bb849d5e55e5408d P f3e105e565d24ab390d4d3738bcc87c6: Deleting consensus metadata
I20260807 22:40:56.805466 3612 ts_tablet_manager.cc:1939] T 8834951b7bf04988bb849d5e55e5408d P 242107e4cd7342ab8039f1231fd213f7: Deleting consensus metadata
I20260807 22:40:56.805816 2747 catalog_manager.cc:4841] TS f3e105e565d24ab390d4d3738bcc87c6 (127.22.212.67:42511): tablet 8834951b7bf04988bb849d5e55e5408d (table test-table [id=6fc87a38c96447969d59369fb1a6e035]) successfully deleted
I20260807 22:40:56.805826 2745 catalog_manager.cc:4841] TS 242107e4cd7342ab8039f1231fd213f7 (127.22.212.66:46695): tablet 8834951b7bf04988bb849d5e55e5408d (table test-table [id=6fc87a38c96447969d59369fb1a6e035]) successfully deleted
I20260807 22:40:56.806046 3615 ts_tablet_manager.cc:1918] T 8834951b7bf04988bb849d5e55e5408d P 97f0239d08c24e56b5327fee7aa03331: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 22:40:56.806121 3615 log.cc:1196] T 8834951b7bf04988bb849d5e55e5408d P 97f0239d08c24e56b5327fee7aa03331: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786142418640232-23377-0/minicluster-data/ts-0/wal/wals/8834951b7bf04988bb849d5e55e5408d
I20260807 22:40:56.806325 3615 ts_tablet_manager.cc:1939] T 8834951b7bf04988bb849d5e55e5408d P 97f0239d08c24e56b5327fee7aa03331: Deleting consensus metadata
I20260807 22:40:56.806653 2743 catalog_manager.cc:4841] TS 97f0239d08c24e56b5327fee7aa03331 (127.22.212.65:38699): tablet 8834951b7bf04988bb849d5e55e5408d (table test-table [id=6fc87a38c96447969d59369fb1a6e035]) successfully deleted
I20260807 22:40:56.806715 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 2870
I20260807 22:40:56.825119 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 3083
I20260807 22:40:56.842111 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 3312
I20260807 22:40:56.855278 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 2719
2026-08-07T22:40:56Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3334 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142418640232-23377-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:40:56 dist-test-slave-2d19 krb5kdc[3672](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:40:56 dist-test-slave-2d19 krb5kdc[3672](info): set up 2 sockets
Aug 07 22:40:56 dist-test-slave-2d19 krb5kdc[3672](info): commencing operation
krb5kdc: starting...
W20260807 22:40:58.127843 23377 mini_kdc.cc:121] Time spent starting KDC: real 1.243s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Aug 07 22:40:58 dist-test-slave-2d19 krb5kdc[3672](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142458, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:40:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:40:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.212.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
I20260807 22:40:58.255551 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:34215
--webserver_interface=127.22.212.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:46881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:34215
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:58.339149 3688 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:58.339390 3688 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:58.339430 3688 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:58.340646 3688 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:40:58.340711 3688 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:58.340735 3688 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:58.340763 3688 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:40:58.340794 3688 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:40:58.342286 3688 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:46881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:34215
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:34215
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3688
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:58.342566 3688 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:58.342805 3688 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:58.348191 3697 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:58.348409 3688 server_base.cc:1034] running on GCE node
W20260807 22:40:58.348210 3694 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:58.348197 3693 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:58.348781 3688 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:58.349115 3688 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:58.350284 3688 hybrid_clock.cc:648] HybridClock initialized: now 1786142458350261 us; error 37 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-07T22:40:58Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1500 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:40:58 dist-test-slave-2d19 krb5kdc[3703](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:40:58 dist-test-slave-2d19 krb5kdc[3703](info): set up 2 sockets
Aug 07 22:40:58 dist-test-slave-2d19 krb5kdc[3703](info): commencing operation
krb5kdc: starting...
W20260807 22:40:59.620129 23377 mini_kdc.cc:121] Time spent starting KDC: real 1.235s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Aug 07 22:40:59 dist-test-slave-2d19 krb5kdc[3703](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142459, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:40:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:40:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.212.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
I20260807 22:40:59.749588 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:45623
--webserver_interface=127.22.212.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:36857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:45623
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:40:59.832748 3724 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:40:59.832954 3724 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:40:59.832976 3724 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:40:59.834113 3724 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:40:59.834156 3724 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:40:59.834169 3724 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:40:59.834182 3724 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:40:59.834194 3724 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:40:59.835687 3724 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:36857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:45623
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:45623
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3724
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:40:59.835966 3724 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:40:59.836215 3724 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:40:59.841189 3736 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:59.841253 3730 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:40:59.841189 3731 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:40:59.841617 3724 server_base.cc:1034] running on GCE node
I20260807 22:40:59.841878 3724 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:40:59.842182 3724 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:40:59.843380 3724 hybrid_clock.cc:648] HybridClock initialized: now 1786142459843373 us; error 37 us; skew 500 ppm
Aug 07 22:40:59 dist-test-slave-2d19 krb5kdc[3703](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142459, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:40:59.851321 3724 init.cc:377] Logged in from keytab as kudu/127.22.212.126@KRBTEST.COM (short username kudu)
I20260807 22:40:59.851899 3724 webserver.cc:460] Webserver started at http://127.22.212.126:34031/ using document root <none> and password file <none>
I20260807 22:40:59.852149 3724 fs_manager.cc:359] Metadata directory not provided
I20260807 22:40:59.852221 3724 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:40:59.852434 3724 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:40:59.853578 3724 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "39810395765c4b6594e1a77c4f79e28b"
format_stamp: "Formatted at 2026-08-07 22:40:59 on dist-test-slave-2d19"
server_key: "7049e894548a92b2353df29b534da6cd"
server_key_iv: "407f034f5a98b4d753275cff8a583835"
server_key_version: "encryptionkey@0"
I20260807 22:40:59.853977 3724 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "39810395765c4b6594e1a77c4f79e28b"
format_stamp: "Formatted at 2026-08-07 22:40:59 on dist-test-slave-2d19"
server_key: "7049e894548a92b2353df29b534da6cd"
server_key_iv: "407f034f5a98b4d753275cff8a583835"
server_key_version: "encryptionkey@0"
I20260807 22:40:59.855422 3724 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 22:40:59.856205 3745 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:40:59.856412 3724 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:40:59.856510 3724 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "39810395765c4b6594e1a77c4f79e28b"
format_stamp: "Formatted at 2026-08-07 22:40:59 on dist-test-slave-2d19"
server_key: "7049e894548a92b2353df29b534da6cd"
server_key_iv: "407f034f5a98b4d753275cff8a583835"
server_key_version: "encryptionkey@0"
I20260807 22:40:59.856572 3724 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:40:59.867456 3724 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:40:59.869801 3724 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:40:59.869913 3724 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:40:59.873821 3724 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:45623
I20260807 22:40:59.873888 3823 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:45623 every 8 connection(s)
I20260807 22:40:59.874255 3724 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:40:59.874722 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 3724
I20260807 22:40:59.874836 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:40:59.875038 23377 external_mini_cluster.cc:1428] Setting key 5a63c2be7ea0b8981f17d8b179678ce7
I20260807 22:40:59.875367 3824 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:40:59.878849 3824 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39810395765c4b6594e1a77c4f79e28b: Bootstrap starting.
I20260807 22:40:59.879459 3824 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 39810395765c4b6594e1a77c4f79e28b: Neither blocks nor log segments found. Creating new log.
I20260807 22:40:59.879769 3824 log.cc:824] T 00000000000000000000000000000000 P 39810395765c4b6594e1a77c4f79e28b: Log is configured to *not* fsync() on all Append() calls
I20260807 22:40:59.880553 3824 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39810395765c4b6594e1a77c4f79e28b: No bootstrap required, opened a new log
Aug 07 22:40:59 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142459, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:40:59.883031 3824 raft_consensus.cc:348] T 00000000000000000000000000000000 P 39810395765c4b6594e1a77c4f79e28b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39810395765c4b6594e1a77c4f79e28b" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 45623 } }
I20260807 22:40:59.883191 3824 raft_consensus.cc:374] T 00000000000000000000000000000000 P 39810395765c4b6594e1a77c4f79e28b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:40:59.883256 3824 raft_consensus.cc:729] T 00000000000000000000000000000000 P 39810395765c4b6594e1a77c4f79e28b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39810395765c4b6594e1a77c4f79e28b, State: Initialized, Role: FOLLOWER
I20260807 22:40:59.883404 3824 consensus_queue.cc:260] T 00000000000000000000000000000000 P 39810395765c4b6594e1a77c4f79e28b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39810395765c4b6594e1a77c4f79e28b" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 45623 } }
I20260807 22:40:59.883494 3824 raft_consensus.cc:388] T 00000000000000000000000000000000 P 39810395765c4b6594e1a77c4f79e28b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:40:59.883548 3824 raft_consensus.cc:482] T 00000000000000000000000000000000 P 39810395765c4b6594e1a77c4f79e28b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:40:59.883601 3824 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 39810395765c4b6594e1a77c4f79e28b [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:40:59.884239 3824 raft_consensus.cc:504] T 00000000000000000000000000000000 P 39810395765c4b6594e1a77c4f79e28b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39810395765c4b6594e1a77c4f79e28b" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 45623 } }
I20260807 22:40:59.884435 3824 leader_election.cc:302] T 00000000000000000000000000000000 P 39810395765c4b6594e1a77c4f79e28b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 39810395765c4b6594e1a77c4f79e28b; no voters:
I20260807 22:40:59.884670 3824 leader_election.cc:288] T 00000000000000000000000000000000 P 39810395765c4b6594e1a77c4f79e28b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:40:59.884720 3830 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 39810395765c4b6594e1a77c4f79e28b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:40:59.884909 3830 raft_consensus.cc:686] T 00000000000000000000000000000000 P 39810395765c4b6594e1a77c4f79e28b [term 1 LEADER]: Becoming Leader. State: Replica: 39810395765c4b6594e1a77c4f79e28b, State: Running, Role: LEADER
I20260807 22:40:59.884963 3824 sys_catalog.cc:564] T 00000000000000000000000000000000 P 39810395765c4b6594e1a77c4f79e28b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:40:59.885092 3830 consensus_queue.cc:237] T 00000000000000000000000000000000 P 39810395765c4b6594e1a77c4f79e28b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39810395765c4b6594e1a77c4f79e28b" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 45623 } }
I20260807 22:40:59.885455 3836 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39810395765c4b6594e1a77c4f79e28b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "39810395765c4b6594e1a77c4f79e28b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39810395765c4b6594e1a77c4f79e28b" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 45623 } } }
I20260807 22:40:59.885558 3836 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39810395765c4b6594e1a77c4f79e28b [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:59.886431 3832 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39810395765c4b6594e1a77c4f79e28b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 39810395765c4b6594e1a77c4f79e28b. Latest consensus state: current_term: 1 leader_uuid: "39810395765c4b6594e1a77c4f79e28b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39810395765c4b6594e1a77c4f79e28b" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 45623 } } }
I20260807 22:40:59.886548 3843 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:40:59.886605 3832 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39810395765c4b6594e1a77c4f79e28b [sys.catalog]: This master's current role is: LEADER
I20260807 22:40:59.886808 3827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:40:59.875606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60320 (local address 127.22.212.126:45623)
0807 22:40:59.875811 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0807 22:40:59.875821 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 22:40:59.875855 (+ 34us) server_negotiation.cc:407] Connection header received
0807 22:40:59.876608 (+ 753us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:40:59.876617 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:40:59.876681 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:40:59.876828 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:40:59.877426 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:59.878797 (+ 1371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:59.879590 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:40:59.880049 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:40:59.880170 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:40:59.882838 (+ 2668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:40:59.882842 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:40:59.882842 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:40:59.882853 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:40:59.884779 (+ 1926us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:59.885206 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:59.885209 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:59.885209 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:59.885313 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:40:59.885539 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:40:59.885540 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:40:59.885540 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:40:59.885898 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:40:59.886089 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0807 22:40:59.886217 (+ 128us) server_negotiation.cc:299] Negotiation successful
0807 22:40:59.886381 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":92,"threads_started":1}
I20260807 22:40:59.887137 3843 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:40:59.888751 3843 catalog_manager.cc:1347] Generated new cluster ID: fc1bb22ba1fc44dbae5b19333971d608
I20260807 22:40:59.888823 3843 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:40:59.901371 3843 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:40:59.901894 3843 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:40:59.906687 3843 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 39810395765c4b6594e1a77c4f79e28b: Generated new TSK 0
I20260807 22:40:59.906883 3843 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.212.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab.
Entry for principal kudu/127.22.212.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab.
I20260807 22:40:59.942963 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.65:0
--local_ip_for_outbound_sockets=127.22.212.65
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:45623
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:36857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:41:00.028076 3863 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:00.028407 3863 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:00.028455 3863 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:00.029660 3863 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:00.029733 3863 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:00.029776 3863 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.65
I20260807 22:41:00.031653 3863 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:36857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:45623
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3863
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.65
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:41:00.032032 3863 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:00.032390 3863 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:00.037910 3875 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:00.037876 3872 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:00.037945 3871 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:00.038082 3863 server_base.cc:1034] running on GCE node
I20260807 22:41:00.038374 3863 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:00.038616 3863 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:00.039767 3863 hybrid_clock.cc:648] HybridClock initialized: now 1786142460039751 us; error 30 us; skew 500 ppm
Aug 07 22:41:00 dist-test-slave-2d19 krb5kdc[3703](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142460, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:41:00.043226 3863 init.cc:377] Logged in from keytab as kudu/127.22.212.65@KRBTEST.COM (short username kudu)
I20260807 22:41:00.043689 3863 webserver.cc:460] Webserver started at http://127.22.212.65:45917/ using document root <none> and password file <none>
I20260807 22:41:00.043936 3863 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:00.044008 3863 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:00.044165 3863 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:41:00.045291 3863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-0/data/instance:
uuid: "0066fbd74cdb4d329f30a1e3d01c9f28"
format_stamp: "Formatted at 2026-08-07 22:41:00 on dist-test-slave-2d19"
server_key: "1d025ab807376a456f7e24332e72adf6"
server_key_iv: "86a1635b5dbd2739706b3ef289a87f99"
server_key_version: "encryptionkey@0"
I20260807 22:41:00.045680 3863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance:
uuid: "0066fbd74cdb4d329f30a1e3d01c9f28"
format_stamp: "Formatted at 2026-08-07 22:41:00 on dist-test-slave-2d19"
server_key: "1d025ab807376a456f7e24332e72adf6"
server_key_iv: "86a1635b5dbd2739706b3ef289a87f99"
server_key_version: "encryptionkey@0"
I20260807 22:41:00.047087 3863 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 22:41:00.047804 3883 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:00.047976 3863 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 22:41:00.048100 3863 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-0/wal
uuid: "0066fbd74cdb4d329f30a1e3d01c9f28"
format_stamp: "Formatted at 2026-08-07 22:41:00 on dist-test-slave-2d19"
server_key: "1d025ab807376a456f7e24332e72adf6"
server_key_iv: "86a1635b5dbd2739706b3ef289a87f99"
server_key_version: "encryptionkey@0"
I20260807 22:41:00.048180 3863 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:00.062357 3863 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:00.064189 3863 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:00.064390 3863 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:00.064630 3863 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:41:00.064944 3863 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:41:00.064978 3863 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:00.065001 3863 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:41:00.065052 3863 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:00.070751 3863 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.65:37657
I20260807 22:41:00.070854 4056 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.65:37657 every 8 connection(s)
I20260807 22:41:00.071164 3863 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
Aug 07 22:41:00 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142460, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:41:00.078785 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 3863
I20260807 22:41:00.078883 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance
I20260807 22:41:00.079052 23377 external_mini_cluster.cc:1428] Setting key 372870922d1d406f45540e19045887dc
I20260807 22:41:00.081761 3827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:00.071915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:41105 (local address 127.22.212.126:45623)
0807 22:41:00.071997 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:00.071999 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:00.072195 (+ 196us) server_negotiation.cc:407] Connection header received
0807 22:41:00.072786 (+ 591us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:00.072787 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:00.072800 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:00.072866 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:00.073853 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:00.074367 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:00.075376 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:00.075592 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:00.075677 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:00.078198 (+ 2521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:00.078200 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:00.078200 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:41:00.078207 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:00.080135 (+ 1928us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:00.080655 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:00.080656 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:00.080656 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:00.080709 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:00.081004 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:00.081005 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:00.081005 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:00.081111 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:00.081159 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:00.081490 (+ 331us) server_negotiation.cc:299] Negotiation successful
0807 22:41:00.081620 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 22:41:00.081908 4063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:00.071865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.65:41105)
0807 22:41:00.072064 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:00.072109 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:00.072672 (+ 563us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:00.072941 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:00.072945 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:00.073554 (+ 609us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:00.073744 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:00.073749 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:00.074480 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:00.074481 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:00.075279 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:00.075281 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:00.075693 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:00.075695 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:00.075845 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:00.076509 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:00.076540 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:00.078108 (+ 1568us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:41:00.080217 (+ 2109us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:41:00.080225 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:41:00.080227 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:41:00.080581 (+ 354us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:41:00.080779 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:41:00.080780 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:41:00.080780 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:41:00.080932 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:41:00.081174 (+ 242us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:41:00.081180 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:41:00.081349 (+ 169us) client_negotiation.cc:769] Sending connection context
0807 22:41:00.081458 (+ 109us) client_negotiation.cc:240] Negotiation successful
0807 22:41:00.081651 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":91,"threads_started":1}
I20260807 22:41:00.082382 4059 heartbeater.cc:347] Connected to a master server at 127.22.212.126:45623
I20260807 22:41:00.082494 4059 heartbeater.cc:464] Registering TS with master...
I20260807 22:41:00.082703 4059 heartbeater.cc:511] Master 127.22.212.126:45623 requested a full tablet report, sending...
I20260807 22:41:00.083225 3770 ts_manager.cc:194] Registered new tserver with Master: 0066fbd74cdb4d329f30a1e3d01c9f28 (127.22.212.65:37657)
I20260807 22:41:00.083834 3770 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.65@KRBTEST.COM'} at 127.22.212.65:41105
WARNING: no policy specified for kudu/127.22.212.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab.
Entry for principal kudu/127.22.212.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab.
I20260807 22:41:00.109277 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.66:0
--local_ip_for_outbound_sockets=127.22.212.66
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:45623
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:36857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:41:00.193305 4067 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:00.193516 4067 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:00.193540 4067 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:00.194747 4067 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:00.194793 4067 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:00.194820 4067 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.66
I20260807 22:41:00.196346 4067 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:36857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:45623
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4067
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.66
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:41:00.196592 4067 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:00.196841 4067 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:00.201963 4075 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:00.202044 4074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:00.202029 4079 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:00.202199 4067 server_base.cc:1034] running on GCE node
I20260807 22:41:00.202411 4067 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:00.202626 4067 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:00.203770 4067 hybrid_clock.cc:648] HybridClock initialized: now 1786142460203760 us; error 33 us; skew 500 ppm
Aug 07 22:41:00 dist-test-slave-2d19 krb5kdc[3703](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142460, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:41:00.206377 4067 init.cc:377] Logged in from keytab as kudu/127.22.212.66@KRBTEST.COM (short username kudu)
I20260807 22:41:00.206856 4067 webserver.cc:460] Webserver started at http://127.22.212.66:35777/ using document root <none> and password file <none>
I20260807 22:41:00.207115 4067 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:00.207186 4067 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:00.207340 4067 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:41:00.208469 4067 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-1/data/instance:
uuid: "a74cb537f7f040dea13fbc7b748c309d"
format_stamp: "Formatted at 2026-08-07 22:41:00 on dist-test-slave-2d19"
server_key: "2b1685cdc8400afaaa7bd63115bb6afc"
server_key_iv: "73d7fd4a8d71ce24ff577049a0a969db"
server_key_version: "encryptionkey@0"
I20260807 22:41:00.208837 4067 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance:
uuid: "a74cb537f7f040dea13fbc7b748c309d"
format_stamp: "Formatted at 2026-08-07 22:41:00 on dist-test-slave-2d19"
server_key: "2b1685cdc8400afaaa7bd63115bb6afc"
server_key_iv: "73d7fd4a8d71ce24ff577049a0a969db"
server_key_version: "encryptionkey@0"
I20260807 22:41:00.210194 4067 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:41:00.210913 4086 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:00.211095 4067 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 22:41:00.211206 4067 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-1/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-1/wal
uuid: "a74cb537f7f040dea13fbc7b748c309d"
format_stamp: "Formatted at 2026-08-07 22:41:00 on dist-test-slave-2d19"
server_key: "2b1685cdc8400afaaa7bd63115bb6afc"
server_key_iv: "73d7fd4a8d71ce24ff577049a0a969db"
server_key_version: "encryptionkey@0"
I20260807 22:41:00.211285 4067 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:00.233264 4067 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:00.235316 4067 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:00.235484 4067 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:00.235741 4067 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:41:00.236083 4067 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:41:00.236141 4067 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:00.236178 4067 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:41:00.236207 4067 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:00.242113 4067 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.66:37491
I20260807 22:41:00.242153 4247 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.66:37491 every 8 connection(s)
I20260807 22:41:00.242504 4067 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
I20260807 22:41:00.244787 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 4067
I20260807 22:41:00.244876 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance
I20260807 22:41:00.245090 23377 external_mini_cluster.cc:1428] Setting key 013cafe7e26a20d08051fc1b3f9140d6
Aug 07 22:41:00 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142460, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:41:00.252918 4251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:00.243226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.66:43883)
0807 22:41:00.243411 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:00.243452 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:00.243923 (+ 471us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:00.244185 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:00.244189 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:00.244858 (+ 669us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:00.245140 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:00.245148 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:00.245963 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:00.245964 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:00.246777 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:00.246779 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:00.247212 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:00.247214 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:00.247370 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:00.247880 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:00.247892 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:00.249518 (+ 1626us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:41:00.251408 (+ 1890us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:41:00.251415 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:41:00.251416 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:41:00.251662 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:41:00.251926 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:41:00.251927 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:41:00.251927 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:41:00.252044 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:41:00.252394 (+ 350us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:41:00.252399 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:41:00.252521 (+ 122us) client_negotiation.cc:769] Sending connection context
0807 22:41:00.252625 (+ 104us) client_negotiation.cc:240] Negotiation successful
0807 22:41:00.252751 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":111,"threads_started":1}
I20260807 22:41:00.252909 3827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:00.243266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:43883 (local address 127.22.212.126:45623)
0807 22:41:00.243327 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:00.243329 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:00.243534 (+ 205us) server_negotiation.cc:407] Connection header received
0807 22:41:00.244018 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:00.244019 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:00.244030 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:00.244104 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:00.245236 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:00.245874 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:00.246869 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:00.247093 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:00.247202 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:00.249612 (+ 2410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:00.249614 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:00.249614 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:41:00.249623 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:00.251304 (+ 1681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:00.251742 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:00.251744 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:00.251744 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:00.251815 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:00.252120 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:00.252121 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:00.252121 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:00.252318 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:00.252407 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:00.252675 (+ 268us) server_negotiation.cc:299] Negotiation successful
0807 22:41:00.252771 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260807 22:41:00.253432 4248 heartbeater.cc:347] Connected to a master server at 127.22.212.126:45623
I20260807 22:41:00.253561 4248 heartbeater.cc:464] Registering TS with master...
I20260807 22:41:00.253758 4248 heartbeater.cc:511] Master 127.22.212.126:45623 requested a full tablet report, sending...
I20260807 22:41:00.254220 3770 ts_manager.cc:194] Registered new tserver with Master: a74cb537f7f040dea13fbc7b748c309d (127.22.212.66:37491)
I20260807 22:41:00.254769 3770 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.66@KRBTEST.COM'} at 127.22.212.66:43883
WARNING: no policy specified for kudu/127.22.212.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab.
Entry for principal kudu/127.22.212.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab.
I20260807 22:41:00.275105 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.67:0
--local_ip_for_outbound_sockets=127.22.212.67
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:45623
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:36857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:41:00.364163 4256 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:00.364459 4256 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:00.364500 4256 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:00.365687 4256 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:00.365763 4256 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:00.365808 4256 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.67
I20260807 22:41:00.367295 4256 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:36857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:45623
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4256
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.67
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:41:00.367585 4256 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:00.367838 4256 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:00.373020 4265 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:00.373000 4264 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:00.373000 4268 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:00.373252 4256 server_base.cc:1034] running on GCE node
I20260807 22:41:00.373447 4256 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:00.373716 4256 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:00.374902 4256 hybrid_clock.cc:648] HybridClock initialized: now 1786142460374892 us; error 27 us; skew 500 ppm
Aug 07 22:41:00 dist-test-slave-2d19 krb5kdc[3703](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142460, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:41:00.377404 4256 init.cc:377] Logged in from keytab as kudu/127.22.212.67@KRBTEST.COM (short username kudu)
I20260807 22:41:00.377946 4256 webserver.cc:460] Webserver started at http://127.22.212.67:39933/ using document root <none> and password file <none>
I20260807 22:41:00.378217 4256 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:00.378291 4256 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:00.378443 4256 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:41:00.379518 4256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-2/data/instance:
uuid: "cec623edb6254048beaa76a2413ed459"
format_stamp: "Formatted at 2026-08-07 22:41:00 on dist-test-slave-2d19"
server_key: "3216d712121f5460a020b9e3c94a00e3"
server_key_iv: "d84b73ad0e30b1dca20fc33fafa30497"
server_key_version: "encryptionkey@0"
I20260807 22:41:00.379884 4256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance:
uuid: "cec623edb6254048beaa76a2413ed459"
format_stamp: "Formatted at 2026-08-07 22:41:00 on dist-test-slave-2d19"
server_key: "3216d712121f5460a020b9e3c94a00e3"
server_key_iv: "d84b73ad0e30b1dca20fc33fafa30497"
server_key_version: "encryptionkey@0"
I20260807 22:41:00.381330 4256 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 22:41:00.382071 4285 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:00.382241 4256 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 22:41:00.382350 4256 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-2/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-2/wal
uuid: "cec623edb6254048beaa76a2413ed459"
format_stamp: "Formatted at 2026-08-07 22:41:00 on dist-test-slave-2d19"
server_key: "3216d712121f5460a020b9e3c94a00e3"
server_key_iv: "d84b73ad0e30b1dca20fc33fafa30497"
server_key_version: "encryptionkey@0"
I20260807 22:41:00.382426 4256 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:00.396912 4256 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:00.398957 4256 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:00.399142 4256 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:00.399396 4256 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:41:00.399741 4256 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:41:00.399803 4256 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:00.399854 4256 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:41:00.399880 4256 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:00.406396 4256 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.67:45213
I20260807 22:41:00.406474 4452 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.67:45213 every 8 connection(s)
I20260807 22:41:00.406870 4256 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
I20260807 22:41:00.411547 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 4256
I20260807 22:41:00.411630 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance
I20260807 22:41:00.411804 23377 external_mini_cluster.cc:1428] Setting key 183cfd3838357e4a8a0a93c9e3602ac9
Aug 07 22:41:00 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142460, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:41:00.417086 3827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:00.407730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:41985 (local address 127.22.212.126:45623)
0807 22:41:00.407801 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:00.407803 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:00.408033 (+ 230us) server_negotiation.cc:407] Connection header received
0807 22:41:00.408712 (+ 679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:00.408713 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:00.408727 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:00.408776 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:00.409806 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:00.410376 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:00.411491 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:00.411781 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:00.411891 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:00.414353 (+ 2462us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:00.414354 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:00.414354 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:41:00.414362 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:00.415735 (+ 1373us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:00.416121 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:00.416122 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:00.416122 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:00.416182 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:00.416486 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:00.416487 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:00.416488 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:00.416609 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:00.416674 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:00.416954 (+ 280us) server_negotiation.cc:299] Negotiation successful
0807 22:41:00.417021 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 22:41:00.417165 4457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:00.407720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.67:41985)
0807 22:41:00.407874 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:00.407929 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:00.408595 (+ 666us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:00.408850 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:00.408854 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:00.409489 (+ 635us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:00.409694 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:00.409700 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:00.410485 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:00.410486 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:00.411386 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:00.411388 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:00.411903 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:00.411904 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:00.412056 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:00.412655 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:00.412667 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:00.414265 (+ 1598us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:41:00.415811 (+ 1546us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:41:00.415817 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:41:00.415819 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:41:00.416030 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:41:00.416293 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:41:00.416294 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:41:00.416294 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:41:00.416401 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:41:00.416676 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:41:00.416680 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:41:00.416796 (+ 116us) client_negotiation.cc:769] Sending connection context
0807 22:41:00.416875 (+ 79us) client_negotiation.cc:240] Negotiation successful
0807 22:41:00.416997 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":71,"threads_started":1}
I20260807 22:41:00.417686 4454 heartbeater.cc:347] Connected to a master server at 127.22.212.126:45623
I20260807 22:41:00.417786 4454 heartbeater.cc:464] Registering TS with master...
I20260807 22:41:00.418004 4454 heartbeater.cc:511] Master 127.22.212.126:45623 requested a full tablet report, sending...
I20260807 22:41:00.418416 3770 ts_manager.cc:194] Registered new tserver with Master: cec623edb6254048beaa76a2413ed459 (127.22.212.67:45213)
I20260807 22:41:00.418807 3770 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.67@KRBTEST.COM'} at 127.22.212.67:41985
I20260807 22:41:00.423702 23377 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.22.212.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.212.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.212.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.65.keytab.
Entry for principal oryx/127.22.212.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.65.keytab.
WARNING: no policy specified for oryx/127.22.212.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.212.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.212.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.66.keytab.
Entry for principal oryx/127.22.212.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.66.keytab.
WARNING: no policy specified for oryx/127.22.212.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.212.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.212.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.67.keytab.
Entry for principal oryx/127.22.212.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.67.keytab.
I20260807 22:41:00.500872 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 3863
I20260807 22:41:00.516455 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 4067
I20260807 22:41:00.528856 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 4256
I20260807 22:41:00.539750 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 3724
I20260807 22:41:00.549407 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:45623
--webserver_interface=127.22.212.126
--webserver_port=34031
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:36857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:45623
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:41:00.632725 4467 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:00.632933 4467 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:00.632956 4467 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:00.634159 4467 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:41:00.634203 4467 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:00.634218 4467 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:00.634231 4467 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:41:00.634289 4467 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:41:00.635773 4467 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:36857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:45623
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:45623
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=34031
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4467
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:41:00.636029 4467 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:00.636296 4467 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:00.641186 4475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:00.641196 4478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:00.641523 4467 server_base.cc:1034] running on GCE node
W20260807 22:41:00.641201 4476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:00.641809 4467 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:00.642154 4467 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:00.643322 4467 hybrid_clock.cc:648] HybridClock initialized: now 1786142460643320 us; error 41 us; skew 500 ppm
Aug 07 22:41:00 dist-test-slave-2d19 krb5kdc[3703](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142460, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:41:00.646023 4467 init.cc:377] Logged in from keytab as kudu/127.22.212.126@KRBTEST.COM (short username kudu)
I20260807 22:41:00.646492 4467 webserver.cc:460] Webserver started at http://127.22.212.126:34031/ using document root <none> and password file <none>
I20260807 22:41:00.646751 4467 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:00.646842 4467 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:00.648221 4467 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:41:00.649060 4486 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:00.649642 4467 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:41:00.649758 4467 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "39810395765c4b6594e1a77c4f79e28b"
format_stamp: "Formatted at 2026-08-07 22:40:59 on dist-test-slave-2d19"
server_key: "7049e894548a92b2353df29b534da6cd"
server_key_iv: "407f034f5a98b4d753275cff8a583835"
server_key_version: "encryptionkey@0"
I20260807 22:41:00.650209 4467 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:00.682499 4467 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:00.684540 4467 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:00.684664 4467 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:00.688755 4467 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:45623
I20260807 22:41:00.688843 4564 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:45623 every 8 connection(s)
I20260807 22:41:00.689215 4467 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:41:00.690761 4565 sys_catalog.cc:263] Verifying existing consensus state
I20260807 22:41:00.691454 4565 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39810395765c4b6594e1a77c4f79e28b: Bootstrap starting.
I20260807 22:41:00.695024 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 4467
I20260807 22:41:00.695333 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.65:37657
--local_ip_for_outbound_sockets=127.22.212.65
--tserver_master_addrs=127.22.212.126:45623
--webserver_port=45917
--webserver_interface=127.22.212.65
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:36857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.22.212.65
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.65.keytab with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:41:00.700556 4565 log.cc:824] T 00000000000000000000000000000000 P 39810395765c4b6594e1a77c4f79e28b: Log is configured to *not* fsync() on all Append() calls
I20260807 22:41:00.702243 4565 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39810395765c4b6594e1a77c4f79e28b: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 22:41:00.702548 4565 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39810395765c4b6594e1a77c4f79e28b: Bootstrap complete.
I20260807 22:41:00.704908 4565 raft_consensus.cc:348] T 00000000000000000000000000000000 P 39810395765c4b6594e1a77c4f79e28b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39810395765c4b6594e1a77c4f79e28b" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 45623 } }
I20260807 22:41:00.705156 4565 raft_consensus.cc:729] T 00000000000000000000000000000000 P 39810395765c4b6594e1a77c4f79e28b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39810395765c4b6594e1a77c4f79e28b, State: Initialized, Role: FOLLOWER
I20260807 22:41:00.705344 4565 consensus_queue.cc:260] T 00000000000000000000000000000000 P 39810395765c4b6594e1a77c4f79e28b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39810395765c4b6594e1a77c4f79e28b" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 45623 } }
I20260807 22:41:00.705426 4565 raft_consensus.cc:388] T 00000000000000000000000000000000 P 39810395765c4b6594e1a77c4f79e28b [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:41:00.705482 4565 raft_consensus.cc:482] T 00000000000000000000000000000000 P 39810395765c4b6594e1a77c4f79e28b [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:41:00.705536 4565 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 39810395765c4b6594e1a77c4f79e28b [term 1 FOLLOWER]: Advancing to term 2
I20260807 22:41:00.706521 4565 raft_consensus.cc:504] T 00000000000000000000000000000000 P 39810395765c4b6594e1a77c4f79e28b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39810395765c4b6594e1a77c4f79e28b" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 45623 } }
I20260807 22:41:00.706645 4565 leader_election.cc:302] T 00000000000000000000000000000000 P 39810395765c4b6594e1a77c4f79e28b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 39810395765c4b6594e1a77c4f79e28b; no voters:
I20260807 22:41:00.706874 4565 leader_election.cc:288] T 00000000000000000000000000000000 P 39810395765c4b6594e1a77c4f79e28b [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 22:41:00.706908 4572 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 39810395765c4b6594e1a77c4f79e28b [term 2 FOLLOWER]: Leader election won for term 2
I20260807 22:41:00.707034 4572 raft_consensus.cc:686] T 00000000000000000000000000000000 P 39810395765c4b6594e1a77c4f79e28b [term 2 LEADER]: Becoming Leader. State: Replica: 39810395765c4b6594e1a77c4f79e28b, State: Running, Role: LEADER
I20260807 22:41:00.707142 4572 consensus_queue.cc:237] T 00000000000000000000000000000000 P 39810395765c4b6594e1a77c4f79e28b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39810395765c4b6594e1a77c4f79e28b" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 45623 } }
I20260807 22:41:00.707147 4565 sys_catalog.cc:564] T 00000000000000000000000000000000 P 39810395765c4b6594e1a77c4f79e28b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:41:00.708423 4574 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39810395765c4b6594e1a77c4f79e28b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "39810395765c4b6594e1a77c4f79e28b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39810395765c4b6594e1a77c4f79e28b" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 45623 } } }
I20260807 22:41:00.708519 4574 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39810395765c4b6594e1a77c4f79e28b [sys.catalog]: This master's current role is: LEADER
I20260807 22:41:00.708442 4573 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39810395765c4b6594e1a77c4f79e28b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 39810395765c4b6594e1a77c4f79e28b. Latest consensus state: current_term: 2 leader_uuid: "39810395765c4b6594e1a77c4f79e28b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39810395765c4b6594e1a77c4f79e28b" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 45623 } } }
I20260807 22:41:00.708576 4573 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39810395765c4b6594e1a77c4f79e28b [sys.catalog]: This master's current role is: LEADER
I20260807 22:41:00.708714 4593 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:41:00.709385 4593 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:41:00.709517 4593 catalog_manager.cc:1259] Loaded cluster ID: fc1bb22ba1fc44dbae5b19333971d608
I20260807 22:41:00.709556 4593 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:41:00.710707 4593 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:41:00.710891 4593 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 39810395765c4b6594e1a77c4f79e28b: Loaded TSK: 0
I20260807 22:41:00.711115 4593 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 22:41:00.781278 4570 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:00.781512 4570 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:00.781553 4570 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:00.782712 4570 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:00.782783 4570 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:00.782828 4570 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.65
I20260807 22:41:00.784376 4570 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:36857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.65.keytab
--principal=oryx/127.22.212.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.65:37657
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.212.65
--webserver_port=45917
--tserver_master_addrs=127.22.212.126:45623
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4570
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.65
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:41:00.784651 4570 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:00.784891 4570 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:00.790136 4603 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:00.790185 4570 server_base.cc:1034] running on GCE node
W20260807 22:41:00.790282 4606 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:00.790149 4610 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:00.790542 4570 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:00.790795 4570 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:00.791966 4570 hybrid_clock.cc:648] HybridClock initialized: now 1786142460791940 us; error 42 us; skew 500 ppm
Aug 07 22:41:00 dist-test-slave-2d19 krb5kdc[3703](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142460, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.212.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:41:00.794564 4570 init.cc:377] Logged in from keytab as oryx/127.22.212.65@KRBTEST.COM (short username oryx)
I20260807 22:41:00.795035 4570 webserver.cc:460] Webserver started at http://127.22.212.65:45917/ using document root <none> and password file <none>
I20260807 22:41:00.795282 4570 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:00.795369 4570 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:00.796859 4570 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 22:41:00.797518 4619 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:00.797688 4570 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:41:00.797780 4570 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-0/wal
uuid: "0066fbd74cdb4d329f30a1e3d01c9f28"
format_stamp: "Formatted at 2026-08-07 22:41:00 on dist-test-slave-2d19"
server_key: "1d025ab807376a456f7e24332e72adf6"
server_key_iv: "86a1635b5dbd2739706b3ef289a87f99"
server_key_version: "encryptionkey@0"
I20260807 22:41:00.798095 4570 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:00.815380 4570 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:00.817836 4570 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:00.817987 4570 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:00.818249 4570 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:41:00.818588 4570 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:41:00.818643 4570 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:00.818684 4570 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:41:00.818712 4570 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:00.825290 4570 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.65:37657
I20260807 22:41:00.825361 4788 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.65:37657 every 8 connection(s)
I20260807 22:41:00.825752 4570 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
I20260807 22:41:00.831708 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 4570
I20260807 22:41:00.832046 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.66:37491
--local_ip_for_outbound_sockets=127.22.212.66
--tserver_master_addrs=127.22.212.126:45623
--webserver_port=35777
--webserver_interface=127.22.212.66
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:36857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.22.212.66
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.66.keytab with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 22:41:00 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.65@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:00 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.65@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:00.836866 4793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:00.826495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.65:46145)
0807 22:41:00.826704 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:00.826753 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:00.827367 (+ 614us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:00.828835 (+ 1468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:00.828839 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:00.829489 (+ 650us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:00.829678 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:00.829684 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:00.831299 (+ 1615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:00.831300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:00.832614 (+ 1314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:00.832618 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:00.833392 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:00.833394 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:00.833542 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:00.834197 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:00.834206 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:00.836646 (+ 2440us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":92,"threads_started":1}
W20260807 22:41:00.836915 4794 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:00.826615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:46145 (local address 127.22.212.126:45623)
0807 22:41:00.828391 (+ 1776us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:00.828401 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:00.828438 (+ 37us) server_negotiation.cc:407] Connection header received
0807 22:41:00.828565 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:00.828571 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:00.828623 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:00.828758 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:00.829808 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:00.831165 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:00.832714 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:00.833284 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:00.833397 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:00.836768 (+ 3371us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.65:46145: BlockingRecv error: recv got EOF from 127.22.212.65:46145 (error 108)
Metrics: {"server-negotiator.queue_time_us":1718,"thread_start_us":78,"threads_started":1}
W20260807 22:41:00.837116 4790 heartbeater.cc:644] Failed to heartbeat to 127.22.212.126:45623 (0 consecutive failures): Not authorized: Failed to ping master at 127.22.212.126:45623: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Aug 07 22:41:00 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.65@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:00 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.65@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:00.842222 4793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:00.837325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.65:53867)
0807 22:41:00.837376 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:00.837387 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:00.837431 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:00.837683 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:00.837684 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:00.837849 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:00.837909 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:00.837911 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:00.838516 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:00.838517 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:00.839420 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:00.839423 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:00.839763 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:00.839764 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:00.839836 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:00.840230 (+ 394us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:00.840236 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:00.842126 (+ 1890us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":34}
W20260807 22:41:00.842248 4794 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:00.837385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:53867 (local address 127.22.212.126:45623)
0807 22:41:00.837528 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:00.837547 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:00.837556 (+ 9us) server_negotiation.cc:407] Connection header received
0807 22:41:00.837581 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:00.837582 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:00.837595 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:00.837663 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:00.837989 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:00.838438 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:00.839507 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:00.839689 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:00.839738 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:00.842206 (+ 2468us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.65:53867: BlockingRecv error: recv got EOF from 127.22.212.65:53867 (error 108)
Metrics: {"server-negotiator.queue_time_us":112}
Aug 07 22:41:00 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.65@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:00 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.65@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:00.846951 4793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:00.842506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.65:60823)
0807 22:41:00.842560 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:00.842571 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:00.842610 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:00.842736 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:00.842737 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:00.842891 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:00.842927 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:00.842929 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:00.843506 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:00.843507 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:00.844405 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:00.844408 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:00.844729 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:00.844730 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:00.844795 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:00.845164 (+ 369us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:00.845170 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:00.846881 (+ 1711us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":38}
W20260807 22:41:00.847039 4794 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:00.842584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:60823 (local address 127.22.212.126:45623)
0807 22:41:00.842619 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:00.842620 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:00.842636 (+ 16us) server_negotiation.cc:407] Connection header received
0807 22:41:00.842657 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:00.842658 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:00.842666 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:00.842712 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:00.843001 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:00.843428 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:00.844485 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:00.844652 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:00.844703 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:00.846957 (+ 2254us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.65:60823: BlockingRecv error: recv got EOF from 127.22.212.65:60823 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260807 22:41:00.847074 4790 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 22:41:00.920068 4795 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:00.920318 4795 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:00.920347 4795 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:00.921438 4795 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:00.921473 4795 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:00.921497 4795 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.66
I20260807 22:41:00.922824 4795 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:36857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.66.keytab
--principal=oryx/127.22.212.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.66:37491
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.212.66
--webserver_port=35777
--tserver_master_addrs=127.22.212.126:45623
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4795
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.66
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:41:00.922998 4795 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:00.923194 4795 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:00.928697 4805 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:00.928846 4795 server_base.cc:1034] running on GCE node
W20260807 22:41:00.928697 4802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:00.928714 4808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:00.929178 4795 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:00.929380 4795 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:00.930528 4795 hybrid_clock.cc:648] HybridClock initialized: now 1786142460930499 us; error 38 us; skew 500 ppm
Aug 07 22:41:00 dist-test-slave-2d19 krb5kdc[3703](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142460, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.212.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:41:00.933185 4795 init.cc:377] Logged in from keytab as oryx/127.22.212.66@KRBTEST.COM (short username oryx)
I20260807 22:41:00.933619 4795 webserver.cc:460] Webserver started at http://127.22.212.66:35777/ using document root <none> and password file <none>
I20260807 22:41:00.933845 4795 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:00.933941 4795 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:00.935477 4795 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260807 22:41:00.936137 4822 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:00.936331 4795 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 22:41:00.936435 4795 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-1/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-1/wal
uuid: "a74cb537f7f040dea13fbc7b748c309d"
format_stamp: "Formatted at 2026-08-07 22:41:00 on dist-test-slave-2d19"
server_key: "2b1685cdc8400afaaa7bd63115bb6afc"
server_key_iv: "73d7fd4a8d71ce24ff577049a0a969db"
server_key_version: "encryptionkey@0"
I20260807 22:41:00.936810 4795 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:00.950263 4795 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:00.952174 4795 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:00.952366 4795 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:00.952646 4795 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:41:00.952971 4795 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:41:00.953027 4795 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:00.953065 4795 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:41:00.953112 4795 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:00.958783 4795 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.66:37491
I20260807 22:41:00.958843 4988 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.66:37491 every 8 connection(s)
I20260807 22:41:00.959218 4795 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
Aug 07 22:41:00 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.66@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:00 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.66@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:00.966545 4992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:00.959930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.66:40067)
0807 22:41:00.960105 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:00.960141 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:00.960679 (+ 538us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:00.960937 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:00.960941 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:00.961517 (+ 576us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:00.961705 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:00.961710 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:00.962412 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:00.962413 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:00.963223 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:00.963226 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:00.963624 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:00.963625 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:00.963746 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:00.964241 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:00.964264 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:00.966405 (+ 2141us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":72,"threads_started":1}
W20260807 22:41:00.966558 4794 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:00.959956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:40067 (local address 127.22.212.126:45623)
0807 22:41:00.960004 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:00.960006 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:00.960232 (+ 226us) server_negotiation.cc:407] Connection header received
0807 22:41:00.960792 (+ 560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:00.960794 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:00.960812 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:00.960866 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:00.961813 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:00.962313 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:00.963322 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:00.963529 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:00.963605 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:00.966505 (+ 2900us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.66:40067: BlockingRecv error: recv got EOF from 127.22.212.66:40067 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260807 22:41:00.966830 4990 heartbeater.cc:644] Failed to heartbeat to 127.22.212.126:45623 (0 consecutive failures): Not authorized: Failed to ping master at 127.22.212.126:45623: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
I20260807 22:41:00.968611 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 4795
I20260807 22:41:00.968922 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.67:45213
--local_ip_for_outbound_sockets=127.22.212.67
--tserver_master_addrs=127.22.212.126:45623
--webserver_port=39933
--webserver_interface=127.22.212.67
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:36857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.22.212.67
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.67.keytab with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 22:41:00 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.66@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:00 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.66@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:00.971202 4992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:00.967050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.66:45073)
0807 22:41:00.967100 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:00.967111 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:00.967155 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:00.967296 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:00.967297 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:00.967402 (+ 105us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:00.967444 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:00.967445 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:00.967996 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:00.967996 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:00.968557 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:00.968559 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:00.969054 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:00.969056 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:00.969142 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:00.969553 (+ 411us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:00.969557 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:00.971123 (+ 1566us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":31}
W20260807 22:41:00.971258 4794 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:00.967136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:45073 (local address 127.22.212.126:45623)
0807 22:41:00.967190 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:00.967192 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:00.967200 (+ 8us) server_negotiation.cc:407] Connection header received
0807 22:41:00.967228 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:00.967229 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:00.967236 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:00.967281 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:00.967502 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:00.967935 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:00.968634 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:00.968941 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:00.969010 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:00.971196 (+ 2186us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.66:45073: BlockingRecv error: recv got EOF from 127.22.212.66:45073 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 07 22:41:00 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.66@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:00 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.66@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:00.975544 4992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:00.971504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.66:49927)
0807 22:41:00.971560 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:00.971571 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:00.971617 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:00.971758 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:00.971759 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:00.971889 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:00.971912 (+ 23us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:00.971913 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:00.972593 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:00.972594 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:00.973075 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:00.973076 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:00.973503 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:00.973504 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:00.973558 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:00.973970 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:00.973973 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:00.975467 (+ 1494us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":40}
W20260807 22:41:00.975605 4794 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:00.971614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:49927 (local address 127.22.212.126:45623)
0807 22:41:00.971670 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:00.971672 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:00.971679 (+ 7us) server_negotiation.cc:407] Connection header received
0807 22:41:00.971700 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:00.971700 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:00.971708 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:00.971758 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:00.971985 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:00.972509 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:00.973159 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:00.973429 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:00.973505 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:00.975543 (+ 2038us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.66:49927: BlockingRecv error: recv got EOF from 127.22.212.66:49927 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
W20260807 22:41:00.975669 4990 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 22:41:01.053503 4994 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:01.053735 4994 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:01.053776 4994 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:01.054973 4994 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:01.055042 4994 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:01.055089 4994 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.67
I20260807 22:41:01.056607 4994 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:36857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/krb5kdc/oryx_127.22.212.67.keytab
--principal=oryx/127.22.212.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.67:45213
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.212.67
--webserver_port=39933
--tserver_master_addrs=127.22.212.126:45623
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4994
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.67
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:41:01.056876 4994 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:01.057103 4994 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:01.062086 5006 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:01.062088 5004 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:01.062184 5003 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:01.062412 4994 server_base.cc:1034] running on GCE node
I20260807 22:41:01.062628 4994 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:01.062861 4994 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:01.064003 4994 hybrid_clock.cc:648] HybridClock initialized: now 1786142461063986 us; error 36 us; skew 500 ppm
Aug 07 22:41:01 dist-test-slave-2d19 krb5kdc[3703](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142461, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.212.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:41:01.066717 4994 init.cc:377] Logged in from keytab as oryx/127.22.212.67@KRBTEST.COM (short username oryx)
I20260807 22:41:01.067199 4994 webserver.cc:460] Webserver started at http://127.22.212.67:39933/ using document root <none> and password file <none>
I20260807 22:41:01.067448 4994 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:01.067507 4994 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:01.068966 4994 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:41:01.069555 5016 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:01.069728 4994 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:01.069836 4994 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-2/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-2/wal
uuid: "cec623edb6254048beaa76a2413ed459"
format_stamp: "Formatted at 2026-08-07 22:41:00 on dist-test-slave-2d19"
server_key: "3216d712121f5460a020b9e3c94a00e3"
server_key_iv: "d84b73ad0e30b1dca20fc33fafa30497"
server_key_version: "encryptionkey@0"
I20260807 22:41:01.070199 4994 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:01.090380 4994 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:01.092818 4994 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:01.092991 4994 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:01.093248 4994 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:41:01.093575 4994 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:41:01.093629 4994 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:01.093665 4994 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:41:01.093693 4994 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:01.099488 4994 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.67:45213
I20260807 22:41:01.099546 5183 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.67:45213 every 8 connection(s)
I20260807 22:41:01.099880 4994 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
I20260807 22:41:01.105249 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 4994
Aug 07 22:41:01 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.67@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:01 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.67@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
W20260807 22:41:01.107538 4794 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:01.100616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:51989 (local address 127.22.212.126:45623)
0807 22:41:01.100687 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:01.100690 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:01.100944 (+ 254us) server_negotiation.cc:407] Connection header received
0807 22:41:01.101477 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:01.101479 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:01.101493 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:01.101552 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:01.102549 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:01.103045 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:01.104021 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:01.104245 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:01.104355 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:01.107466 (+ 3111us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.67:51989: BlockingRecv error: recv got EOF from 127.22.212.67:51989 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 22:41:01.107549 5189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:01.100617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.67:51989)
0807 22:41:01.100791 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:01.100828 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:01.101362 (+ 534us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:01.101626 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:01.101629 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:01.102245 (+ 616us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:01.102436 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:01.102441 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:01.103145 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:01.103147 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:01.103924 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:01.103926 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:01.104366 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:01.104368 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:01.104495 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:01.105018 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:01.105027 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:01.107403 (+ 2376us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":87,"threads_started":1}
W20260807 22:41:01.107872 5186 heartbeater.cc:644] Failed to heartbeat to 127.22.212.126:45623 (0 consecutive failures): Not authorized: Failed to ping master at 127.22.212.126:45623: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Aug 07 22:41:01 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.67@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:01 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.67@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:01.112607 5189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:01.108200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.67:44901)
0807 22:41:01.108277 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:01.108286 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:01.108332 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:01.108473 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:01.108474 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:01.108617 (+ 143us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:01.108664 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:01.108665 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:01.109497 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:01.109498 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:01.110028 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:01.110031 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:01.110367 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:01.110368 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:01.110437 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:01.110768 (+ 331us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:01.110772 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:01.112525 (+ 1753us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":36}
W20260807 22:41:01.112668 4794 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:01.108242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:44901 (local address 127.22.212.126:45623)
0807 22:41:01.108289 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:01.108291 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:01.108320 (+ 29us) server_negotiation.cc:407] Connection header received
0807 22:41:01.108394 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:01.108395 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:01.108404 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:01.108455 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:01.108769 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:01.109417 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:01.110113 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:01.110283 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:01.110366 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:01.112602 (+ 2236us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.67:44901: BlockingRecv error: recv got EOF from 127.22.212.67:44901 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
I20260807 22:41:01.113636 5192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:01.105823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60332 (local address 127.22.212.126:45623)
0807 22:41:01.105952 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:01.105954 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:01.105964 (+ 10us) server_negotiation.cc:407] Connection header received
0807 22:41:01.105986 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:01.105986 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:01.105996 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:01.106062 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:01.106790 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:01.107285 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:01.108420 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:01.108775 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:01.108834 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:01.110000 (+ 1166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:01.110006 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:01.110006 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:41:01.110018 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:01.111962 (+ 1944us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:01.112405 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:01.112409 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:01.112410 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:01.112524 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:01.112786 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:01.112787 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:01.112788 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:01.113124 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:01.113277 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:01.113385 (+ 108us) server_negotiation.cc:299] Negotiation successful
0807 22:41:01.113508 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":67,"threads_started":1}
Aug 07 22:41:01 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.67@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:01 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.67@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:01.117285 5189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:01.112918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.67:37093)
0807 22:41:01.113010 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:01.113021 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:01.113069 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:01.113209 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:01.113209 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:01.113348 (+ 139us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:01.113378 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:01.113379 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:01.114156 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:01.114157 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:01.114696 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:01.114698 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:01.115004 (+ 306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:01.115005 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:01.115246 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:01.115620 (+ 374us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:01.115624 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:01.117207 (+ 1583us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":75}
W20260807 22:41:01.117331 4794 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:01.112964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:37093 (local address 127.22.212.126:45623)
0807 22:41:01.113011 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:01.113013 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:01.113055 (+ 42us) server_negotiation.cc:407] Connection header received
0807 22:41:01.113122 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:01.113123 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:01.113130 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:01.113201 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:01.113461 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:01.114064 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:01.114758 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:01.114942 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:01.114990 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:01.117271 (+ 2281us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.67:37093: BlockingRecv error: recv got EOF from 127.22.212.67:37093 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260807 22:41:01.117448 5186 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 07 22:41:01 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.65@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:01 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.65@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:01.852629 5193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:01.847423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.65:56975)
0807 22:41:01.847613 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:01.847625 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:01.847698 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:01.847839 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:01.847840 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:01.848009 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:01.848064 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:01.848065 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:01.848756 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:01.848756 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:01.849291 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:01.849292 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:01.849639 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:01.849640 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:01.849682 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:01.850211 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:01.850215 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:01.852493 (+ 2278us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":84,"threads_started":1}
W20260807 22:41:01.852727 5194 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:01.847517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:56975 (local address 127.22.212.126:45623)
0807 22:41:01.847629 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:01.847631 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:01.847690 (+ 59us) server_negotiation.cc:407] Connection header received
0807 22:41:01.847741 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:01.847742 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:01.847751 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:01.847817 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:01.848116 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:01.848686 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:01.849370 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:01.849572 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:01.849624 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:01.852606 (+ 2982us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.65:56975: BlockingRecv error: recv got EOF from 127.22.212.65:56975 (error 108)
Metrics: {"server-negotiator.queue_time_us":83,"thread_start_us":55,"threads_started":1}
Aug 07 22:41:01 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.66@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:01 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.66@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:01.980907 5195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:01.976130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.66:37083)
0807 22:41:01.976279 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:01.976291 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:01.976400 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:01.976576 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:01.976577 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:01.976774 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:01.976823 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:01.976825 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:01.977525 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:01.977526 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:01.978088 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:01.978090 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:01.978463 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:01.978464 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:01.978514 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:01.979061 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:01.979067 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:01.980836 (+ 1769us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":75,"threads_started":1}
W20260807 22:41:01.980997 5194 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:01.976137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:37083 (local address 127.22.212.126:45623)
0807 22:41:01.976186 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:01.976189 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:01.976353 (+ 164us) server_negotiation.cc:407] Connection header received
0807 22:41:01.976471 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:01.976472 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:01.976486 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:01.976551 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:01.976924 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:01.977438 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:01.978179 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:01.978367 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:01.978445 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:01.980934 (+ 2489us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.66:37083: BlockingRecv error: recv got EOF from 127.22.212.66:37083 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
Aug 07 22:41:02 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.67@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:02 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.67@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:02.122923 5196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:02.117926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.67:34649)
0807 22:41:02.118084 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:02.118098 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:02.118172 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:02.118335 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:02.118336 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:02.118549 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:02.118599 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:02.118601 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:02.119404 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:02.119405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:02.119940 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:02.119942 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:02.120349 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:02.120350 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:02.120391 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:02.120835 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:02.120839 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:02.122858 (+ 2019us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":102,"threads_started":1}
W20260807 22:41:02.123095 5194 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:02.117993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:34649 (local address 127.22.212.126:45623)
0807 22:41:02.118050 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:02.118053 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:02.118174 (+ 121us) server_negotiation.cc:407] Connection header received
0807 22:41:02.118231 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:02.118232 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:02.118246 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:02.118325 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:02.118760 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:02.119316 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:02.120028 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:02.120212 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:02.120341 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:02.122991 (+ 2650us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.67:34649: BlockingRecv error: recv got EOF from 127.22.212.67:34649 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
Aug 07 22:41:02 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.65@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:02 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.65@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:02.858120 5201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:02.853132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.65:53825)
0807 22:41:02.853263 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:02.853277 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:02.853356 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:02.853519 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:02.853520 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:02.853688 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:02.853741 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:02.853742 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:02.854468 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:02.854470 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:02.855050 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:02.855053 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:02.855419 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:02.855420 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:02.855466 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:02.855960 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:02.855965 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:02.858059 (+ 2094us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":61,"threads_started":1}
W20260807 22:41:02.858229 5202 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:02.853215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:53825 (local address 127.22.212.126:45623)
0807 22:41:02.853392 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:02.853394 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:02.853402 (+ 8us) server_negotiation.cc:407] Connection header received
0807 22:41:02.853426 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:02.853427 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:02.853436 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:02.853497 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:02.853812 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:02.854318 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:02.855137 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:02.855330 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:02.855385 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:02.858152 (+ 2767us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.65:53825: BlockingRecv error: recv got EOF from 127.22.212.65:53825 (error 108)
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":77,"threads_started":1}
Aug 07 22:41:02 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.66@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:02 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.66@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:02.986033 5203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:02.981418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.66:43485)
0807 22:41:02.981592 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:02.981608 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:02.981668 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:02.981801 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:02.981802 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:02.981963 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:02.982026 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:02.982028 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:02.982724 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:02.982725 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:02.983264 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:02.983265 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:02.983634 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:02.983635 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:02.983676 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:02.984134 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:02.984138 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:02.985969 (+ 1831us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":120,"threads_started":1}
W20260807 22:41:02.986192 5202 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:02.981514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:43485 (local address 127.22.212.126:45623)
0807 22:41:02.981586 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:02.981588 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:02.981669 (+ 81us) server_negotiation.cc:407] Connection header received
0807 22:41:02.981730 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:02.981731 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:02.981742 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:02.981784 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:02.982124 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:02.982647 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:02.983350 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:02.983561 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:02.983628 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:02.986104 (+ 2476us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.66:43485: BlockingRecv error: recv got EOF from 127.22.212.66:43485 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 07 22:41:03 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.67@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:03 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.67@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:03.128194 5204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:03.123457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.67:54157)
0807 22:41:03.123628 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:03.123640 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:03.123695 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:03.123845 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:03.123845 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:03.124047 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:03.124111 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:03.124114 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:03.124929 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:03.124930 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:03.125481 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:03.125483 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:03.125832 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:03.125832 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:03.125872 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:03.126301 (+ 429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:03.126305 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:03.128089 (+ 1784us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":62,"threads_started":1}
W20260807 22:41:03.128271 5202 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:03.123635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:54157 (local address 127.22.212.126:45623)
0807 22:41:03.123699 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:03.123701 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:03.123712 (+ 11us) server_negotiation.cc:407] Connection header received
0807 22:41:03.123747 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:03.123748 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:03.123759 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:03.123811 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:03.124279 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:03.124854 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:03.125588 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:03.125766 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:03.125817 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:03.128180 (+ 2363us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.67:54157: BlockingRecv error: recv got EOF from 127.22.212.67:54157 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 07 22:41:03 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.65@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:03 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.65@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:03.863623 5208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:03.858760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.65:52103)
0807 22:41:03.859003 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:03.859015 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:03.859085 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:03.859208 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:03.859209 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:03.859389 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:03.859446 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:03.859447 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:03.860136 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:03.860137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:03.860736 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:03.860739 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:03.861066 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:03.861066 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:03.861107 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:03.861633 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:03.861637 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:03.863512 (+ 1875us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":86,"threads_started":1}
W20260807 22:41:03.863687 5209 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:03.858834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:52103 (local address 127.22.212.126:45623)
0807 22:41:03.859006 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:03.859008 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:03.859067 (+ 59us) server_negotiation.cc:407] Connection header received
0807 22:41:03.859133 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:03.859134 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:03.859145 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:03.859202 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:03.859511 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:03.860048 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:03.860813 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:03.861000 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:03.861054 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:03.863606 (+ 2552us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.65:52103: BlockingRecv error: recv got EOF from 127.22.212.65:52103 (error 108)
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":108,"threads_started":1}
Aug 07 22:41:03 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.66@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:03 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.66@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:03.991407 5211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:03.986591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.66:33057)
0807 22:41:03.986772 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:03.986783 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:03.986848 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:03.986986 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:03.986986 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:03.987157 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:03.987207 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:03.987208 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:03.987831 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:03.987832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:03.988611 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:03.988615 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:03.988942 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:03.988943 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:03.988984 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:03.989493 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:03.989500 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:03.991338 (+ 1838us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":116,"threads_started":1}
W20260807 22:41:03.991506 5209 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:03.986638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:33057 (local address 127.22.212.126:45623)
0807 22:41:03.986711 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:03.986714 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:03.986847 (+ 133us) server_negotiation.cc:407] Connection header received
0807 22:41:03.986898 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:03.986899 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:03.986910 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:03.986967 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:03.987269 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:03.987763 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:03.988686 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:03.988880 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:03.988934 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:03.991439 (+ 2505us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.66:33057: BlockingRecv error: recv got EOF from 127.22.212.66:33057 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 07 22:41:04 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.67@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:04 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.67@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:04.133404 5212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:04.128744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.67:55859)
0807 22:41:04.128887 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:04.128901 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:04.128961 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:04.129101 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:04.129102 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:04.129282 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:04.129330 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:04.129332 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:04.130000 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:04.130001 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:04.130536 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:04.130537 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:04.130901 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:04.130902 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:04.130966 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:04.131428 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:04.131433 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:04.133334 (+ 1901us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":91,"threads_started":1}
W20260807 22:41:04.133504 5209 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:04.128906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:55859 (local address 127.22.212.126:45623)
0807 22:41:04.128953 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:04.128955 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:04.128964 (+ 9us) server_negotiation.cc:407] Connection header received
0807 22:41:04.129017 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:04.129018 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:04.129032 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:04.129091 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:04.129414 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:04.129916 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:04.130635 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:04.130829 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:04.130902 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:04.133438 (+ 2536us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.67:55859: BlockingRecv error: recv got EOF from 127.22.212.67:55859 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
Aug 07 22:41:04 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.65@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:04 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.65@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:04.873245 5214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:04.864172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.65:59667)
0807 22:41:04.864351 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:04.864368 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:04.864421 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:04.864579 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:04.864580 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:04.864766 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:04.864815 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:04.864817 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:04.865527 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:04.865528 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:04.866064 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:04.866065 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:04.866402 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:04.866403 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:04.866441 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:04.871082 (+ 4641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:04.871089 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:04.873185 (+ 2096us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":143,"threads_started":1}
W20260807 22:41:04.873379 5216 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:04.864274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:59667 (local address 127.22.212.126:45623)
0807 22:41:04.864401 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:04.864403 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:04.864412 (+ 9us) server_negotiation.cc:407] Connection header received
0807 22:41:04.864488 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:04.864489 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:04.864500 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:04.864554 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:04.864910 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:04.865445 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:04.866143 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:04.866336 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:04.866391 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:04.873286 (+ 6895us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.65:59667: BlockingRecv error: recv got EOF from 127.22.212.65:59667 (error 108)
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":67,"threads_started":1}
Aug 07 22:41:04 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.66@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:04 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.66@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
W20260807 22:41:04.996681 5216 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:04.992056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:54629 (local address 127.22.212.126:45623)
0807 22:41:04.992129 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:04.992131 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:04.992186 (+ 55us) server_negotiation.cc:407] Connection header received
0807 22:41:04.992278 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:04.992279 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:04.992291 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:04.992336 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:04.992684 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:04.993191 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:04.993847 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:04.994053 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:04.994105 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:04.996630 (+ 2525us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.66:54629: BlockingRecv error: recv got EOF from 127.22.212.66:54629 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 22:41:04.996754 5217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:04.991904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.66:54629)
0807 22:41:04.992134 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:04.992145 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:04.992201 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:04.992378 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:04.992379 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:04.992541 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:04.992591 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:04.992593 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:04.993262 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:04.993262 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:04.993776 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:04.993777 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:04.994117 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:04.994118 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:04.994159 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:04.994622 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:04.994627 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:04.996526 (+ 1899us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":114,"threads_started":1}
Aug 07 22:41:05 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.67@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:05 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.67@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:05.138497 5218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:05.133872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.67:57857)
0807 22:41:05.134025 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:05.134045 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:05.134100 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:05.134260 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:05.134261 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:05.134416 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:05.134465 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:05.134466 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:05.135201 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:05.135202 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:05.135717 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:05.135719 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:05.136120 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:05.136120 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:05.136162 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:05.136663 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:05.136668 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:05.138439 (+ 1771us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":101,"threads_started":1}
W20260807 22:41:05.138660 5216 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:05.134047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:57857 (local address 127.22.212.126:45623)
0807 22:41:05.134124 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:05.134126 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:05.134136 (+ 10us) server_negotiation.cc:407] Connection header received
0807 22:41:05.134169 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:05.134169 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:05.134181 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:05.134248 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:05.134535 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:05.135123 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:05.135797 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:05.136047 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:05.136109 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:05.138566 (+ 2457us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.67:57857: BlockingRecv error: recv got EOF from 127.22.212.67:57857 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 07 22:41:05 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.65@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:05 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.65@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:05.879261 5221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:05.873788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.65:49639)
0807 22:41:05.873927 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:05.873941 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:05.874006 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:05.874247 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:05.874248 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:05.874467 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:05.874524 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:05.874527 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:05.875240 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:05.875241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:05.875949 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:05.875952 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:05.876365 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:05.876366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:05.876423 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:05.876992 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:05.876998 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:05.879145 (+ 2147us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":65,"threads_started":1}
W20260807 22:41:05.879295 5224 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:05.873854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:49639 (local address 127.22.212.126:45623)
0807 22:41:05.873989 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:05.873991 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:05.874001 (+ 10us) server_negotiation.cc:407] Connection header received
0807 22:41:05.874104 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:05.874105 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:05.874120 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:05.874177 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:05.874624 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:05.875144 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:05.876021 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:05.876244 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:05.876363 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:05.879240 (+ 2877us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.65:49639: BlockingRecv error: recv got EOF from 127.22.212.65:49639 (error 108)
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":73,"threads_started":1}
Aug 07 22:41:05 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.66@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:05 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.66@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:06.002564 5227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:05.997289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.66:38855)
0807 22:41:05.997441 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:05.997451 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:05.997524 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:05.997760 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:05.997761 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:05.997941 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:05.997990 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:05.997992 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:05.998665 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:05.998666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:05.999204 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:05.999206 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:05.999580 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:05.999581 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:05.999638 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:06.000179 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:06.000184 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:06.002476 (+ 2292us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":85,"threads_started":1}
W20260807 22:41:06.002605 5224 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:05.997479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:38855 (local address 127.22.212.126:45623)
0807 22:41:05.997559 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:05.997561 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:05.997581 (+ 20us) server_negotiation.cc:407] Connection header received
0807 22:41:05.997651 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:05.997652 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:05.997665 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:05.997739 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:05.998077 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:05.998581 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:05.999295 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:05.999499 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:05.999582 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:06.002557 (+ 2975us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.66:38855: BlockingRecv error: recv got EOF from 127.22.212.66:38855 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 07 22:41:06 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.67@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:06 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.67@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:06.143457 5228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:06.138977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.67:50137)
0807 22:41:06.139149 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:06.139166 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:06.139222 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:06.139370 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:06.139370 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:06.139538 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:06.139588 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:06.139589 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:06.140332 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:06.140333 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:06.140866 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:06.140868 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:06.141191 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:06.141191 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:06.141229 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:06.141666 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:06.141670 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:06.143400 (+ 1730us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":122,"threads_started":1}
W20260807 22:41:06.143666 5224 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:06.139075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:50137 (local address 127.22.212.126:45623)
0807 22:41:06.139134 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:06.139135 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:06.139221 (+ 86us) server_negotiation.cc:407] Connection header received
0807 22:41:06.139268 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:06.139268 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:06.139285 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:06.139348 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:06.139648 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:06.140213 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:06.140937 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:06.141128 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:06.141180 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:06.143590 (+ 2410us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.67:50137: BlockingRecv error: recv got EOF from 127.22.212.67:50137 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 07 22:41:06 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.65@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:06 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.65@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:06.885077 5229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:06.880006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.65:36405)
0807 22:41:06.880160 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:06.880171 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:06.880229 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:06.880436 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:06.880437 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:06.880628 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:06.880683 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:06.880685 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:06.881355 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:06.881356 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:06.881887 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:06.881888 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:06.882424 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:06.882425 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:06.882493 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:06.883051 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:06.883055 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:06.884975 (+ 1920us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":81,"threads_started":1}
W20260807 22:41:06.885144 5231 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:06.880079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:36405 (local address 127.22.212.126:45623)
0807 22:41:06.880232 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:06.880235 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:06.880322 (+ 87us) server_negotiation.cc:407] Connection header received
0807 22:41:06.880349 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:06.880350 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:06.880362 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:06.880414 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:06.880755 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:06.881286 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:06.881970 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:06.882300 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:06.882372 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:06.885070 (+ 2698us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.65:36405: BlockingRecv error: recv got EOF from 127.22.212.65:36405 (error 108)
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":89,"threads_started":1}
Aug 07 22:41:07 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.66@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:07 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.66@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:07.008728 5232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:07.003125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.66:50085)
0807 22:41:07.003293 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:07.003311 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:07.003588 (+ 277us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:07.003886 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:07.003887 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:07.004086 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:07.004139 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:07.004141 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:07.004969 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:07.004971 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:07.005543 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:07.005545 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:07.005922 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:07.005923 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:07.005976 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:07.006481 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:07.006485 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:07.008590 (+ 2105us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":97,"threads_started":1}
W20260807 22:41:07.008770 5231 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:07.003233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:50085 (local address 127.22.212.126:45623)
0807 22:41:07.003322 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:07.003327 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:07.003381 (+ 54us) server_negotiation.cc:407] Connection header received
0807 22:41:07.003760 (+ 379us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:07.003762 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:07.003780 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:07.003859 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:07.004208 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:07.004885 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:07.005626 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:07.005839 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:07.005903 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:07.008709 (+ 2806us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.66:50085: BlockingRecv error: recv got EOF from 127.22.212.66:50085 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 07 22:41:07 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.67@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:07 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.67@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:07.149183 5233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:07.144103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.67:38451)
0807 22:41:07.144245 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:07.144282 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:07.144357 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:07.144519 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:07.144520 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:07.144692 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:07.144742 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:07.144743 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:07.145591 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:07.145593 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:07.146263 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:07.146266 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:07.146614 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:07.146615 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:07.146655 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:07.147116 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:07.147120 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:07.149123 (+ 2003us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":85,"threads_started":1}
W20260807 22:41:07.149335 5231 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:07.144201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:38451 (local address 127.22.212.126:45623)
0807 22:41:07.144302 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:07.144304 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:07.144333 (+ 29us) server_negotiation.cc:407] Connection header received
0807 22:41:07.144424 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:07.144424 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:07.144438 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:07.144499 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:07.144837 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:07.145503 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:07.146333 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:07.146548 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:07.146604 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:07.149249 (+ 2645us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.67:38451: BlockingRecv error: recv got EOF from 127.22.212.67:38451 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 07 22:41:07 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.65@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:07 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.65@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:07.889986 5234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:07.885581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.65:49117)
0807 22:41:07.885738 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:07.885748 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:07.885804 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:07.885937 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:07.885938 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:07.886130 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:07.886181 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:07.886183 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:07.886806 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:07.886806 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:07.887333 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:07.887335 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:07.887656 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:07.887657 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:07.887702 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:07.888158 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:07.888163 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:07.889926 (+ 1763us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":78,"threads_started":1}
W20260807 22:41:07.890187 5236 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:07.885609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:49117 (local address 127.22.212.126:45623)
0807 22:41:07.885728 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:07.885730 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:07.885789 (+ 59us) server_negotiation.cc:407] Connection header received
0807 22:41:07.885859 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:07.885859 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:07.885870 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:07.885919 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:07.886248 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:07.886741 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:07.887405 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:07.887592 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:07.887644 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:07.890119 (+ 2475us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.65:49117: BlockingRecv error: recv got EOF from 127.22.212.65:49117 (error 108)
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":54,"threads_started":1}
Aug 07 22:41:08 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.66@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:08 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.66@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:08.013911 5237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:08.009312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.66:44701)
0807 22:41:08.009503 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:08.009515 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:08.009581 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:08.009708 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:08.009709 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:08.009878 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:08.009934 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:08.009936 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:08.010564 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:08.010565 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:08.011107 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:08.011108 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:08.011441 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:08.011442 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:08.011486 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:08.011959 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:08.011965 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:08.013851 (+ 1886us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":120,"threads_started":1}
W20260807 22:41:08.014077 5236 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:08.009360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:44701 (local address 127.22.212.126:45623)
0807 22:41:08.009441 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:08.009444 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:08.009581 (+ 137us) server_negotiation.cc:407] Connection header received
0807 22:41:08.009628 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:08.009628 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:08.009640 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:08.009688 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:08.010004 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:08.010491 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:08.011180 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:08.011362 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:08.011411 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:08.013978 (+ 2567us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.66:44701: BlockingRecv error: recv got EOF from 127.22.212.66:44701 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 07 22:41:08 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.67@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:08 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.67@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:08.154407 5238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:08.149667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.67:33261)
0807 22:41:08.149831 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:08.149844 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:08.149911 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:08.150042 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:08.150043 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:08.150211 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:08.150260 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:08.150262 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:08.150892 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:08.150893 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:08.151429 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:08.151431 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:08.151769 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:08.151770 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:08.151811 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:08.152297 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:08.152301 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:08.154348 (+ 2047us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":105,"threads_started":1}
W20260807 22:41:08.154564 5236 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:08.149751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:33261 (local address 127.22.212.126:45623)
0807 22:41:08.149826 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:08.149830 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:08.149923 (+ 93us) server_negotiation.cc:407] Connection header received
0807 22:41:08.149951 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:08.149952 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:08.149965 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:08.150021 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:08.150330 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:08.150820 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:08.151519 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:08.151700 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:08.151754 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:08.154459 (+ 2705us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.67:33261: BlockingRecv error: recv got EOF from 127.22.212.67:33261 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 07 22:41:08 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.65@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:08 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.65@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:08.895148 5241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:08.890549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.65:43313)
0807 22:41:08.890727 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:08.890738 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:08.890792 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:08.890925 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:08.890925 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:08.891097 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:08.891148 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:08.891150 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:08.891809 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:08.891810 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:08.892436 (+ 626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:08.892439 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:08.892798 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:08.892799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:08.892839 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:08.893296 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:08.893300 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:08.895088 (+ 1788us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":114,"threads_started":1}
W20260807 22:41:08.895295 5243 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:08.890661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:43313 (local address 127.22.212.126:45623)
0807 22:41:08.890771 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:08.890773 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:08.890782 (+ 9us) server_negotiation.cc:407] Connection header received
0807 22:41:08.890850 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:08.890850 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:08.890861 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:08.890910 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:08.891220 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:08.891744 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:08.892517 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:08.892732 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:08.892787 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:08.895189 (+ 2402us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.65:43313: BlockingRecv error: recv got EOF from 127.22.212.65:43313 (error 108)
Metrics: {"server-negotiator.queue_time_us":84,"thread_start_us":51,"threads_started":1}
Aug 07 22:41:09 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.66@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:09 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.66@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:09.019800 5244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:09.014497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.66:38439)
0807 22:41:09.014674 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:09.014688 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:09.014764 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:09.014941 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:09.014942 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:09.015139 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:09.015192 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:09.015194 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:09.016017 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:09.016018 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:09.016699 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:09.016702 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:09.017090 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:09.017091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:09.017137 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:09.017618 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:09.017623 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:09.019704 (+ 2081us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":119,"threads_started":1}
W20260807 22:41:09.019930 5243 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:09.014562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:38439 (local address 127.22.212.126:45623)
0807 22:41:09.014638 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:09.014641 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:09.014794 (+ 153us) server_negotiation.cc:407] Connection header received
0807 22:41:09.014825 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:09.014825 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:09.014840 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:09.014900 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:09.015272 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:09.015932 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:09.016813 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:09.017012 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:09.017080 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:09.019826 (+ 2746us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.66:38439: BlockingRecv error: recv got EOF from 127.22.212.66:38439 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 07 22:41:09 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.67@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:09 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.67@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:09.159966 5245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:09.154900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.67:49757)
0807 22:41:09.155391 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:09.155405 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:09.155486 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:09.155630 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:09.155631 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:09.155809 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:09.155862 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:09.155864 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:09.156596 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:09.156597 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:09.157205 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:09.157207 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:09.157542 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:09.157543 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:09.157585 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:09.158037 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:09.158042 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:09.159906 (+ 1864us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":76,"threads_started":1}
W20260807 22:41:09.160111 5243 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:09.154986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:49757 (local address 127.22.212.126:45623)
0807 22:41:09.155085 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:09.155087 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:09.155483 (+ 396us) server_negotiation.cc:407] Connection header received
0807 22:41:09.155547 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:09.155547 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:09.155561 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:09.155602 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:09.155929 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:09.156522 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:09.157287 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:09.157468 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:09.157525 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:09.160004 (+ 2479us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.67:49757: BlockingRecv error: recv got EOF from 127.22.212.67:49757 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 07 22:41:09 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.65@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:09 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.65@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:09.905501 5248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:09.895727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.65:36617)
0807 22:41:09.895890 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:09.895910 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:09.895987 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:09.896145 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:09.896146 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:09.896351 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:09.896425 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:09.896426 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:09.897113 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:09.897114 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:09.897661 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:09.897663 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:09.897995 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:09.897996 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:09.898045 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:09.903235 (+ 5190us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:09.903240 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:09.905410 (+ 2170us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":105,"threads_started":1}
W20260807 22:41:09.905597 5249 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:09.895798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:36617 (local address 127.22.212.126:45623)
0807 22:41:09.895926 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:09.895928 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:09.895966 (+ 38us) server_negotiation.cc:407] Connection header received
0807 22:41:09.896053 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:09.896054 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:09.896065 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:09.896117 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:09.896493 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:09.897004 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:09.897737 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:09.897924 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:09.897975 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:09.905520 (+ 7545us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.65:36617: BlockingRecv error: recv got EOF from 127.22.212.65:36617 (error 108)
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":79,"threads_started":1}
Aug 07 22:41:10 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.66@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:10 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.66@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:10.025883 5251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:10.020451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.66:39737)
0807 22:41:10.020632 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:10.020645 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:10.020723 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:10.020860 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:10.020861 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:10.021077 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:10.021126 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:10.021129 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:10.021841 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:10.021842 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:10.022412 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:10.022415 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:10.022802 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:10.022803 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:10.022864 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:10.023358 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:10.023364 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:10.025781 (+ 2417us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":101,"threads_started":1}
W20260807 22:41:10.025954 5249 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:10.020543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:39737 (local address 127.22.212.126:45623)
0807 22:41:10.020627 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:10.020629 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:10.020703 (+ 74us) server_negotiation.cc:407] Connection header received
0807 22:41:10.020787 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:10.020789 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:10.020801 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:10.020855 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:10.021223 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:10.021736 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:10.022514 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:10.022720 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:10.022802 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:10.025880 (+ 3078us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.66:39737: BlockingRecv error: recv got EOF from 127.22.212.66:39737 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 07 22:41:10 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.67@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:10 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.67@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:10.165050 5253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:10.160544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.67:52905)
0807 22:41:10.160696 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:10.160708 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:10.160780 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:10.160931 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:10.160932 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:10.161104 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:10.161155 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:10.161156 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:10.161785 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:10.161786 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:10.162340 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:10.162342 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:10.162672 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:10.162673 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:10.162712 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:10.163177 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:10.163181 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:10.164970 (+ 1789us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":94,"threads_started":1}
W20260807 22:41:10.165158 5249 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:10.160608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:52905 (local address 127.22.212.126:45623)
0807 22:41:10.160684 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:10.160686 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:10.160781 (+ 95us) server_negotiation.cc:407] Connection header received
0807 22:41:10.160849 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:10.160850 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:10.160863 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:10.160908 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:10.161222 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:10.161705 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:10.162419 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:10.162608 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:10.162658 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:10.165085 (+ 2427us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.67:52905: BlockingRecv error: recv got EOF from 127.22.212.67:52905 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 07 22:41:10 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.65@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:10 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.65@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:10.910686 5257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:10.905971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.65:56637)
0807 22:41:10.906119 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:10.906136 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:10.906222 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:10.906374 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:10.906375 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:10.906550 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:10.906601 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:10.906603 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:10.907325 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:10.907326 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:10.907858 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:10.907860 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:10.908297 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:10.908298 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:10.908418 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:10.908908 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:10.908914 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:10.910626 (+ 1712us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":64,"threads_started":1}
W20260807 22:41:10.910791 5258 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:10.906088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:56637 (local address 127.22.212.126:45623)
0807 22:41:10.906240 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:10.906242 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:10.906252 (+ 10us) server_negotiation.cc:407] Connection header received
0807 22:41:10.906275 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:10.906276 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:10.906287 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:10.906343 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:10.906667 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:10.907174 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:10.907964 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:10.908175 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:10.908232 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:10.910716 (+ 2484us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.65:56637: BlockingRecv error: recv got EOF from 127.22.212.65:56637 (error 108)
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":86,"threads_started":1}
Aug 07 22:41:11 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.66@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:11 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.66@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:11.030959 5261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:11.026430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.66:37047)
0807 22:41:11.026624 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:11.026635 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:11.026695 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:11.026843 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:11.026844 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:11.027010 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:11.027060 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:11.027062 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:11.027687 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:11.027688 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:11.028201 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:11.028202 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:11.028567 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:11.028568 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:11.028613 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:11.029065 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:11.029070 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:11.030861 (+ 1791us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":128,"threads_started":1}
W20260807 22:41:11.031008 5258 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:11.026518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:37047 (local address 127.22.212.126:45623)
0807 22:41:11.026615 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:11.026617 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:11.026682 (+ 65us) server_negotiation.cc:407] Connection header received
0807 22:41:11.026764 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:11.026764 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:11.026775 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:11.026818 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:11.027135 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:11.027620 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:11.028312 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:11.028496 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:11.028551 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:11.030941 (+ 2390us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.66:37047: BlockingRecv error: recv got EOF from 127.22.212.66:37047 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 07 22:41:11 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.67@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:11 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.67@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:11.170050 5262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:11.165537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.67:50531)
0807 22:41:11.165765 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:11.165780 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:11.165841 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:11.165972 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:11.165973 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:11.166149 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:11.166199 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:11.166201 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:11.166826 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:11.166827 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:11.167367 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:11.167369 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:11.167717 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:11.167718 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:11.167756 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:11.168203 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:11.168208 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:11.169986 (+ 1778us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":180,"threads_started":1}
W20260807 22:41:11.170178 5258 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:11.165661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:50531 (local address 127.22.212.126:45623)
0807 22:41:11.165714 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:11.165716 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:11.165845 (+ 129us) server_negotiation.cc:407] Connection header received
0807 22:41:11.165894 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:11.165895 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:11.165907 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:11.165949 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:11.166263 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:11.166751 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:11.167447 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:11.167650 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:11.167706 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:11.170096 (+ 2390us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.67:50531: BlockingRecv error: recv got EOF from 127.22.212.67:50531 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Aug 07 22:41:11 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.65@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:11 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.65@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:11.916225 5264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:11.911217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.65:52941)
0807 22:41:11.911374 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:11.911385 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:11.911435 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:11.911626 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:11.911626 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:11.911803 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:11.911854 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:11.911855 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:11.912578 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:11.912579 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:11.913105 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:11.913107 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:11.913466 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:11.913467 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:11.913516 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:11.913977 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:11.913981 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:11.916154 (+ 2173us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":91,"threads_started":1}
W20260807 22:41:11.916366 5265 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:11.911339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:52941 (local address 127.22.212.126:45623)
0807 22:41:11.911476 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:11.911478 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:11.911486 (+ 8us) server_negotiation.cc:407] Connection header received
0807 22:41:11.911510 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:11.911510 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:11.911521 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:11.911620 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:11.911937 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:11.912499 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:11.913179 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:11.913371 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:11.913423 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:11.916289 (+ 2866us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.65:52941: BlockingRecv error: recv got EOF from 127.22.212.65:52941 (error 108)
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":80,"threads_started":1}
Aug 07 22:41:12 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.66@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:12 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.66@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:12.036409 5266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:12.031487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.66:59849)
0807 22:41:12.031661 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:12.031676 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:12.031762 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:12.031938 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:12.031939 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:12.032140 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:12.032187 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:12.032189 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:12.032888 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:12.032890 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:12.033409 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:12.033411 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:12.033805 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:12.033807 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:12.033871 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:12.034411 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:12.034416 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:12.036336 (+ 1920us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":103,"threads_started":1}
W20260807 22:41:12.036470 5265 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:12.031619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:59849 (local address 127.22.212.126:45623)
0807 22:41:12.031697 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:12.031699 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:12.031751 (+ 52us) server_negotiation.cc:407] Connection header received
0807 22:41:12.031840 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:12.031842 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:12.031856 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:12.031925 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:12.032292 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:12.032802 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:12.033499 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:12.033714 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:12.033802 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:12.036422 (+ 2620us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.66:59849: BlockingRecv error: recv got EOF from 127.22.212.66:59849 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 07 22:41:12 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.67@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:12 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.67@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:12.175153 5267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:12.170581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.67:42929)
0807 22:41:12.170729 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:12.170741 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:12.170806 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:12.170921 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:12.170922 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:12.171100 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:12.171149 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:12.171151 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:12.171774 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:12.171774 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:12.172334 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:12.172336 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:12.172658 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:12.172659 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:12.172703 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:12.173303 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:12.173308 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:12.175082 (+ 1774us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":90,"threads_started":1}
W20260807 22:41:12.175223 5265 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:12.170671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:42929 (local address 127.22.212.126:45623)
0807 22:41:12.170738 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:12.170740 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:12.170804 (+ 64us) server_negotiation.cc:407] Connection header received
0807 22:41:12.170849 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:12.170850 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:12.170862 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:12.170917 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:12.171208 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:12.171699 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:12.172402 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:12.172588 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:12.172644 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:12.175174 (+ 2530us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.67:42929: BlockingRecv error: recv got EOF from 127.22.212.67:42929 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 07 22:41:12 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.65@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:12 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.65@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:12.921381 5272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:12.916816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.65:54981)
0807 22:41:12.916952 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:12.916965 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:12.917040 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:12.917179 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:12.917180 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:12.917352 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:12.917402 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:12.917403 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:12.918118 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:12.918118 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:12.918635 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:12.918636 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:12.919031 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:12.919031 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:12.919071 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:12.919564 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:12.919568 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:12.921323 (+ 1755us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":67,"threads_started":1}
W20260807 22:41:12.921499 5273 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:12.916902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:54981 (local address 127.22.212.126:45623)
0807 22:41:12.917046 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:12.917048 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:12.917059 (+ 11us) server_negotiation.cc:407] Connection header received
0807 22:41:12.917088 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:12.917088 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:12.917098 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:12.917158 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:12.917481 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:12.918045 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:12.918716 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:12.918957 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:12.919016 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:12.921417 (+ 2401us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.65:54981: BlockingRecv error: recv got EOF from 127.22.212.65:54981 (error 108)
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":70,"threads_started":1}
Aug 07 22:41:13 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.66@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:13 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.66@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:13.041706 5274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:13.036932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.66:50629)
0807 22:41:13.037095 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:13.037109 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:13.037200 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:13.037346 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:13.037347 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:13.037545 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:13.037595 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:13.037597 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:13.038290 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:13.038292 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:13.038816 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:13.038817 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:13.039255 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:13.039257 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:13.039320 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:13.039754 (+ 434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:13.039759 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:13.041607 (+ 1848us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":98,"threads_started":1}
W20260807 22:41:13.041760 5273 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:13.037063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:50629 (local address 127.22.212.126:45623)
0807 22:41:13.037111 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:13.037113 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:13.037181 (+ 68us) server_negotiation.cc:407] Connection header received
0807 22:41:13.037276 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:13.037278 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:13.037291 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:13.037342 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:13.037681 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:13.038194 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:13.038898 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:13.039172 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:13.039245 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:13.041692 (+ 2447us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.66:50629: BlockingRecv error: recv got EOF from 127.22.212.66:50629 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
Aug 07 22:41:13 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.67@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:13 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.67@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:13.180727 5275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:13.175717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.67:59731)
0807 22:41:13.175848 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:13.175866 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:13.175918 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:13.176100 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:13.176101 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:13.176311 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:13.176360 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:13.176362 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:13.177207 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:13.177208 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:13.177758 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:13.177760 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:13.178161 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:13.178162 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:13.178215 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:13.178782 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:13.178787 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:13.180666 (+ 1879us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":74,"threads_started":1}
W20260807 22:41:13.180866 5273 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:13.175794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:59731 (local address 127.22.212.126:45623)
0807 22:41:13.175960 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:13.175962 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:13.175972 (+ 10us) server_negotiation.cc:407] Connection header received
0807 22:41:13.176005 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:13.176006 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:13.176018 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:13.176078 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:13.176487 (+ 409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:13.177084 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:13.177865 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:13.178063 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:13.178125 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:13.180770 (+ 2645us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.67:59731: BlockingRecv error: recv got EOF from 127.22.212.67:59731 (error 108)
Metrics: {"server-negotiator.queue_time_us":140}
Aug 07 22:41:13 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.65@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:13 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.65@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:13.927022 5276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:13.921971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.65:51109)
0807 22:41:13.922155 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:13.922167 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:13.922231 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:13.922368 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:13.922369 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:13.922562 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:13.922612 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:13.922614 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:13.923328 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:13.923329 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:13.923894 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:13.923896 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:13.924387 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:13.924388 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:13.924435 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:13.925037 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:13.925042 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:13.926942 (+ 1900us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":118,"threads_started":1}
W20260807 22:41:13.927136 5278 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:13.922087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:51109 (local address 127.22.212.126:45623)
0807 22:41:13.922242 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:13.922244 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:13.922253 (+ 9us) server_negotiation.cc:407] Connection header received
0807 22:41:13.922282 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:13.922282 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:13.922294 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:13.922364 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:13.922713 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:13.923243 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:13.924019 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:13.924246 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:13.924383 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:13.927059 (+ 2676us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.65:51109: BlockingRecv error: recv got EOF from 127.22.212.65:51109 (error 108)
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":93,"threads_started":1}
Aug 07 22:41:14 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.66@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:14 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.66@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:14.047348 5279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:14.042232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.66:51525)
0807 22:41:14.042389 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:14.042401 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:14.042489 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:14.042652 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:14.042653 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:14.042848 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:14.042895 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:14.042897 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:14.043610 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:14.043612 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:14.044165 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:14.044167 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:14.044614 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:14.044616 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:14.044685 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:14.045378 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:14.045384 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:14.047255 (+ 1871us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":68,"threads_started":1}
W20260807 22:41:14.047451 5278 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:14.042422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:51525 (local address 127.22.212.126:45623)
0807 22:41:14.042494 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:14.042496 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:14.042525 (+ 29us) server_negotiation.cc:407] Connection header received
0807 22:41:14.042562 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:14.042567 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:14.042580 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:14.042643 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:14.042989 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:14.043504 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:14.044282 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:14.044499 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:14.044613 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:14.047379 (+ 2766us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.66:51525: BlockingRecv error: recv got EOF from 127.22.212.66:51525 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 07 22:41:14 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.67@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:14 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.67@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:14.186573 5282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:14.181280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.67:41467)
0807 22:41:14.181464 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:14.181474 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:14.181563 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:14.181739 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:14.181740 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:14.181972 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:14.182024 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:14.182026 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:14.182711 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:14.182712 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:14.183267 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:14.183269 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:14.183635 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:14.183636 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:14.183697 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:14.184231 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:14.184237 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:14.186444 (+ 2207us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":106,"threads_started":1}
W20260807 22:41:14.186939 5278 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:14.181354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:41467 (local address 127.22.212.126:45623)
0807 22:41:14.181420 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:14.181422 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:14.181543 (+ 121us) server_negotiation.cc:407] Connection header received
0807 22:41:14.181632 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:14.181634 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:14.181654 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:14.181714 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:14.182110 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:14.182621 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:14.183362 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:14.183558 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:14.183637 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:14.186854 (+ 3217us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.67:41467: BlockingRecv error: recv got EOF from 127.22.212.67:41467 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 07 22:41:14 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.65@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:14 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.65@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:14.936054 5284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:14.927502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.65:60609)
0807 22:41:14.927647 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:14.927663 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:14.927711 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:14.927838 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:14.927838 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:14.928008 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:14.928059 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:14.928061 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:14.928751 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:14.928751 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:14.929269 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:14.929271 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:14.929710 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:14.929711 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:14.929754 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:14.934070 (+ 4316us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:14.934075 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:14.935990 (+ 1915us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":89,"threads_started":1}
W20260807 22:41:14.936180 5285 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:14.927581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:60609 (local address 127.22.212.126:45623)
0807 22:41:14.927721 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:14.927724 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:14.927731 (+ 7us) server_negotiation.cc:407] Connection header received
0807 22:41:14.927753 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:14.927754 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:14.927764 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:14.927825 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:14.928124 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:14.928681 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:14.929364 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:14.929639 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:14.929697 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:14.936101 (+ 6404us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.65:60609: BlockingRecv error: recv got EOF from 127.22.212.65:60609 (error 108)
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":81,"threads_started":1}
Aug 07 22:41:15 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.66@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:15 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.66@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:15.052493 5286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:15.047919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.66:38259)
0807 22:41:15.048088 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:15.048100 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:15.048159 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:15.048310 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:15.048310 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:15.048483 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:15.048531 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:15.048532 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:15.049167 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:15.049167 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:15.049786 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:15.049789 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:15.050141 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:15.050142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:15.050184 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:15.050645 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:15.050650 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:15.052425 (+ 1775us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":92,"threads_started":1}
W20260807 22:41:15.052598 5285 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:15.047965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:38259 (local address 127.22.212.126:45623)
0807 22:41:15.048020 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:15.048023 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:15.048161 (+ 138us) server_negotiation.cc:407] Connection header received
0807 22:41:15.048217 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:15.048218 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:15.048229 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:15.048300 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:15.048592 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:15.049096 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:15.049864 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:15.050071 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:15.050128 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:15.052524 (+ 2396us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.66:38259: BlockingRecv error: recv got EOF from 127.22.212.66:38259 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
Aug 07 22:41:15 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.67@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:15 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.67@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:15.192314 5287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:15.187193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.67:60299)
0807 22:41:15.187390 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:15.187403 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:15.187481 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:15.187668 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:15.187669 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:15.187852 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:15.187899 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:15.187901 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:15.188647 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:15.188648 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:15.189392 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:15.189394 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:15.189736 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:15.189737 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:15.189783 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:15.190258 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:15.190271 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:15.192197 (+ 1926us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":128,"threads_started":1}
W20260807 22:41:15.192456 5285 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:15.187282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:60299 (local address 127.22.212.126:45623)
0807 22:41:15.187355 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:15.187357 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:15.187480 (+ 123us) server_negotiation.cc:407] Connection header received
0807 22:41:15.187533 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:15.187534 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:15.187547 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:15.187613 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:15.187973 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:15.188527 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:15.189472 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:15.189668 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:15.189724 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:15.192372 (+ 2648us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.67:60299: BlockingRecv error: recv got EOF from 127.22.212.67:60299 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 07 22:41:15 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.65@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:15 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.65@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:15.942631 5288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:15.936584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.65:45375)
0807 22:41:15.936708 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:15.936719 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:15.936778 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:15.936955 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:15.936956 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:15.937227 (+ 271us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:15.937293 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:15.937296 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:15.937976 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:15.937978 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:15.938966 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:15.938969 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:15.939497 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:15.939498 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:15.939571 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:15.940322 (+ 751us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:15.940328 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:15.942482 (+ 2154us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":62,"threads_started":1}
W20260807 22:41:15.942709 5289 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:15.936644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:45375 (local address 127.22.212.126:45623)
0807 22:41:15.936761 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:15.936763 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:15.936773 (+ 10us) server_negotiation.cc:407] Connection header received
0807 22:41:15.936842 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:15.936843 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:15.936857 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:15.936931 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:15.937388 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:15.937890 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:15.939080 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:15.939401 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:15.939479 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:15.942619 (+ 3140us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.65:45375: BlockingRecv error: recv got EOF from 127.22.212.65:45375 (error 108)
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":63,"threads_started":1}
Aug 07 22:41:16 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.66@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
Aug 07 22:41:16 dist-test-slave-2d19 krb5kdc[3703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.212.66@KRBTEST.COM for oryx/127.22.212.126@KRBTEST.COM, Server not found in Kerberos database
I20260807 22:41:16.057745 5292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:16.053035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45623 (local address 127.22.212.66:37795)
0807 22:41:16.053173 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:16.053186 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:16.053256 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:16.053392 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:16.053393 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:16.053591 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:16.053639 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:16.053641 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:16.054334 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:16.054336 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:16.054895 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:16.054897 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:16.055362 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:16.055363 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:16.055424 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:16.055858 (+ 434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:16.055862 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:16.057637 (+ 1775us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.212.126:45623: Server oryx/127.22.212.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":101,"threads_started":1}
W20260807 22:41:16.057790 5289 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:16.053102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:37795 (local address 127.22.212.126:45623)
0807 22:41:16.053191 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:16.053193 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:16.053238 (+ 45us) server_negotiation.cc:407] Connection header received
0807 22:41:16.053314 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:16.053315 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:16.053325 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:16.053373 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:16.053707 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:16.054221 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:16.055008 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:16.055276 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:16.055361 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:16.057725 (+ 2364us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.212.66:37795: BlockingRecv error: recv got EOF from 127.22.212.66:37795 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 22:41:16.106045 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 4570
I20260807 22:41:16.123070 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 4795
I20260807 22:41:16.136905 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 4994
I20260807 22:41:16.148137 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 4467
2026-08-07T22:41:16Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17793 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-07T22:41:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:41:16Z Disabled control of system clock
I20260807 22:41:16.187497 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:36639
--webserver_interface=127.22.212.126
--webserver_port=0
--builtin_ntp_servers=127.22.212.84:46061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:36639
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260807 22:41:16.271301 5297 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:16.271503 5297 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:16.271524 5297 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:16.272773 5297 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:41:16.272814 5297 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:16.272827 5297 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:16.272840 5297 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:41:16.272852 5297 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:41:16.274155 5297 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:46061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:36639
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:36639
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5297
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:41:16.274346 5297 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:16.274576 5297 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:16.279695 5311 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:16.279733 5306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:16.279726 5305 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:16.280095 5297 server_base.cc:1034] running on GCE node
I20260807 22:41:16.280390 5297 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:16.280710 5297 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:16.281878 5297 hybrid_clock.cc:648] HybridClock initialized: now 1786142476281860 us; error 28 us; skew 500 ppm
I20260807 22:41:16.283100 5297 webserver.cc:460] Webserver started at http://127.22.212.126:40643/ using document root <none> and password file <none>
I20260807 22:41:16.283347 5297 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:16.283418 5297 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:16.283710 5297 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:41:16.284937 5297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "8eef0a7059854bf7ab7218b88809a8b6"
format_stamp: "Formatted at 2026-08-07 22:41:16 on dist-test-slave-2d19"
server_key: "e8a0812a0a8e7e0fc0696d7a6056a8eb"
server_key_iv: "b3d0584ed04ecc04840742dc9df9a698"
server_key_version: "encryptionkey@0"
I20260807 22:41:16.285336 5297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "8eef0a7059854bf7ab7218b88809a8b6"
format_stamp: "Formatted at 2026-08-07 22:41:16 on dist-test-slave-2d19"
server_key: "e8a0812a0a8e7e0fc0696d7a6056a8eb"
server_key_iv: "b3d0584ed04ecc04840742dc9df9a698"
server_key_version: "encryptionkey@0"
I20260807 22:41:16.286787 5297 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 22:41:16.287619 5319 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:16.287834 5297 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:41:16.287945 5297 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "8eef0a7059854bf7ab7218b88809a8b6"
format_stamp: "Formatted at 2026-08-07 22:41:16 on dist-test-slave-2d19"
server_key: "e8a0812a0a8e7e0fc0696d7a6056a8eb"
server_key_iv: "b3d0584ed04ecc04840742dc9df9a698"
server_key_version: "encryptionkey@0"
I20260807 22:41:16.288069 5297 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:16.297238 5297 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:16.297539 5297 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:16.297686 5297 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:16.301568 5297 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:36639
I20260807 22:41:16.301613 5417 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:36639 every 8 connection(s)
I20260807 22:41:16.301970 5297 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:41:16.302151 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 5297
I20260807 22:41:16.302256 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:41:16.302484 23377 external_mini_cluster.cc:1428] Setting key c28aab0020a45425ea4347504a7c82c1
I20260807 22:41:16.302810 5418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:41:16.306454 5418 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8eef0a7059854bf7ab7218b88809a8b6: Bootstrap starting.
I20260807 22:41:16.307188 5418 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8eef0a7059854bf7ab7218b88809a8b6: Neither blocks nor log segments found. Creating new log.
I20260807 22:41:16.307512 5418 log.cc:824] T 00000000000000000000000000000000 P 8eef0a7059854bf7ab7218b88809a8b6: Log is configured to *not* fsync() on all Append() calls
I20260807 22:41:16.308365 5418 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8eef0a7059854bf7ab7218b88809a8b6: No bootstrap required, opened a new log
I20260807 22:41:16.308673 5421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:16.303376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59892 (local address 127.22.212.126:36639)
0807 22:41:16.303575 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:16.303582 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:16.303608 (+ 26us) server_negotiation.cc:407] Connection header received
0807 22:41:16.304061 (+ 453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:16.304068 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:16.304130 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:16.304243 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:16.304538 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:16.305421 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:16.306566 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:16.306992 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:16.307090 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:16.307841 (+ 751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:16.307845 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:16.307846 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:41:16.308051 (+ 205us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:16.308097 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:41:16.308109 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:16.308164 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:16.308326 (+ 162us) server_negotiation.cc:299] Negotiation successful
0807 22:41:16.308431 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":70,"threads_started":1}
I20260807 22:41:16.310312 5418 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8eef0a7059854bf7ab7218b88809a8b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eef0a7059854bf7ab7218b88809a8b6" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36639 } }
I20260807 22:41:16.310480 5418 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8eef0a7059854bf7ab7218b88809a8b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:41:16.310534 5418 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8eef0a7059854bf7ab7218b88809a8b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8eef0a7059854bf7ab7218b88809a8b6, State: Initialized, Role: FOLLOWER
I20260807 22:41:16.310680 5418 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8eef0a7059854bf7ab7218b88809a8b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eef0a7059854bf7ab7218b88809a8b6" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36639 } }
I20260807 22:41:16.310765 5418 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8eef0a7059854bf7ab7218b88809a8b6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:41:16.310808 5418 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8eef0a7059854bf7ab7218b88809a8b6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:41:16.310858 5418 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8eef0a7059854bf7ab7218b88809a8b6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:41:16.311427 5418 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8eef0a7059854bf7ab7218b88809a8b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eef0a7059854bf7ab7218b88809a8b6" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36639 } }
I20260807 22:41:16.311550 5418 leader_election.cc:302] T 00000000000000000000000000000000 P 8eef0a7059854bf7ab7218b88809a8b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8eef0a7059854bf7ab7218b88809a8b6; no voters:
I20260807 22:41:16.311729 5418 leader_election.cc:288] T 00000000000000000000000000000000 P 8eef0a7059854bf7ab7218b88809a8b6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:41:16.311769 5423 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8eef0a7059854bf7ab7218b88809a8b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:41:16.311990 5423 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8eef0a7059854bf7ab7218b88809a8b6 [term 1 LEADER]: Becoming Leader. State: Replica: 8eef0a7059854bf7ab7218b88809a8b6, State: Running, Role: LEADER
I20260807 22:41:16.312031 5418 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8eef0a7059854bf7ab7218b88809a8b6 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:41:16.312088 5423 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8eef0a7059854bf7ab7218b88809a8b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eef0a7059854bf7ab7218b88809a8b6" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36639 } }
I20260807 22:41:16.312520 5425 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8eef0a7059854bf7ab7218b88809a8b6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8eef0a7059854bf7ab7218b88809a8b6. Latest consensus state: current_term: 1 leader_uuid: "8eef0a7059854bf7ab7218b88809a8b6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eef0a7059854bf7ab7218b88809a8b6" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36639 } } }
I20260807 22:41:16.312547 5424 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8eef0a7059854bf7ab7218b88809a8b6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8eef0a7059854bf7ab7218b88809a8b6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eef0a7059854bf7ab7218b88809a8b6" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36639 } } }
I20260807 22:41:16.312708 5425 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8eef0a7059854bf7ab7218b88809a8b6 [sys.catalog]: This master's current role is: LEADER
I20260807 22:41:16.312728 5424 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8eef0a7059854bf7ab7218b88809a8b6 [sys.catalog]: This master's current role is: LEADER
I20260807 22:41:16.313090 5435 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:41:16.313576 5435 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:41:16.315187 5435 catalog_manager.cc:1347] Generated new cluster ID: 09849d7792f349fb8172c2b878d85f22
I20260807 22:41:16.315248 5435 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:41:16.324285 5435 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:41:16.324842 5435 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:41:16.328289 5435 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8eef0a7059854bf7ab7218b88809a8b6: Generated new TSK 0
I20260807 22:41:16.328473 5435 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:41:16.330554 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.65:0
--local_ip_for_outbound_sockets=127.22.212.65
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:36639
--builtin_ntp_servers=127.22.212.84:46061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260807 22:41:16.439208 5447 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:16.439507 5447 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:16.439546 5447 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:16.440799 5447 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:16.440857 5447 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:16.440897 5447 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.65
I20260807 22:41:16.442262 5447 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:46061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:36639
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5447
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.65
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:41:16.442541 5447 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:16.442848 5447 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:16.449195 5458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:16.449195 5455 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:16.449209 5454 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:16.449698 5447 server_base.cc:1034] running on GCE node
I20260807 22:41:16.449957 5447 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:16.450207 5447 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:16.451371 5447 hybrid_clock.cc:648] HybridClock initialized: now 1786142476451357 us; error 33 us; skew 500 ppm
I20260807 22:41:16.452756 5447 webserver.cc:460] Webserver started at http://127.22.212.65:46563/ using document root <none> and password file <none>
I20260807 22:41:16.453001 5447 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:16.453070 5447 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:16.453218 5447 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:41:16.454516 5447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/data/instance:
uuid: "389bc0ee0db34bbabda29ae785dfec77"
format_stamp: "Formatted at 2026-08-07 22:41:16 on dist-test-slave-2d19"
server_key: "e655b086895daacbbf4936fe3a0269ac"
server_key_iv: "1fb6d88feb420934279d5331bc32c191"
server_key_version: "encryptionkey@0"
I20260807 22:41:16.454906 5447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance:
uuid: "389bc0ee0db34bbabda29ae785dfec77"
format_stamp: "Formatted at 2026-08-07 22:41:16 on dist-test-slave-2d19"
server_key: "e655b086895daacbbf4936fe3a0269ac"
server_key_iv: "1fb6d88feb420934279d5331bc32c191"
server_key_version: "encryptionkey@0"
I20260807 22:41:16.456369 5447 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260807 22:41:16.457206 5467 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:16.457378 5447 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:41:16.457489 5447 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/wal
uuid: "389bc0ee0db34bbabda29ae785dfec77"
format_stamp: "Formatted at 2026-08-07 22:41:16 on dist-test-slave-2d19"
server_key: "e655b086895daacbbf4936fe3a0269ac"
server_key_iv: "1fb6d88feb420934279d5331bc32c191"
server_key_version: "encryptionkey@0"
I20260807 22:41:16.457594 5447 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:16.471256 5447 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:16.471609 5447 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:16.471779 5447 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:16.472059 5447 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:41:16.472497 5447 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:41:16.472554 5447 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:16.472589 5447 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:41:16.472633 5447 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:16.478404 5447 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.65:37547
I20260807 22:41:16.478524 5656 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.65:37547 every 8 connection(s)
I20260807 22:41:16.478847 5447 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
I20260807 22:41:16.480139 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 5447
I20260807 22:41:16.480252 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance
I20260807 22:41:16.480460 23377 external_mini_cluster.cc:1428] Setting key cc7f9aaca37780e195631cd410284386
I20260807 22:41:16.481500 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.66:0
--local_ip_for_outbound_sockets=127.22.212.66
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:36639
--builtin_ntp_servers=127.22.212.84:46061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260807 22:41:16.484629 5421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:16.479601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:44517 (local address 127.22.212.126:36639)
0807 22:41:16.479668 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:16.479670 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:16.479926 (+ 256us) server_negotiation.cc:407] Connection header received
0807 22:41:16.480564 (+ 638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:16.480566 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:16.480582 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:16.480636 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:16.481449 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:16.482059 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:16.483085 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:16.483300 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:16.483383 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:16.484312 (+ 929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:16.484313 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:16.484313 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:41:16.484318 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:16.484334 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:41:16.484337 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:16.484403 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:16.484503 (+ 100us) server_negotiation.cc:299] Negotiation successful
0807 22:41:16.484541 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 22:41:16.484858 5660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:16.479602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:36639 (local address 127.22.212.65:44517)
0807 22:41:16.479798 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:16.479831 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:16.480436 (+ 605us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:16.480715 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:16.480719 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:16.480728 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:16.481359 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:16.481365 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:16.482167 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:16.482172 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:16.482958 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:16.482960 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:16.483406 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:16.483407 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:16.483545 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:16.484137 (+ 592us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:41:16.484138 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:16.484167 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:41:16.484191 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:41:16.484406 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:41:16.484414 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:41:16.484417 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:41:16.484507 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 22:41:16.484615 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":84,"threads_started":1}
I20260807 22:41:16.485384 5658 heartbeater.cc:347] Connected to a master server at 127.22.212.126:36639
I20260807 22:41:16.485493 5658 heartbeater.cc:464] Registering TS with master...
I20260807 22:41:16.485699 5658 heartbeater.cc:511] Master 127.22.212.126:36639 requested a full tablet report, sending...
I20260807 22:41:16.486265 5344 ts_manager.cc:194] Registered new tserver with Master: 389bc0ee0db34bbabda29ae785dfec77 (127.22.212.65:37547)
I20260807 22:41:16.487309 5344 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.212.65:44517
W20260807 22:41:16.565572 5663 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:16.565794 5663 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:16.565816 5663 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:16.566988 5663 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:16.567031 5663 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:16.567058 5663 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.66
I20260807 22:41:16.568363 5663 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:46061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:36639
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5663
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.66
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:41:16.568554 5663 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:16.568805 5663 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:16.573920 5678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:16.573930 5675 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:16.573938 5673 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:16.574194 5663 server_base.cc:1034] running on GCE node
I20260807 22:41:16.574430 5663 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:16.574707 5663 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:16.575872 5663 hybrid_clock.cc:648] HybridClock initialized: now 1786142476575862 us; error 27 us; skew 500 ppm
I20260807 22:41:16.577174 5663 webserver.cc:460] Webserver started at http://127.22.212.66:38241/ using document root <none> and password file <none>
I20260807 22:41:16.577422 5663 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:16.577522 5663 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:16.577663 5663 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:41:16.578833 5663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/data/instance:
uuid: "a4d8ed9ac38145aca4f9c96f1dee3573"
format_stamp: "Formatted at 2026-08-07 22:41:16 on dist-test-slave-2d19"
server_key: "db8259c19f0aedbee3f2c38d07a9929f"
server_key_iv: "964525e07c6c5cc2baf2f0ad3fbf87d9"
server_key_version: "encryptionkey@0"
I20260807 22:41:16.579205 5663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance:
uuid: "a4d8ed9ac38145aca4f9c96f1dee3573"
format_stamp: "Formatted at 2026-08-07 22:41:16 on dist-test-slave-2d19"
server_key: "db8259c19f0aedbee3f2c38d07a9929f"
server_key_iv: "964525e07c6c5cc2baf2f0ad3fbf87d9"
server_key_version: "encryptionkey@0"
I20260807 22:41:16.580688 5663 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260807 22:41:16.581404 5687 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:16.581578 5663 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 22:41:16.581699 5663 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/wal
uuid: "a4d8ed9ac38145aca4f9c96f1dee3573"
format_stamp: "Formatted at 2026-08-07 22:41:16 on dist-test-slave-2d19"
server_key: "db8259c19f0aedbee3f2c38d07a9929f"
server_key_iv: "964525e07c6c5cc2baf2f0ad3fbf87d9"
server_key_version: "encryptionkey@0"
I20260807 22:41:16.581781 5663 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:16.601760 5663 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:16.602098 5663 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:16.602258 5663 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:16.602507 5663 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:41:16.602859 5663 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:41:16.602916 5663 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:16.602952 5663 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:41:16.602982 5663 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:16.608920 5663 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.66:33063
I20260807 22:41:16.608973 5872 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.66:33063 every 8 connection(s)
I20260807 22:41:16.609316 5663 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
I20260807 22:41:16.615018 5421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:16.610003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:37725 (local address 127.22.212.126:36639)
0807 22:41:16.610056 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:16.610059 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:16.610269 (+ 210us) server_negotiation.cc:407] Connection header received
0807 22:41:16.610849 (+ 580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:16.610850 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:16.610864 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:16.610930 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:16.611776 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:16.612321 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:16.613501 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:16.613709 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:16.613790 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:16.614726 (+ 936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:16.614728 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:16.614728 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:41:16.614733 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:16.614749 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:41:16.614753 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:16.614807 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:16.614908 (+ 101us) server_negotiation.cc:299] Negotiation successful
0807 22:41:16.614936 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 22:41:16.615253 5875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:16.609963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:36639 (local address 127.22.212.66:37725)
0807 22:41:16.610146 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:16.610181 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:16.610730 (+ 549us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:16.611010 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:16.611014 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:16.611030 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:16.611672 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:16.611679 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:16.612445 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:16.612447 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:16.613406 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:16.613409 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:16.613799 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:16.613800 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:16.613961 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:16.614577 (+ 616us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:41:16.614577 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:16.614607 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:41:16.614631 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:41:16.614814 (+ 183us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:41:16.614819 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:41:16.614821 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 22:41:16.614907 (+ 86us) client_negotiation.cc:240] Negotiation successful
0807 22:41:16.615015 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":72,"threads_started":1}
I20260807 22:41:16.615770 5873 heartbeater.cc:347] Connected to a master server at 127.22.212.126:36639
I20260807 22:41:16.615867 5873 heartbeater.cc:464] Registering TS with master...
I20260807 22:41:16.616019 5873 heartbeater.cc:511] Master 127.22.212.126:36639 requested a full tablet report, sending...
I20260807 22:41:16.616487 5344 ts_manager.cc:194] Registered new tserver with Master: a4d8ed9ac38145aca4f9c96f1dee3573 (127.22.212.66:33063)
I20260807 22:41:16.616840 5344 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.212.66:37725
I20260807 22:41:16.618093 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 5663
I20260807 22:41:16.618162 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance
I20260807 22:41:16.618312 23377 external_mini_cluster.cc:1428] Setting key f1a873ebb520c794c9d8e9a72d83b8b5
I20260807 22:41:16.619272 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.67:0
--local_ip_for_outbound_sockets=127.22.212.67
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:36639
--builtin_ntp_servers=127.22.212.84:46061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260807 22:41:16.703585 5876 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:16.703788 5876 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:16.703810 5876 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:16.704909 5876 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:16.704942 5876 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:16.704967 5876 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.67
I20260807 22:41:16.706212 5876 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:46061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:36639
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5876
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.67
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:41:16.706389 5876 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:16.706643 5876 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:16.711916 5890 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:16.711910 5891 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:16.711941 5876 server_base.cc:1034] running on GCE node
W20260807 22:41:16.711910 5893 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:16.712395 5876 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:16.712611 5876 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:16.713775 5876 hybrid_clock.cc:648] HybridClock initialized: now 1786142476713753 us; error 54 us; skew 500 ppm
I20260807 22:41:16.715128 5876 webserver.cc:460] Webserver started at http://127.22.212.67:45013/ using document root <none> and password file <none>
I20260807 22:41:16.715392 5876 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:16.715467 5876 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:16.715626 5876 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:41:16.716779 5876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/data/instance:
uuid: "9ed2b9b60ac341aca8db87c71b9190af"
format_stamp: "Formatted at 2026-08-07 22:41:16 on dist-test-slave-2d19"
server_key: "c57cc5a8efae924005bb272b3d6cbd6c"
server_key_iv: "526a06f4447f6e63007a848c74ec025a"
server_key_version: "encryptionkey@0"
I20260807 22:41:16.717149 5876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance:
uuid: "9ed2b9b60ac341aca8db87c71b9190af"
format_stamp: "Formatted at 2026-08-07 22:41:16 on dist-test-slave-2d19"
server_key: "c57cc5a8efae924005bb272b3d6cbd6c"
server_key_iv: "526a06f4447f6e63007a848c74ec025a"
server_key_version: "encryptionkey@0"
I20260807 22:41:16.718482 5876 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260807 22:41:16.719228 5908 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:16.719388 5876 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 22:41:16.719496 5876 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/wal
uuid: "9ed2b9b60ac341aca8db87c71b9190af"
format_stamp: "Formatted at 2026-08-07 22:41:16 on dist-test-slave-2d19"
server_key: "c57cc5a8efae924005bb272b3d6cbd6c"
server_key_iv: "526a06f4447f6e63007a848c74ec025a"
server_key_version: "encryptionkey@0"
I20260807 22:41:16.719573 5876 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:16.736716 5876 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:16.737021 5876 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:16.737179 5876 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:16.737416 5876 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:41:16.737749 5876 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:41:16.737803 5876 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:16.737847 5876 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:41:16.737871 5876 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:16.743592 5876 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.67:33895
I20260807 22:41:16.743634 6101 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.67:33895 every 8 connection(s)
I20260807 22:41:16.744006 5876 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
I20260807 22:41:16.745290 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 5876
I20260807 22:41:16.745385 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance
I20260807 22:41:16.745599 23377 external_mini_cluster.cc:1428] Setting key ef56ef82c584b86a2f910d0117469746
I20260807 22:41:16.750108 5421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:16.744863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:50295 (local address 127.22.212.126:36639)
0807 22:41:16.744922 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:16.744924 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:16.745154 (+ 230us) server_negotiation.cc:407] Connection header received
0807 22:41:16.745966 (+ 812us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:16.745967 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:16.745977 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:16.746026 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:16.746948 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:16.747439 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:16.748776 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:16.748959 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:16.749018 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:16.749841 (+ 823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:16.749842 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:16.749843 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:41:16.749847 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:16.749860 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:41:16.749863 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:16.749908 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:16.750022 (+ 114us) server_negotiation.cc:299] Negotiation successful
0807 22:41:16.750047 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260807 22:41:16.750360 6106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:16.744819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:36639 (local address 127.22.212.67:50295)
0807 22:41:16.745022 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:16.745063 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:16.745781 (+ 718us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:16.746144 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:16.746148 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:16.746156 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:16.746864 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:16.746870 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:16.747702 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:16.747703 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:16.748695 (+ 992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:16.748698 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:16.749065 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:16.749066 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:16.749185 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:16.749708 (+ 523us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:41:16.749709 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:16.749738 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:41:16.749761 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:41:16.749919 (+ 158us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:41:16.749923 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:41:16.749926 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:41:16.750013 (+ 87us) client_negotiation.cc:240] Negotiation successful
0807 22:41:16.750096 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":95,"threads_started":1}
I20260807 22:41:16.750901 6102 heartbeater.cc:347] Connected to a master server at 127.22.212.126:36639
I20260807 22:41:16.751010 6102 heartbeater.cc:464] Registering TS with master...
I20260807 22:41:16.751204 6102 heartbeater.cc:511] Master 127.22.212.126:36639 requested a full tablet report, sending...
I20260807 22:41:16.751609 5344 ts_manager.cc:194] Registered new tserver with Master: 9ed2b9b60ac341aca8db87c71b9190af (127.22.212.67:33895)
I20260807 22:41:16.751965 5344 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.212.67:50295
I20260807 22:41:16.757616 23377 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 22:41:16.759555 5421 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:16.759019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59908 (local address 127.22.212.126:36639)
0807 22:41:16.759070 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:16.759072 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:16.759245 (+ 173us) server_negotiation.cc:407] Connection header received
0807 22:41:16.759269 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:16.759270 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:16.759279 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:16.759331 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:16.759480 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59908: BlockingRecv error: recv got EOF from 127.0.0.1:59908 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 22:41:16.759593 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 5447
I20260807 22:41:16.771929 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 5663
I20260807 22:41:16.784588 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 5876
I20260807 22:41:16.794603 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 5297
2026-08-07T22:41:16Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (642 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-07T22:41:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:41:16Z Disabled control of system clock
I20260807 22:41:16.829733 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:36559
--webserver_interface=127.22.212.126
--webserver_port=0
--builtin_ntp_servers=127.22.212.84:36569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:36559
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260807 22:41:16.912957 6118 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:16.913200 6118 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:16.913223 6118 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:16.914330 6118 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:41:16.914368 6118 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:16.914381 6118 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:16.914393 6118 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:41:16.914405 6118 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:41:16.915692 6118 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:36569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:36559
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:36559
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6118
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:41:16.915897 6118 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:16.916144 6118 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:16.921231 6127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:16.921231 6133 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:16.921243 6131 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:16.921464 6118 server_base.cc:1034] running on GCE node
I20260807 22:41:16.921795 6118 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:16.922132 6118 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:16.923290 6118 hybrid_clock.cc:648] HybridClock initialized: now 1786142476923260 us; error 40 us; skew 500 ppm
I20260807 22:41:16.924697 6118 webserver.cc:460] Webserver started at http://127.22.212.126:45873/ using document root <none> and password file <none>
I20260807 22:41:16.924952 6118 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:16.925025 6118 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:16.925190 6118 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:41:16.926281 6118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "c4f50c37a4164d27998cfd6190d96090"
format_stamp: "Formatted at 2026-08-07 22:41:16 on dist-test-slave-2d19"
server_key: "876fd33f7ef22ea3e21358be6b985c4d"
server_key_iv: "d30570dc704bc4dcc3dc43b5cbee8514"
server_key_version: "encryptionkey@0"
I20260807 22:41:16.926661 6118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "c4f50c37a4164d27998cfd6190d96090"
format_stamp: "Formatted at 2026-08-07 22:41:16 on dist-test-slave-2d19"
server_key: "876fd33f7ef22ea3e21358be6b985c4d"
server_key_iv: "d30570dc704bc4dcc3dc43b5cbee8514"
server_key_version: "encryptionkey@0"
I20260807 22:41:16.927983 6118 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 22:41:16.928823 6143 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:16.929010 6118 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:16.929131 6118 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "c4f50c37a4164d27998cfd6190d96090"
format_stamp: "Formatted at 2026-08-07 22:41:16 on dist-test-slave-2d19"
server_key: "876fd33f7ef22ea3e21358be6b985c4d"
server_key_iv: "d30570dc704bc4dcc3dc43b5cbee8514"
server_key_version: "encryptionkey@0"
I20260807 22:41:16.929220 6118 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:16.932612 6118 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:16.932898 6118 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:16.933056 6118 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:16.937178 6118 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:36559
I20260807 22:41:16.937249 6227 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:36559 every 8 connection(s)
I20260807 22:41:16.937569 6118 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:41:16.938306 6228 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:41:16.941373 6228 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c4f50c37a4164d27998cfd6190d96090: Bootstrap starting.
I20260807 22:41:16.941951 6228 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c4f50c37a4164d27998cfd6190d96090: Neither blocks nor log segments found. Creating new log.
I20260807 22:41:16.942214 6228 log.cc:824] T 00000000000000000000000000000000 P c4f50c37a4164d27998cfd6190d96090: Log is configured to *not* fsync() on all Append() calls
I20260807 22:41:16.942896 6228 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c4f50c37a4164d27998cfd6190d96090: No bootstrap required, opened a new log
I20260807 22:41:16.944625 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 6118
I20260807 22:41:16.944743 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:41:16.944964 23377 external_mini_cluster.cc:1428] Setting key ad45f91554d80489c839729441b27667
I20260807 22:41:16.945003 6228 raft_consensus.cc:348] T 00000000000000000000000000000000 P c4f50c37a4164d27998cfd6190d96090 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4f50c37a4164d27998cfd6190d96090" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36559 } }
I20260807 22:41:16.945205 6228 raft_consensus.cc:374] T 00000000000000000000000000000000 P c4f50c37a4164d27998cfd6190d96090 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:41:16.945284 6228 raft_consensus.cc:729] T 00000000000000000000000000000000 P c4f50c37a4164d27998cfd6190d96090 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4f50c37a4164d27998cfd6190d96090, State: Initialized, Role: FOLLOWER
I20260807 22:41:16.945447 6228 consensus_queue.cc:260] T 00000000000000000000000000000000 P c4f50c37a4164d27998cfd6190d96090 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4f50c37a4164d27998cfd6190d96090" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36559 } }
I20260807 22:41:16.945549 6228 raft_consensus.cc:388] T 00000000000000000000000000000000 P c4f50c37a4164d27998cfd6190d96090 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:41:16.945586 6228 raft_consensus.cc:482] T 00000000000000000000000000000000 P c4f50c37a4164d27998cfd6190d96090 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:41:16.945647 6228 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c4f50c37a4164d27998cfd6190d96090 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:41:16.946456 6228 raft_consensus.cc:504] T 00000000000000000000000000000000 P c4f50c37a4164d27998cfd6190d96090 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4f50c37a4164d27998cfd6190d96090" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36559 } }
I20260807 22:41:16.946586 6228 leader_election.cc:302] T 00000000000000000000000000000000 P c4f50c37a4164d27998cfd6190d96090 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c4f50c37a4164d27998cfd6190d96090; no voters:
I20260807 22:41:16.946755 6228 leader_election.cc:288] T 00000000000000000000000000000000 P c4f50c37a4164d27998cfd6190d96090 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:41:16.946810 6237 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c4f50c37a4164d27998cfd6190d96090 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:41:16.946941 6237 raft_consensus.cc:686] T 00000000000000000000000000000000 P c4f50c37a4164d27998cfd6190d96090 [term 1 LEADER]: Becoming Leader. State: Replica: c4f50c37a4164d27998cfd6190d96090, State: Running, Role: LEADER
I20260807 22:41:16.947034 6237 consensus_queue.cc:237] T 00000000000000000000000000000000 P c4f50c37a4164d27998cfd6190d96090 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4f50c37a4164d27998cfd6190d96090" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36559 } }
I20260807 22:41:16.947091 6228 sys_catalog.cc:564] T 00000000000000000000000000000000 P c4f50c37a4164d27998cfd6190d96090 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:41:16.947417 6237 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4f50c37a4164d27998cfd6190d96090 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c4f50c37a4164d27998cfd6190d96090. Latest consensus state: current_term: 1 leader_uuid: "c4f50c37a4164d27998cfd6190d96090" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4f50c37a4164d27998cfd6190d96090" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36559 } } }
I20260807 22:41:16.947506 6237 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4f50c37a4164d27998cfd6190d96090 [sys.catalog]: This master's current role is: LEADER
I20260807 22:41:16.947755 6236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:16.945571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33480 (local address 127.22.212.126:36559)
0807 22:41:16.945849 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:16.945859 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:16.945916 (+ 57us) server_negotiation.cc:407] Connection header received
0807 22:41:16.946055 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:16.946063 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:16.946113 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:16.946285 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:16.947157 (+ 872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:16.947160 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:16.947161 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:41:16.947165 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:16.947219 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:41:16.947231 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:16.947313 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:16.947400 (+ 87us) server_negotiation.cc:299] Negotiation successful
0807 22:41:16.947472 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":101,"threads_started":1}
I20260807 22:41:16.947583 6238 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4f50c37a4164d27998cfd6190d96090 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c4f50c37a4164d27998cfd6190d96090" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4f50c37a4164d27998cfd6190d96090" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36559 } } }
I20260807 22:41:16.948215 6238 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4f50c37a4164d27998cfd6190d96090 [sys.catalog]: This master's current role is: LEADER
I20260807 22:41:16.948800 6242 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:41:16.949329 6242 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:41:16.950875 6242 catalog_manager.cc:1347] Generated new cluster ID: 9acf577f4cd64c83ac58b371f6b1c802
I20260807 22:41:16.950934 6242 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:41:16.956363 6242 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:41:16.956526 6242 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:41:16.965622 6242 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c4f50c37a4164d27998cfd6190d96090: Generated new TSK 0
I20260807 22:41:16.965822 6242 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:41:16.973259 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.65:0
--local_ip_for_outbound_sockets=127.22.212.65
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:36559
--builtin_ntp_servers=127.22.212.84:36569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260807 22:41:17.061261 6269 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:17.061512 6269 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:17.061553 6269 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:17.062757 6269 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:17.062825 6269 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:17.062870 6269 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.65
I20260807 22:41:17.064244 6269 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:36569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:36559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6269
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.65
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:41:17.064560 6269 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:17.064865 6269 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:17.069991 6280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:17.070000 6282 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:17.070004 6277 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:17.070535 6269 server_base.cc:1034] running on GCE node
I20260807 22:41:17.070763 6269 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:17.071031 6269 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:17.072213 6269 hybrid_clock.cc:648] HybridClock initialized: now 1786142477072190 us; error 37 us; skew 500 ppm
I20260807 22:41:17.073756 6269 webserver.cc:460] Webserver started at http://127.22.212.65:45469/ using document root <none> and password file <none>
I20260807 22:41:17.074050 6269 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:17.074124 6269 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:17.074270 6269 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:41:17.075791 6269 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/data/instance:
uuid: "dd7364eecc4d48138c5fae6a5dcf30f6"
format_stamp: "Formatted at 2026-08-07 22:41:17 on dist-test-slave-2d19"
server_key: "2ed1caedcd689e209ecad483803e53e6"
server_key_iv: "891eec222137ba497dd2c4e8122aed06"
server_key_version: "encryptionkey@0"
I20260807 22:41:17.076242 6269 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance:
uuid: "dd7364eecc4d48138c5fae6a5dcf30f6"
format_stamp: "Formatted at 2026-08-07 22:41:17 on dist-test-slave-2d19"
server_key: "2ed1caedcd689e209ecad483803e53e6"
server_key_iv: "891eec222137ba497dd2c4e8122aed06"
server_key_version: "encryptionkey@0"
I20260807 22:41:17.078199 6269 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.001s
I20260807 22:41:17.079324 6294 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:17.079543 6269 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:41:17.079638 6269 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/wal
uuid: "dd7364eecc4d48138c5fae6a5dcf30f6"
format_stamp: "Formatted at 2026-08-07 22:41:17 on dist-test-slave-2d19"
server_key: "2ed1caedcd689e209ecad483803e53e6"
server_key_iv: "891eec222137ba497dd2c4e8122aed06"
server_key_version: "encryptionkey@0"
I20260807 22:41:17.079715 6269 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:17.083051 6269 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:17.083319 6269 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:17.083459 6269 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:17.083669 6269 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:41:17.083985 6269 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:41:17.084020 6269 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:17.084041 6269 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:41:17.084085 6269 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:17.090288 6269 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.65:40697
I20260807 22:41:17.090333 6480 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.65:40697 every 8 connection(s)
I20260807 22:41:17.090700 6269 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
I20260807 22:41:17.094257 6236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:17.091514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:57061 (local address 127.22.212.126:36559)
0807 22:41:17.091561 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:17.091564 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:17.091826 (+ 262us) server_negotiation.cc:407] Connection header received
0807 22:41:17.092500 (+ 674us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:17.092501 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:17.092509 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:17.092573 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:17.093888 (+ 1315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:17.093890 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:17.093891 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:41:17.093896 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:17.093980 (+ 84us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:41:17.093986 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:17.094066 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:17.094160 (+ 94us) server_negotiation.cc:299] Negotiation successful
0807 22:41:17.094179 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 22:41:17.094492 6483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:17.091495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:36559 (local address 127.22.212.65:57061)
0807 22:41:17.091681 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:17.091717 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:17.092374 (+ 657us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:17.092659 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:17.092664 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:17.092675 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:17.093709 (+ 1034us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:41:17.093709 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:17.093741 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:41:17.093775 (+ 34us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:41:17.094066 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:41:17.094075 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:41:17.094079 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 22:41:17.094161 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 22:41:17.094233 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":73,"threads_started":1}
I20260807 22:41:17.095148 6481 heartbeater.cc:347] Connected to a master server at 127.22.212.126:36559
I20260807 22:41:17.095273 6481 heartbeater.cc:464] Registering TS with master...
I20260807 22:41:17.095466 6481 heartbeater.cc:511] Master 127.22.212.126:36559 requested a full tablet report, sending...
I20260807 22:41:17.096012 6171 ts_manager.cc:194] Registered new tserver with Master: dd7364eecc4d48138c5fae6a5dcf30f6 (127.22.212.65:40697)
I20260807 22:41:17.099669 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 6269
I20260807 22:41:17.099751 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance
I20260807 22:41:17.099906 23377 external_mini_cluster.cc:1428] Setting key 04fbe0c7e742b40ab4e0fea9aa1479cc
I20260807 22:41:17.100860 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.66:0
--local_ip_for_outbound_sockets=127.22.212.66
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:36559
--builtin_ntp_servers=127.22.212.84:36569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260807 22:41:17.186570 6487 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:17.186811 6487 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:17.186848 6487 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:17.188051 6487 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:17.188117 6487 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:17.188159 6487 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.66
I20260807 22:41:17.189670 6487 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:36569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:36559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6487
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.66
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:41:17.189976 6487 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:17.190301 6487 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:17.195813 6504 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:17.195835 6500 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:17.196133 6487 server_base.cc:1034] running on GCE node
W20260807 22:41:17.195813 6498 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:17.196436 6487 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:17.196725 6487 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:17.197937 6487 hybrid_clock.cc:648] HybridClock initialized: now 1786142477197891 us; error 55 us; skew 500 ppm
I20260807 22:41:17.199285 6487 webserver.cc:460] Webserver started at http://127.22.212.66:45261/ using document root <none> and password file <none>
I20260807 22:41:17.199581 6487 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:17.199656 6487 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:17.199816 6487 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:41:17.200980 6487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/data/instance:
uuid: "1392286d6b0d46e79d4dc5ff8141f57c"
format_stamp: "Formatted at 2026-08-07 22:41:17 on dist-test-slave-2d19"
server_key: "ebfdef4a1810537946549c024930ea7c"
server_key_iv: "4ff840b5bde65f004f84f623da51b09a"
server_key_version: "encryptionkey@0"
I20260807 22:41:17.201355 6487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance:
uuid: "1392286d6b0d46e79d4dc5ff8141f57c"
format_stamp: "Formatted at 2026-08-07 22:41:17 on dist-test-slave-2d19"
server_key: "ebfdef4a1810537946549c024930ea7c"
server_key_iv: "4ff840b5bde65f004f84f623da51b09a"
server_key_version: "encryptionkey@0"
I20260807 22:41:17.202744 6487 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 22:41:17.203510 6517 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:17.203689 6487 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 22:41:17.203801 6487 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/wal
uuid: "1392286d6b0d46e79d4dc5ff8141f57c"
format_stamp: "Formatted at 2026-08-07 22:41:17 on dist-test-slave-2d19"
server_key: "ebfdef4a1810537946549c024930ea7c"
server_key_iv: "4ff840b5bde65f004f84f623da51b09a"
server_key_version: "encryptionkey@0"
I20260807 22:41:17.203886 6487 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:17.207345 6487 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:17.207628 6487 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:17.207778 6487 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:17.207995 6487 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:41:17.208379 6487 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:41:17.208442 6487 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:17.208477 6487 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:41:17.208505 6487 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:17.214316 6487 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.66:44793
I20260807 22:41:17.214354 6714 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.66:44793 every 8 connection(s)
I20260807 22:41:17.214694 6487 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
I20260807 22:41:17.216482 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 6487
I20260807 22:41:17.216598 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance
I20260807 22:41:17.216807 23377 external_mini_cluster.cc:1428] Setting key c1d7c560323a79536c7eb628631ac056
I20260807 22:41:17.217854 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.67:0
--local_ip_for_outbound_sockets=127.22.212.67
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:36559
--builtin_ntp_servers=127.22.212.84:36569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260807 22:41:17.218145 6236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:17.215455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:53659 (local address 127.22.212.126:36559)
0807 22:41:17.215547 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:17.215550 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:17.215772 (+ 222us) server_negotiation.cc:407] Connection header received
0807 22:41:17.216405 (+ 633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:17.216406 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:17.216413 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:17.216472 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:17.217772 (+ 1300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:17.217773 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:17.217773 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:41:17.217777 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:17.217793 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:41:17.217803 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:17.217850 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:17.218071 (+ 221us) server_negotiation.cc:299] Negotiation successful
0807 22:41:17.218086 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 22:41:17.218253 6717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:17.215404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:36559 (local address 127.22.212.66:53659)
0807 22:41:17.215626 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:17.215672 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:17.216245 (+ 573us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:17.216544 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:17.216548 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:17.216559 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:17.217610 (+ 1051us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:41:17.217610 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:17.217648 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:41:17.217686 (+ 38us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:41:17.217853 (+ 167us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:41:17.217858 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:41:17.217861 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:41:17.217940 (+ 79us) client_negotiation.cc:240] Negotiation successful
0807 22:41:17.218008 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":93,"threads_started":1}
I20260807 22:41:17.218708 6715 heartbeater.cc:347] Connected to a master server at 127.22.212.126:36559
I20260807 22:41:17.218813 6715 heartbeater.cc:464] Registering TS with master...
I20260807 22:41:17.218967 6715 heartbeater.cc:511] Master 127.22.212.126:36559 requested a full tablet report, sending...
I20260807 22:41:17.219350 6171 ts_manager.cc:194] Registered new tserver with Master: 1392286d6b0d46e79d4dc5ff8141f57c (127.22.212.66:44793)
W20260807 22:41:17.304899 6718 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:17.305110 6718 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:17.305133 6718 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:17.306313 6718 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:17.306416 6718 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:17.306484 6718 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.67
I20260807 22:41:17.308010 6718 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:36569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:36559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6718
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.67
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:41:17.308395 6718 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:17.308768 6718 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:17.314116 6724 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:17.314155 6725 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:17.314142 6729 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:17.314196 6718 server_base.cc:1034] running on GCE node
I20260807 22:41:17.314492 6718 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:17.314705 6718 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:17.315840 6718 hybrid_clock.cc:648] HybridClock initialized: now 1786142477315819 us; error 38 us; skew 500 ppm
I20260807 22:41:17.317118 6718 webserver.cc:460] Webserver started at http://127.22.212.67:42025/ using document root <none> and password file <none>
I20260807 22:41:17.317309 6718 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:17.317349 6718 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:17.317437 6718 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:41:17.318454 6718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/data/instance:
uuid: "fe0fe82e2c734e91b9d6afec24b14a76"
format_stamp: "Formatted at 2026-08-07 22:41:17 on dist-test-slave-2d19"
server_key: "44d3f1630f826d89010599fc8d1309f9"
server_key_iv: "a6b3f861ef0e7f469ed4fe75242327a7"
server_key_version: "encryptionkey@0"
I20260807 22:41:17.318754 6718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance:
uuid: "fe0fe82e2c734e91b9d6afec24b14a76"
format_stamp: "Formatted at 2026-08-07 22:41:17 on dist-test-slave-2d19"
server_key: "44d3f1630f826d89010599fc8d1309f9"
server_key_iv: "a6b3f861ef0e7f469ed4fe75242327a7"
server_key_version: "encryptionkey@0"
I20260807 22:41:17.320124 6718 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 22:41:17.320955 6738 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:17.321138 6718 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:41:17.321240 6718 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/wal
uuid: "fe0fe82e2c734e91b9d6afec24b14a76"
format_stamp: "Formatted at 2026-08-07 22:41:17 on dist-test-slave-2d19"
server_key: "44d3f1630f826d89010599fc8d1309f9"
server_key_iv: "a6b3f861ef0e7f469ed4fe75242327a7"
server_key_version: "encryptionkey@0"
I20260807 22:41:17.321327 6718 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:17.324774 6718 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:17.325042 6718 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:17.325177 6718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:17.325383 6718 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:41:17.325691 6718 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:41:17.325745 6718 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:17.325785 6718 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:41:17.325814 6718 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:17.331617 6718 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.67:33031
I20260807 22:41:17.331660 6929 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.67:33031 every 8 connection(s)
I20260807 22:41:17.332036 6718 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
I20260807 22:41:17.333643 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 6718
I20260807 22:41:17.333752 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance
I20260807 22:41:17.333976 23377 external_mini_cluster.cc:1428] Setting key 6ef9db4925a847a32b2fb3d6a73923d3
I20260807 22:41:17.335547 6236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:17.332760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:57253 (local address 127.22.212.126:36559)
0807 22:41:17.332826 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:17.332829 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:17.333202 (+ 373us) server_negotiation.cc:407] Connection header received
0807 22:41:17.333798 (+ 596us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:17.333800 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:17.333808 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:17.333841 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:17.335368 (+ 1527us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:17.335369 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:17.335369 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:41:17.335372 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:17.335386 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:41:17.335390 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:17.335432 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:17.335481 (+ 49us) server_negotiation.cc:299] Negotiation successful
0807 22:41:17.335493 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260807 22:41:17.335733 6934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:17.332787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:36559 (local address 127.22.212.67:57253)
0807 22:41:17.333077 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:17.333109 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:17.333654 (+ 545us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:17.334053 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:17.334057 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:17.334068 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:17.335232 (+ 1164us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:41:17.335232 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:17.335261 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:41:17.335288 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:41:17.335434 (+ 146us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:41:17.335436 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:41:17.335438 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 22:41:17.335489 (+ 51us) client_negotiation.cc:240] Negotiation successful
0807 22:41:17.335538 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":172,"threads_started":1}
I20260807 22:41:17.336133 6930 heartbeater.cc:347] Connected to a master server at 127.22.212.126:36559
I20260807 22:41:17.336238 6930 heartbeater.cc:464] Registering TS with master...
I20260807 22:41:17.336408 6930 heartbeater.cc:511] Master 127.22.212.126:36559 requested a full tablet report, sending...
I20260807 22:41:17.336759 6171 ts_manager.cc:194] Registered new tserver with Master: fe0fe82e2c734e91b9d6afec24b14a76 (127.22.212.67:33031)
I20260807 22:41:17.345992 23377 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 22:41:17.348346 6236 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:41:17.347617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33490 (local address 127.22.212.126:36559)
0807 22:41:17.347733 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:17.347735 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:17.347866 (+ 131us) server_negotiation.cc:407] Connection header received
0807 22:41:17.347965 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:17.347966 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:17.347972 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:17.348058 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:17.348203 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33490: BlockingRecv error: recv got EOF from 127.0.0.1:33490 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
I20260807 22:41:17.348394 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 6269
I20260807 22:41:17.365288 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 6487
I20260807 22:41:17.384915 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 6718
I20260807 22:41:17.409139 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 6118
2026-08-07T22:41:17Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (611 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:41:17 dist-test-slave-2d19 krb5kdc[6945](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:41:17 dist-test-slave-2d19 krb5kdc[6945](info): set up 2 sockets
Aug 07 22:41:17 dist-test-slave-2d19 krb5kdc[6945](info): commencing operation
krb5kdc: starting...
W20260807 22:41:18.682240 23377 mini_kdc.cc:121] Time spent starting KDC: real 1.250s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Aug 07 22:41:18 dist-test-slave-2d19 krb5kdc[6945](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142478, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:41:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:41:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.212.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
I20260807 22:41:18.815409 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:46365
--webserver_interface=127.22.212.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:42493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:46365
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:41:18.899029 6969 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:18.899277 6969 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:18.899315 6969 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:18.900467 6969 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:41:18.900540 6969 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:18.900563 6969 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:18.900583 6969 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:41:18.900615 6969 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:41:18.902101 6969 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:42493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:46365
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:46365
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6969
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:41:18.902388 6969 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:18.902631 6969 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:18.907608 6977 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:18.907617 6978 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:18.907649 6984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:18.907841 6969 server_base.cc:1034] running on GCE node
I20260807 22:41:18.908185 6969 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:18.908514 6969 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:18.909673 6969 hybrid_clock.cc:648] HybridClock initialized: now 1786142478909654 us; error 43 us; skew 500 ppm
Aug 07 22:41:18 dist-test-slave-2d19 krb5kdc[6945](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142478, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:41:18.912415 6969 init.cc:377] Logged in from keytab as kudu/127.22.212.126@KRBTEST.COM (short username kudu)
I20260807 22:41:18.912880 6969 webserver.cc:460] Webserver started at http://127.22.212.126:46297/ using document root <none> and password file <none>
I20260807 22:41:18.913100 6969 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:18.913143 6969 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:18.913234 6969 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:41:18.914259 6969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "f85cae80cdf94983a81270313a0da85b"
format_stamp: "Formatted at 2026-08-07 22:41:18 on dist-test-slave-2d19"
server_key: "507f0f37112cfeb904a3583157ac895c"
server_key_iv: "4b32ccca6d23d8a699f71a139b89558a"
server_key_version: "encryptionkey@0"
I20260807 22:41:18.914578 6969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "f85cae80cdf94983a81270313a0da85b"
format_stamp: "Formatted at 2026-08-07 22:41:18 on dist-test-slave-2d19"
server_key: "507f0f37112cfeb904a3583157ac895c"
server_key_iv: "4b32ccca6d23d8a699f71a139b89558a"
server_key_version: "encryptionkey@0"
I20260807 22:41:18.915869 6969 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 22:41:18.916682 6991 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:18.916903 6969 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260807 22:41:18.917065 6969 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "f85cae80cdf94983a81270313a0da85b"
format_stamp: "Formatted at 2026-08-07 22:41:18 on dist-test-slave-2d19"
server_key: "507f0f37112cfeb904a3583157ac895c"
server_key_iv: "4b32ccca6d23d8a699f71a139b89558a"
server_key_version: "encryptionkey@0"
I20260807 22:41:18.917156 6969 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:18.935323 6969 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:18.937531 6969 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:18.937698 6969 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:18.941969 6969 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:46365
I20260807 22:41:18.942005 7071 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:46365 every 8 connection(s)
I20260807 22:41:18.942389 6969 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:41:18.943392 7072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:41:18.945859 7072 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f85cae80cdf94983a81270313a0da85b: Bootstrap starting.
I20260807 22:41:18.946470 7072 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f85cae80cdf94983a81270313a0da85b: Neither blocks nor log segments found. Creating new log.
I20260807 22:41:18.946771 7072 log.cc:824] T 00000000000000000000000000000000 P f85cae80cdf94983a81270313a0da85b: Log is configured to *not* fsync() on all Append() calls
I20260807 22:41:18.947594 7072 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f85cae80cdf94983a81270313a0da85b: No bootstrap required, opened a new log
I20260807 22:41:18.949312 7072 raft_consensus.cc:348] T 00000000000000000000000000000000 P f85cae80cdf94983a81270313a0da85b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f85cae80cdf94983a81270313a0da85b" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 46365 } }
I20260807 22:41:18.949460 7072 raft_consensus.cc:374] T 00000000000000000000000000000000 P f85cae80cdf94983a81270313a0da85b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:41:18.949482 7072 raft_consensus.cc:729] T 00000000000000000000000000000000 P f85cae80cdf94983a81270313a0da85b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f85cae80cdf94983a81270313a0da85b, State: Initialized, Role: FOLLOWER
I20260807 22:41:18.949640 7072 consensus_queue.cc:260] T 00000000000000000000000000000000 P f85cae80cdf94983a81270313a0da85b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f85cae80cdf94983a81270313a0da85b" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 46365 } }
I20260807 22:41:18.949723 7072 raft_consensus.cc:388] T 00000000000000000000000000000000 P f85cae80cdf94983a81270313a0da85b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:41:18.949746 7072 raft_consensus.cc:482] T 00000000000000000000000000000000 P f85cae80cdf94983a81270313a0da85b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:41:18.949815 7072 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f85cae80cdf94983a81270313a0da85b [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:41:18.950678 7072 raft_consensus.cc:504] T 00000000000000000000000000000000 P f85cae80cdf94983a81270313a0da85b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f85cae80cdf94983a81270313a0da85b" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 46365 } }
I20260807 22:41:18.950774 7072 leader_election.cc:302] T 00000000000000000000000000000000 P f85cae80cdf94983a81270313a0da85b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f85cae80cdf94983a81270313a0da85b; no voters:
I20260807 22:41:18.950953 7072 leader_election.cc:288] T 00000000000000000000000000000000 P f85cae80cdf94983a81270313a0da85b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:41:18.951041 7075 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f85cae80cdf94983a81270313a0da85b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:41:18.951172 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 6969
I20260807 22:41:18.951212 7075 raft_consensus.cc:686] T 00000000000000000000000000000000 P f85cae80cdf94983a81270313a0da85b [term 1 LEADER]: Becoming Leader. State: Replica: f85cae80cdf94983a81270313a0da85b, State: Running, Role: LEADER
I20260807 22:41:18.951275 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:41:18.951272 7072 sys_catalog.cc:564] T 00000000000000000000000000000000 P f85cae80cdf94983a81270313a0da85b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:41:18.951293 7075 consensus_queue.cc:237] T 00000000000000000000000000000000 P f85cae80cdf94983a81270313a0da85b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f85cae80cdf94983a81270313a0da85b" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 46365 } }
I20260807 22:41:18.951494 23377 external_mini_cluster.cc:1428] Setting key 7a55251d3b06d4932e89721b7d86a376
I20260807 22:41:18.951594 7076 sys_catalog.cc:455] T 00000000000000000000000000000000 P f85cae80cdf94983a81270313a0da85b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f85cae80cdf94983a81270313a0da85b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f85cae80cdf94983a81270313a0da85b" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 46365 } } }
I20260807 22:41:18.951669 7076 sys_catalog.cc:458] T 00000000000000000000000000000000 P f85cae80cdf94983a81270313a0da85b [sys.catalog]: This master's current role is: LEADER
I20260807 22:41:18.951834 7080 sys_catalog.cc:455] T 00000000000000000000000000000000 P f85cae80cdf94983a81270313a0da85b [sys.catalog]: SysCatalogTable state changed. Reason: New leader f85cae80cdf94983a81270313a0da85b. Latest consensus state: current_term: 1 leader_uuid: "f85cae80cdf94983a81270313a0da85b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f85cae80cdf94983a81270313a0da85b" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 46365 } } }
I20260807 22:41:18.951946 7080 sys_catalog.cc:458] T 00000000000000000000000000000000 P f85cae80cdf94983a81270313a0da85b [sys.catalog]: This master's current role is: LEADER
I20260807 22:41:18.952093 7086 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:41:18.952698 7086 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:41:18.954452 7086 catalog_manager.cc:1347] Generated new cluster ID: e5b829c09e744fb7bf8a9436947876b4
I20260807 22:41:18.954514 7086 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 22:41:18 dist-test-slave-2d19 krb5kdc[6945](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142478, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:41:18.964010 7102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:18.952395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59278 (local address 127.22.212.126:46365)
0807 22:41:18.952799 (+ 404us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:18.952811 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:18.952848 (+ 37us) server_negotiation.cc:407] Connection header received
0807 22:41:18.952985 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:18.952994 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:18.953216 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:18.953370 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:18.954098 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:18.955487 (+ 1389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:18.956524 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:18.957176 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:18.957306 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:18.960334 (+ 3028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:18.960339 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:18.960340 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:41:18.960352 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:18.962334 (+ 1982us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:18.962761 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:18.962764 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:18.962765 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:18.962884 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:18.963103 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:18.963104 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:18.963104 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:18.963398 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:18.963550 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:18.963656 (+ 106us) server_negotiation.cc:299] Negotiation successful
0807 22:41:18.963790 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":346,"thread_start_us":81,"threads_started":1}
I20260807 22:41:18.966327 7086 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:41:18.967023 7086 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:41:18.975018 7086 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f85cae80cdf94983a81270313a0da85b: Generated new TSK 0
I20260807 22:41:18.975206 7086 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.212.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab.
Entry for principal kudu/127.22.212.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab.
I20260807 22:41:19.008116 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.65:0
--local_ip_for_outbound_sockets=127.22.212.65
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:46365
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:42493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:41:19.092000 7120 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:19.092211 7120 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:19.092236 7120 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:19.093499 7120 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:19.093562 7120 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:19.093591 7120 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.65
I20260807 22:41:19.095052 7120 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:42493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:46365
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7120
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.65
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:41:19.095306 7120 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:19.095554 7120 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:19.100844 7129 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:19.100817 7131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:19.100836 7128 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:19.101186 7120 server_base.cc:1034] running on GCE node
I20260807 22:41:19.101377 7120 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:19.101627 7120 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:19.102800 7120 hybrid_clock.cc:648] HybridClock initialized: now 1786142479102777 us; error 58 us; skew 500 ppm
Aug 07 22:41:19 dist-test-slave-2d19 krb5kdc[6945](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142479, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:41:19.105551 7120 init.cc:377] Logged in from keytab as kudu/127.22.212.65@KRBTEST.COM (short username kudu)
I20260807 22:41:19.105921 7120 webserver.cc:460] Webserver started at http://127.22.212.65:34419/ using document root <none> and password file <none>
I20260807 22:41:19.106101 7120 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:19.106142 7120 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:19.106232 7120 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:41:19.107237 7120 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/data/instance:
uuid: "98650c2c93114122ba52f7a5ba4443ce"
format_stamp: "Formatted at 2026-08-07 22:41:19 on dist-test-slave-2d19"
server_key: "f71115aa9eeee97888fbc5c1d7616ecf"
server_key_iv: "d7f4b7f18e3e010244c883e70c6e534f"
server_key_version: "encryptionkey@0"
I20260807 22:41:19.107540 7120 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance:
uuid: "98650c2c93114122ba52f7a5ba4443ce"
format_stamp: "Formatted at 2026-08-07 22:41:19 on dist-test-slave-2d19"
server_key: "f71115aa9eeee97888fbc5c1d7616ecf"
server_key_iv: "d7f4b7f18e3e010244c883e70c6e534f"
server_key_version: "encryptionkey@0"
I20260807 22:41:19.108915 7120 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 22:41:19.109709 7142 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:19.109915 7120 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:41:19.110013 7120 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/wal
uuid: "98650c2c93114122ba52f7a5ba4443ce"
format_stamp: "Formatted at 2026-08-07 22:41:19 on dist-test-slave-2d19"
server_key: "f71115aa9eeee97888fbc5c1d7616ecf"
server_key_iv: "d7f4b7f18e3e010244c883e70c6e534f"
server_key_version: "encryptionkey@0"
I20260807 22:41:19.110101 7120 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:19.145464 7120 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:19.147544 7120 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:19.147698 7120 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:19.147971 7120 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:41:19.148355 7120 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:41:19.148394 7120 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:19.148418 7120 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:41:19.148463 7120 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:19.154605 7120 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.65:40075
I20260807 22:41:19.154711 7339 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.65:40075 every 8 connection(s)
I20260807 22:41:19.155019 7120 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
Aug 07 22:41:19 dist-test-slave-2d19 krb5kdc[6945](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142479, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:41:19.164426 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 7120
I20260807 22:41:19.164533 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance
I20260807 22:41:19.164750 23377 external_mini_cluster.cc:1428] Setting key dd3b3f80b4c4c352a2d1efebfd4b44e5
I20260807 22:41:19.165089 7102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:19.155785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:47883 (local address 127.22.212.126:46365)
0807 22:41:19.155859 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:19.155861 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:19.156067 (+ 206us) server_negotiation.cc:407] Connection header received
0807 22:41:19.156677 (+ 610us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:19.156679 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:19.156694 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:19.156747 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:19.157713 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:19.158235 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:19.159258 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:19.159468 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:19.159548 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:19.161843 (+ 2295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:19.161845 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:19.161846 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:41:19.161852 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:19.163535 (+ 1683us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:19.163903 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:19.163904 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:19.163904 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:19.163973 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:19.164212 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:19.164213 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:19.164213 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:19.164384 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:19.164440 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:19.164789 (+ 349us) server_negotiation.cc:299] Negotiation successful
0807 22:41:19.164930 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 22:41:19.165182 7345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:19.155757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:46365 (local address 127.22.212.65:47883)
0807 22:41:19.155945 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:19.155989 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:19.156569 (+ 580us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:19.156818 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:19.156822 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:19.157410 (+ 588us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:19.157608 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:19.157613 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:19.158342 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:19.158343 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:19.159162 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:19.159165 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:19.159562 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:19.159563 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:19.159736 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:19.160244 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:19.160294 (+ 50us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:19.161749 (+ 1455us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:41:19.163618 (+ 1869us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:41:19.163623 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:41:19.163625 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:41:19.163835 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:41:19.164038 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:41:19.164038 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:41:19.164038 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:41:19.164135 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:41:19.164452 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:41:19.164459 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:41:19.164636 (+ 177us) client_negotiation.cc:769] Sending connection context
0807 22:41:19.164762 (+ 126us) client_negotiation.cc:240] Negotiation successful
0807 22:41:19.164942 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":108,"threads_started":1}
I20260807 22:41:19.165710 7341 heartbeater.cc:347] Connected to a master server at 127.22.212.126:46365
I20260807 22:41:19.165824 7341 heartbeater.cc:464] Registering TS with master...
I20260807 22:41:19.166003 7341 heartbeater.cc:511] Master 127.22.212.126:46365 requested a full tablet report, sending...
I20260807 22:41:19.166633 7016 ts_manager.cc:194] Registered new tserver with Master: 98650c2c93114122ba52f7a5ba4443ce (127.22.212.65:40075)
I20260807 22:41:19.167567 7016 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.65@KRBTEST.COM'} at 127.22.212.65:47883
WARNING: no policy specified for kudu/127.22.212.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab.
Entry for principal kudu/127.22.212.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab.
I20260807 22:41:19.191516 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.66:0
--local_ip_for_outbound_sockets=127.22.212.66
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:46365
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:42493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:41:19.278252 7352 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:19.278456 7352 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:19.278479 7352 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:19.279630 7352 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:19.279673 7352 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:19.279699 7352 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.66
I20260807 22:41:19.281172 7352 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:42493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:46365
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7352
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.66
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:41:19.281428 7352 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:19.281658 7352 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:19.287214 7369 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:19.287272 7365 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:19.287214 7367 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:19.287513 7352 server_base.cc:1034] running on GCE node
I20260807 22:41:19.287732 7352 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:19.287993 7352 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:19.289187 7352 hybrid_clock.cc:648] HybridClock initialized: now 1786142479289146 us; error 57 us; skew 500 ppm
Aug 07 22:41:19 dist-test-slave-2d19 krb5kdc[6945](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142479, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:41:19.291950 7352 init.cc:377] Logged in from keytab as kudu/127.22.212.66@KRBTEST.COM (short username kudu)
I20260807 22:41:19.292459 7352 webserver.cc:460] Webserver started at http://127.22.212.66:37943/ using document root <none> and password file <none>
I20260807 22:41:19.292670 7352 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:19.292711 7352 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:19.292801 7352 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:41:19.293834 7352 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/data/instance:
uuid: "89e2a91b70034062acb484173e8a6dfe"
format_stamp: "Formatted at 2026-08-07 22:41:19 on dist-test-slave-2d19"
server_key: "b40611d4e31803145311b9c43ae3aad9"
server_key_iv: "c68ff2cbe480192b4b2a285bf07a279e"
server_key_version: "encryptionkey@0"
I20260807 22:41:19.294179 7352 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance:
uuid: "89e2a91b70034062acb484173e8a6dfe"
format_stamp: "Formatted at 2026-08-07 22:41:19 on dist-test-slave-2d19"
server_key: "b40611d4e31803145311b9c43ae3aad9"
server_key_iv: "c68ff2cbe480192b4b2a285bf07a279e"
server_key_version: "encryptionkey@0"
I20260807 22:41:19.295539 7352 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 22:41:19.296242 7379 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:19.296614 7352 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 22:41:19.296718 7352 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/wal
uuid: "89e2a91b70034062acb484173e8a6dfe"
format_stamp: "Formatted at 2026-08-07 22:41:19 on dist-test-slave-2d19"
server_key: "b40611d4e31803145311b9c43ae3aad9"
server_key_iv: "c68ff2cbe480192b4b2a285bf07a279e"
server_key_version: "encryptionkey@0"
I20260807 22:41:19.296813 7352 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:19.330058 7352 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:19.332234 7352 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:19.332461 7352 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:19.332734 7352 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:41:19.333084 7352 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:41:19.333158 7352 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:19.333201 7352 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:41:19.333230 7352 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:19.339210 7352 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.66:45835
I20260807 22:41:19.339255 7585 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.66:45835 every 8 connection(s)
I20260807 22:41:19.339638 7352 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
Aug 07 22:41:19 dist-test-slave-2d19 krb5kdc[6945](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142479, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:41:19.347352 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 7352
I20260807 22:41:19.347479 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance
I20260807 22:41:19.347699 23377 external_mini_cluster.cc:1428] Setting key 9e2c3bfec932293e793b93ee10c980f3
I20260807 22:41:19.349313 7102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:19.340421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:58717 (local address 127.22.212.126:46365)
0807 22:41:19.340493 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:19.340496 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:19.340740 (+ 244us) server_negotiation.cc:407] Connection header received
0807 22:41:19.341236 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:19.341237 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:19.341253 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:19.341311 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:19.342245 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:19.342754 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:19.343765 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:19.343974 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:19.344032 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:19.346193 (+ 2161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:19.346195 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:19.346196 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:41:19.346202 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:19.347826 (+ 1624us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:19.348274 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:19.348275 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:19.348276 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:19.348341 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:19.348678 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:19.348679 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:19.348679 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:19.348784 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:19.348838 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:19.349178 (+ 340us) server_negotiation.cc:299] Negotiation successful
0807 22:41:19.349250 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 22:41:19.349638 7591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:19.340406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:46365 (local address 127.22.212.66:58717)
0807 22:41:19.340612 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:19.340649 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:19.341140 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:19.341367 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:19.341370 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:19.341951 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:19.342157 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:19.342162 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:19.342847 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:19.342848 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:19.343683 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:19.343685 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:19.344055 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:19.344056 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:19.344161 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:19.344690 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:19.344698 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:19.346102 (+ 1404us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:41:19.347952 (+ 1850us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:41:19.347964 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:41:19.347966 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:41:19.348187 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:41:19.348420 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:41:19.348436 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:41:19.348436 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:41:19.348603 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:41:19.348854 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:41:19.348860 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:41:19.349037 (+ 177us) client_negotiation.cc:769] Sending connection context
0807 22:41:19.349161 (+ 124us) client_negotiation.cc:240] Negotiation successful
0807 22:41:19.349351 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":109,"threads_started":1}
I20260807 22:41:19.350175 7586 heartbeater.cc:347] Connected to a master server at 127.22.212.126:46365
I20260807 22:41:19.350320 7586 heartbeater.cc:464] Registering TS with master...
I20260807 22:41:19.350538 7586 heartbeater.cc:511] Master 127.22.212.126:46365 requested a full tablet report, sending...
I20260807 22:41:19.351059 7016 ts_manager.cc:194] Registered new tserver with Master: 89e2a91b70034062acb484173e8a6dfe (127.22.212.66:45835)
I20260807 22:41:19.351487 7016 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.66@KRBTEST.COM'} at 127.22.212.66:58717
WARNING: no policy specified for kudu/127.22.212.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab.
Entry for principal kudu/127.22.212.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab.
I20260807 22:41:19.375116 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.67:0
--local_ip_for_outbound_sockets=127.22.212.67
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:46365
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:42493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:41:19.460404 7595 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:41:19.460628 7595 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:41:19.460652 7595 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:41:19.461773 7595 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:41:19.461809 7595 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:41:19.461835 7595 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.67
I20260807 22:41:19.463232 7595 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:42493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:46365
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7595
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.67
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:41:19.463431 7595 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:41:19.463619 7595 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:41:19.468917 7606 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:41:19.468901 7607 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:19.468961 7595 server_base.cc:1034] running on GCE node
W20260807 22:41:19.468901 7609 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:41:19.469419 7595 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:41:19.469646 7595 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:41:19.470784 7595 hybrid_clock.cc:648] HybridClock initialized: now 1786142479470771 us; error 28 us; skew 500 ppm
Aug 07 22:41:19 dist-test-slave-2d19 krb5kdc[6945](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142479, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:41:19.473429 7595 init.cc:377] Logged in from keytab as kudu/127.22.212.67@KRBTEST.COM (short username kudu)
I20260807 22:41:19.473810 7595 webserver.cc:460] Webserver started at http://127.22.212.67:40879/ using document root <none> and password file <none>
I20260807 22:41:19.473994 7595 fs_manager.cc:359] Metadata directory not provided
I20260807 22:41:19.474036 7595 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:41:19.474123 7595 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:41:19.475286 7595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/data/instance:
uuid: "9f84950bfa5f4b34adb4be49e9e98f95"
format_stamp: "Formatted at 2026-08-07 22:41:19 on dist-test-slave-2d19"
server_key: "7dcdedbb3e85667c4d4140f9a53685e7"
server_key_iv: "8cc894ec7ce465c8ee8e29f788cb3ebf"
server_key_version: "encryptionkey@0"
I20260807 22:41:19.475704 7595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance:
uuid: "9f84950bfa5f4b34adb4be49e9e98f95"
format_stamp: "Formatted at 2026-08-07 22:41:19 on dist-test-slave-2d19"
server_key: "7dcdedbb3e85667c4d4140f9a53685e7"
server_key_iv: "8cc894ec7ce465c8ee8e29f788cb3ebf"
server_key_version: "encryptionkey@0"
I20260807 22:41:19.477121 7595 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 22:41:19.477849 7621 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:19.478070 7595 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:41:19.478180 7595 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/wal
uuid: "9f84950bfa5f4b34adb4be49e9e98f95"
format_stamp: "Formatted at 2026-08-07 22:41:19 on dist-test-slave-2d19"
server_key: "7dcdedbb3e85667c4d4140f9a53685e7"
server_key_iv: "8cc894ec7ce465c8ee8e29f788cb3ebf"
server_key_version: "encryptionkey@0"
I20260807 22:41:19.478256 7595 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:41:19.502903 7595 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:41:19.505370 7595 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:41:19.505550 7595 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:41:19.505803 7595 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:41:19.506134 7595 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:41:19.506191 7595 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:19.506227 7595 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:41:19.506253 7595 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:41:19.512202 7595 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.67:43141
I20260807 22:41:19.512245 7807 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.67:43141 every 8 connection(s)
I20260807 22:41:19.512661 7595 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
Aug 07 22:41:19 dist-test-slave-2d19 krb5kdc[6945](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142479, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:41:19.521041 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 7595
I20260807 22:41:19.521142 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance
I20260807 22:41:19.521376 23377 external_mini_cluster.cc:1428] Setting key 57e7c79114af4c56676b6ad38f1cafcd
I20260807 22:41:19.522522 7102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:19.513548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:44383 (local address 127.22.212.126:46365)
0807 22:41:19.513644 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:19.513646 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:19.513800 (+ 154us) server_negotiation.cc:407] Connection header received
0807 22:41:19.514276 (+ 476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:19.514277 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:19.514289 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:19.514361 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:19.515297 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:19.515805 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:19.516873 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:19.517079 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:19.517141 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:19.519236 (+ 2095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:19.519237 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:19.519238 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:41:19.519245 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:19.520868 (+ 1623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:19.521377 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:19.521378 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:19.521379 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:19.521447 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:19.521765 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:19.521766 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:19.521766 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:19.521930 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:19.522002 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:19.522336 (+ 334us) server_negotiation.cc:299] Negotiation successful
0807 22:41:19.522436 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 22:41:19.522706 7815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:19.513465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:46365 (local address 127.22.212.67:44383)
0807 22:41:19.513641 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:19.513686 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:19.514177 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:19.514420 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:19.514423 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:19.514985 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:41:19.515180 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:19.515186 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:19.515891 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:19.515892 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:19.516760 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:19.516762 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:19.517157 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:19.517158 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:19.517255 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:19.517808 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:41:19.517817 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:41:19.519144 (+ 1327us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:41:19.520949 (+ 1805us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:41:19.520956 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:41:19.520959 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:41:19.521302 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:41:19.521535 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:41:19.521536 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:41:19.521536 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:41:19.521677 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:41:19.522006 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:41:19.522014 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:41:19.522186 (+ 172us) client_negotiation.cc:769] Sending connection context
0807 22:41:19.522290 (+ 104us) client_negotiation.cc:240] Negotiation successful
0807 22:41:19.522481 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":103,"threads_started":1}
I20260807 22:41:19.523198 7812 heartbeater.cc:347] Connected to a master server at 127.22.212.126:46365
I20260807 22:41:19.523295 7812 heartbeater.cc:464] Registering TS with master...
I20260807 22:41:19.523450 7812 heartbeater.cc:511] Master 127.22.212.126:46365 requested a full tablet report, sending...
I20260807 22:41:19.523789 7016 ts_manager.cc:194] Registered new tserver with Master: 9f84950bfa5f4b34adb4be49e9e98f95 (127.22.212.67:43141)
I20260807 22:41:19.524130 7016 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.67@KRBTEST.COM'} at 127.22.212.67:44383
I20260807 22:41:19.533164 23377 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:41:19.540720 7102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:19.534649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59284 (local address 127.22.212.126:46365)
0807 22:41:19.534717 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:19.534719 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:19.534853 (+ 134us) server_negotiation.cc:407] Connection header received
0807 22:41:19.534900 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:19.534901 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:19.534910 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:19.534948 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:41:19.535504 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:19.535968 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:19.536832 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:19.537023 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:19.537084 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:19.538435 (+ 1351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:41:19.538436 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:41:19.538436 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:41:19.538440 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:41:19.539662 (+ 1222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:19.540002 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:19.540003 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:19.540003 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:19.540053 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:41:19.540191 (+ 138us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:41:19.540192 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:41:19.540192 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:41:19.540386 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:41:19.540467 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:19.540595 (+ 128us) server_negotiation.cc:299] Negotiation successful
0807 22:41:19.540659 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 22:41:19.542572 7016 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59284:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:41:19.544157 7016 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:41:19.550897 7836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:19.546695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38224 (local address 127.22.212.66:45835)
0807 22:41:19.547222 (+ 527us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:19.547226 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:19.547236 (+ 10us) server_negotiation.cc:407] Connection header received
0807 22:41:19.547274 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:19.547276 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:19.547290 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:19.547357 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:41:19.547609 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:19.548767 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:19.549982 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:19.550471 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:19.550561 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:19.550620 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:19.550766 (+ 146us) server_negotiation.cc:299] Negotiation successful
0807 22:41:19.550805 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":487,"thread_start_us":94,"threads_started":1}
I20260807 22:41:19.550930 7833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:19.546812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.67:43141 (local address 127.0.0.1:44250)
0807 22:41:19.546986 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:19.546996 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:19.547088 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:19.547430 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:19.547433 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:19.547435 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:41:19.547553 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:19.547555 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:19.548489 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:19.548490 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:19.549658 (+ 1168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:19.549660 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:19.550651 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:19.550653 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:19.550718 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:19.550723 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 22:41:19.550774 (+ 51us) client_negotiation.cc:240] Negotiation successful
0807 22:41:19.550817 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"mutex_wait_us":6,"thread_start_us":72,"threads_started":1}
I20260807 22:41:19.551026 7830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:19.546597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:40075 (local address 127.0.0.1:59852)
0807 22:41:19.546770 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:19.546810 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:19.546876 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:19.547440 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:19.547440 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:19.547442 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:41:19.547549 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:19.547552 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:19.548923 (+ 1371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:19.548924 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:19.549894 (+ 970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:19.549897 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:19.550776 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:19.550777 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:19.550829 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:19.550832 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:41:19.550862 (+ 30us) client_negotiation.cc:240] Negotiation successful
0807 22:41:19.550896 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"mutex_wait_us":4,"thread_start_us":64,"threads_started":1}
I20260807 22:41:19.550945 7837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:19.546596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.66:45835 (local address 127.0.0.1:38224)
0807 22:41:19.546934 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:19.546945 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:19.547021 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:19.547435 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:19.547435 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:19.547436 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:41:19.547537 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:19.547540 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:19.548887 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:19.548888 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:19.549892 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:19.549894 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:19.550563 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:19.550564 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:19.550645 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:19.550657 (+ 12us) client_negotiation.cc:769] Sending connection context
0807 22:41:19.550750 (+ 93us) client_negotiation.cc:240] Negotiation successful
0807 22:41:19.550806 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":321,"mutex_wait_us":34,"thread_start_us":79,"threads_started":1}
I20260807 22:41:19.551277 7839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:19.546813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59852 (local address 127.22.212.65:40075)
0807 22:41:19.547260 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:19.547265 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:19.547275 (+ 10us) server_negotiation.cc:407] Connection header received
0807 22:41:19.547318 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:19.547320 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:19.547337 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:19.547640 (+ 303us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:41:19.547723 (+ 83us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:19.548798 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:19.550006 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:19.550685 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:19.550971 (+ 286us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:19.551093 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:19.551123 (+ 30us) server_negotiation.cc:299] Negotiation successful
0807 22:41:19.551173 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":86,"threads_started":1}
I20260807 22:41:19.551460 7841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:19.546975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44250 (local address 127.22.212.67:43141)
0807 22:41:19.547164 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:19.547169 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:19.547181 (+ 12us) server_negotiation.cc:407] Connection header received
0807 22:41:19.547225 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:19.547227 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:19.547246 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:19.547326 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:41:19.547637 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:19.548392 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:19.549753 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:19.550471 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:19.550553 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:19.550613 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:19.551287 (+ 674us) server_negotiation.cc:299] Negotiation successful
0807 22:41:19.551339 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":95,"threads_started":1}
I20260807 22:41:19.552065 7220 tablet_service.cc:1467] Processing CreateTablet for tablet 70ea23cd008b40049ba1842dc5378dad (DEFAULT_TABLE table=test-table [id=81656793770541758dd77f1c4c27fd47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:41:19.552146 7695 tablet_service.cc:1467] Processing CreateTablet for tablet 70ea23cd008b40049ba1842dc5378dad (DEFAULT_TABLE table=test-table [id=81656793770541758dd77f1c4c27fd47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:41:19.552150 7453 tablet_service.cc:1467] Processing CreateTablet for tablet 70ea23cd008b40049ba1842dc5378dad (DEFAULT_TABLE table=test-table [id=81656793770541758dd77f1c4c27fd47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:41:19.552549 7695 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70ea23cd008b40049ba1842dc5378dad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:41:19.552546 7453 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70ea23cd008b40049ba1842dc5378dad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:41:19.552562 7220 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70ea23cd008b40049ba1842dc5378dad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:41:19.555411 7842 tablet_bootstrap.cc:492] T 70ea23cd008b40049ba1842dc5378dad P 98650c2c93114122ba52f7a5ba4443ce: Bootstrap starting.
I20260807 22:41:19.555805 7843 tablet_bootstrap.cc:492] T 70ea23cd008b40049ba1842dc5378dad P 89e2a91b70034062acb484173e8a6dfe: Bootstrap starting.
I20260807 22:41:19.556408 7842 tablet_bootstrap.cc:654] T 70ea23cd008b40049ba1842dc5378dad P 98650c2c93114122ba52f7a5ba4443ce: Neither blocks nor log segments found. Creating new log.
I20260807 22:41:19.556412 7844 tablet_bootstrap.cc:492] T 70ea23cd008b40049ba1842dc5378dad P 9f84950bfa5f4b34adb4be49e9e98f95: Bootstrap starting.
I20260807 22:41:19.556496 7843 tablet_bootstrap.cc:654] T 70ea23cd008b40049ba1842dc5378dad P 89e2a91b70034062acb484173e8a6dfe: Neither blocks nor log segments found. Creating new log.
I20260807 22:41:19.556967 7844 tablet_bootstrap.cc:654] T 70ea23cd008b40049ba1842dc5378dad P 9f84950bfa5f4b34adb4be49e9e98f95: Neither blocks nor log segments found. Creating new log.
I20260807 22:41:19.557124 7842 log.cc:824] T 70ea23cd008b40049ba1842dc5378dad P 98650c2c93114122ba52f7a5ba4443ce: Log is configured to *not* fsync() on all Append() calls
I20260807 22:41:19.557124 7843 log.cc:824] T 70ea23cd008b40049ba1842dc5378dad P 89e2a91b70034062acb484173e8a6dfe: Log is configured to *not* fsync() on all Append() calls
I20260807 22:41:19.557610 7844 log.cc:824] T 70ea23cd008b40049ba1842dc5378dad P 9f84950bfa5f4b34adb4be49e9e98f95: Log is configured to *not* fsync() on all Append() calls
I20260807 22:41:19.558530 7843 tablet_bootstrap.cc:492] T 70ea23cd008b40049ba1842dc5378dad P 89e2a91b70034062acb484173e8a6dfe: No bootstrap required, opened a new log
I20260807 22:41:19.558557 7842 tablet_bootstrap.cc:492] T 70ea23cd008b40049ba1842dc5378dad P 98650c2c93114122ba52f7a5ba4443ce: No bootstrap required, opened a new log
I20260807 22:41:19.558604 7843 ts_tablet_manager.cc:1397] T 70ea23cd008b40049ba1842dc5378dad P 89e2a91b70034062acb484173e8a6dfe: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 22:41:19.558642 7842 ts_tablet_manager.cc:1397] T 70ea23cd008b40049ba1842dc5378dad P 98650c2c93114122ba52f7a5ba4443ce: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260807 22:41:19.559490 7844 tablet_bootstrap.cc:492] T 70ea23cd008b40049ba1842dc5378dad P 9f84950bfa5f4b34adb4be49e9e98f95: No bootstrap required, opened a new log
I20260807 22:41:19.559574 7844 ts_tablet_manager.cc:1397] T 70ea23cd008b40049ba1842dc5378dad P 9f84950bfa5f4b34adb4be49e9e98f95: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260807 22:41:19.560431 7842 raft_consensus.cc:348] T 70ea23cd008b40049ba1842dc5378dad P 98650c2c93114122ba52f7a5ba4443ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98650c2c93114122ba52f7a5ba4443ce" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 40075 } } peers { permanent_uuid: "89e2a91b70034062acb484173e8a6dfe" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 45835 } } peers { permanent_uuid: "9f84950bfa5f4b34adb4be49e9e98f95" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 43141 } }
I20260807 22:41:19.560631 7842 raft_consensus.cc:374] T 70ea23cd008b40049ba1842dc5378dad P 98650c2c93114122ba52f7a5ba4443ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:41:19.560678 7842 raft_consensus.cc:729] T 70ea23cd008b40049ba1842dc5378dad P 98650c2c93114122ba52f7a5ba4443ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98650c2c93114122ba52f7a5ba4443ce, State: Initialized, Role: FOLLOWER
I20260807 22:41:19.560824 7842 consensus_queue.cc:260] T 70ea23cd008b40049ba1842dc5378dad P 98650c2c93114122ba52f7a5ba4443ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98650c2c93114122ba52f7a5ba4443ce" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 40075 } } peers { permanent_uuid: "89e2a91b70034062acb484173e8a6dfe" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 45835 } } peers { permanent_uuid: "9f84950bfa5f4b34adb4be49e9e98f95" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 43141 } }
I20260807 22:41:19.560828 7843 raft_consensus.cc:348] T 70ea23cd008b40049ba1842dc5378dad P 89e2a91b70034062acb484173e8a6dfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98650c2c93114122ba52f7a5ba4443ce" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 40075 } } peers { permanent_uuid: "89e2a91b70034062acb484173e8a6dfe" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 45835 } } peers { permanent_uuid: "9f84950bfa5f4b34adb4be49e9e98f95" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 43141 } }
I20260807 22:41:19.560990 7843 raft_consensus.cc:374] T 70ea23cd008b40049ba1842dc5378dad P 89e2a91b70034062acb484173e8a6dfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:41:19.561024 7843 raft_consensus.cc:729] T 70ea23cd008b40049ba1842dc5378dad P 89e2a91b70034062acb484173e8a6dfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89e2a91b70034062acb484173e8a6dfe, State: Initialized, Role: FOLLOWER
I20260807 22:41:19.561131 7842 ts_tablet_manager.cc:1428] T 70ea23cd008b40049ba1842dc5378dad P 98650c2c93114122ba52f7a5ba4443ce: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260807 22:41:19.561139 7843 consensus_queue.cc:260] T 70ea23cd008b40049ba1842dc5378dad P 89e2a91b70034062acb484173e8a6dfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98650c2c93114122ba52f7a5ba4443ce" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 40075 } } peers { permanent_uuid: "89e2a91b70034062acb484173e8a6dfe" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 45835 } } peers { permanent_uuid: "9f84950bfa5f4b34adb4be49e9e98f95" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 43141 } }
I20260807 22:41:19.561255 7341 heartbeater.cc:503] Master 127.22.212.126:46365 was elected leader, sending a full tablet report...
I20260807 22:41:19.561409 7843 ts_tablet_manager.cc:1428] T 70ea23cd008b40049ba1842dc5378dad P 89e2a91b70034062acb484173e8a6dfe: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 22:41:19.561551 7586 heartbeater.cc:503] Master 127.22.212.126:46365 was elected leader, sending a full tablet report...
I20260807 22:41:19.561645 7844 raft_consensus.cc:348] T 70ea23cd008b40049ba1842dc5378dad P 9f84950bfa5f4b34adb4be49e9e98f95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98650c2c93114122ba52f7a5ba4443ce" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 40075 } } peers { permanent_uuid: "89e2a91b70034062acb484173e8a6dfe" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 45835 } } peers { permanent_uuid: "9f84950bfa5f4b34adb4be49e9e98f95" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 43141 } }
I20260807 22:41:19.561806 7844 raft_consensus.cc:374] T 70ea23cd008b40049ba1842dc5378dad P 9f84950bfa5f4b34adb4be49e9e98f95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:41:19.561847 7844 raft_consensus.cc:729] T 70ea23cd008b40049ba1842dc5378dad P 9f84950bfa5f4b34adb4be49e9e98f95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f84950bfa5f4b34adb4be49e9e98f95, State: Initialized, Role: FOLLOWER
I20260807 22:41:19.561980 7844 consensus_queue.cc:260] T 70ea23cd008b40049ba1842dc5378dad P 9f84950bfa5f4b34adb4be49e9e98f95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98650c2c93114122ba52f7a5ba4443ce" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 40075 } } peers { permanent_uuid: "89e2a91b70034062acb484173e8a6dfe" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 45835 } } peers { permanent_uuid: "9f84950bfa5f4b34adb4be49e9e98f95" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 43141 } }
I20260807 22:41:19.562300 7844 ts_tablet_manager.cc:1428] T 70ea23cd008b40049ba1842dc5378dad P 9f84950bfa5f4b34adb4be49e9e98f95: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260807 22:41:19.562431 7812 heartbeater.cc:503] Master 127.22.212.126:46365 was elected leader, sending a full tablet report...
W20260807 22:41:19.590263 7590 tablet.cc:2369] T 70ea23cd008b40049ba1842dc5378dad P 89e2a91b70034062acb484173e8a6dfe: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 22:41:19.655791 7342 tablet.cc:2369] T 70ea23cd008b40049ba1842dc5378dad P 98650c2c93114122ba52f7a5ba4443ce: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:41:19.687608 7852 raft_consensus.cc:482] T 70ea23cd008b40049ba1842dc5378dad P 9f84950bfa5f4b34adb4be49e9e98f95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:41:19.687819 7852 raft_consensus.cc:504] T 70ea23cd008b40049ba1842dc5378dad P 9f84950bfa5f4b34adb4be49e9e98f95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98650c2c93114122ba52f7a5ba4443ce" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 40075 } } peers { permanent_uuid: "89e2a91b70034062acb484173e8a6dfe" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 45835 } } peers { permanent_uuid: "9f84950bfa5f4b34adb4be49e9e98f95" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 43141 } }
I20260807 22:41:19.688333 7852 leader_election.cc:288] T 70ea23cd008b40049ba1842dc5378dad P 9f84950bfa5f4b34adb4be49e9e98f95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98650c2c93114122ba52f7a5ba4443ce (127.22.212.65:40075), 89e2a91b70034062acb484173e8a6dfe (127.22.212.66:45835)
I20260807 22:41:19.691316 7839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:19.688674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:45467 (local address 127.22.212.65:40075)
0807 22:41:19.688719 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:19.688721 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:19.688732 (+ 11us) server_negotiation.cc:407] Connection header received
0807 22:41:19.688823 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:19.688825 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:19.688838 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:19.688924 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:41:19.689111 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:19.689589 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:19.690528 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:19.690884 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:19.691027 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:19.691036 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:19.691213 (+ 177us) server_negotiation.cc:299] Negotiation successful
0807 22:41:19.691250 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 22:41:19.691316 7815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:19.688573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:40075 (local address 127.22.212.67:45467)
0807 22:41:19.688634 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:19.688648 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:19.688719 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:19.688945 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:19.688946 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:19.688948 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:41:19.689025 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:19.689027 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:19.689683 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:19.689684 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:19.690433 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:19.690435 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:19.691029 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:19.691030 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:19.691109 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:19.691112 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:41:19.691204 (+ 92us) client_negotiation.cc:240] Negotiation successful
0807 22:41:19.691244 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260807 22:41:19.691375 7836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:19.688706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:43877 (local address 127.22.212.66:45835)
0807 22:41:19.688760 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:19.688763 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:19.688899 (+ 136us) server_negotiation.cc:407] Connection header received
0807 22:41:19.688968 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:19.688969 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:19.688988 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:19.689063 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:41:19.689235 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:19.689686 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:19.690589 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:19.690962 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:19.691104 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:19.691113 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:19.691266 (+ 153us) server_negotiation.cc:299] Negotiation successful
0807 22:41:19.691303 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260807 22:41:19.691448 7853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:19.688576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.66:45835 (local address 127.22.212.67:43877)
0807 22:41:19.688815 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:19.688827 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:41:19.688878 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:41:19.689071 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:41:19.689072 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:41:19.689074 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:41:19.689154 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:19.689155 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:19.689778 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:19.689779 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:19.690497 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:41:19.690499 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:41:19.691107 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:41:19.691108 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:41:19.691182 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:19.691185 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:41:19.691259 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 22:41:19.691300 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"mutex_wait_us":68,"thread_start_us":105,"threads_started":1}
I20260807 22:41:19.691807 7484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70ea23cd008b40049ba1842dc5378dad" candidate_uuid: "9f84950bfa5f4b34adb4be49e9e98f95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89e2a91b70034062acb484173e8a6dfe" is_pre_election: true
I20260807 22:41:19.691792 7255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70ea23cd008b40049ba1842dc5378dad" candidate_uuid: "9f84950bfa5f4b34adb4be49e9e98f95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98650c2c93114122ba52f7a5ba4443ce" is_pre_election: true
I20260807 22:41:19.691999 7484 raft_consensus.cc:2454] T 70ea23cd008b40049ba1842dc5378dad P 89e2a91b70034062acb484173e8a6dfe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f84950bfa5f4b34adb4be49e9e98f95 in term 0.
I20260807 22:41:19.692057 7255 raft_consensus.cc:2454] T 70ea23cd008b40049ba1842dc5378dad P 98650c2c93114122ba52f7a5ba4443ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f84950bfa5f4b34adb4be49e9e98f95 in term 0.
I20260807 22:41:19.692365 7625 leader_election.cc:302] T 70ea23cd008b40049ba1842dc5378dad P 9f84950bfa5f4b34adb4be49e9e98f95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89e2a91b70034062acb484173e8a6dfe, 9f84950bfa5f4b34adb4be49e9e98f95; no voters:
I20260807 22:41:19.692520 7852 raft_consensus.cc:2781] T 70ea23cd008b40049ba1842dc5378dad P 9f84950bfa5f4b34adb4be49e9e98f95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:41:19.692584 7852 raft_consensus.cc:482] T 70ea23cd008b40049ba1842dc5378dad P 9f84950bfa5f4b34adb4be49e9e98f95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:41:19.692607 7852 raft_consensus.cc:3037] T 70ea23cd008b40049ba1842dc5378dad P 9f84950bfa5f4b34adb4be49e9e98f95 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:41:19.693331 7852 raft_consensus.cc:504] T 70ea23cd008b40049ba1842dc5378dad P 9f84950bfa5f4b34adb4be49e9e98f95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98650c2c93114122ba52f7a5ba4443ce" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 40075 } } peers { permanent_uuid: "89e2a91b70034062acb484173e8a6dfe" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 45835 } } peers { permanent_uuid: "9f84950bfa5f4b34adb4be49e9e98f95" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 43141 } }
I20260807 22:41:19.693471 7852 leader_election.cc:288] T 70ea23cd008b40049ba1842dc5378dad P 9f84950bfa5f4b34adb4be49e9e98f95 [CANDIDATE]: Term 1 election: Requested vote from peers 98650c2c93114122ba52f7a5ba4443ce (127.22.212.65:40075), 89e2a91b70034062acb484173e8a6dfe (127.22.212.66:45835)
I20260807 22:41:19.693656 7255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70ea23cd008b40049ba1842dc5378dad" candidate_uuid: "9f84950bfa5f4b34adb4be49e9e98f95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98650c2c93114122ba52f7a5ba4443ce"
I20260807 22:41:19.693662 7484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70ea23cd008b40049ba1842dc5378dad" candidate_uuid: "9f84950bfa5f4b34adb4be49e9e98f95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89e2a91b70034062acb484173e8a6dfe"
I20260807 22:41:19.693737 7484 raft_consensus.cc:3037] T 70ea23cd008b40049ba1842dc5378dad P 89e2a91b70034062acb484173e8a6dfe [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:41:19.693737 7255 raft_consensus.cc:3037] T 70ea23cd008b40049ba1842dc5378dad P 98650c2c93114122ba52f7a5ba4443ce [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:41:19.694644 7255 raft_consensus.cc:2454] T 70ea23cd008b40049ba1842dc5378dad P 98650c2c93114122ba52f7a5ba4443ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f84950bfa5f4b34adb4be49e9e98f95 in term 1.
I20260807 22:41:19.694644 7484 raft_consensus.cc:2454] T 70ea23cd008b40049ba1842dc5378dad P 89e2a91b70034062acb484173e8a6dfe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f84950bfa5f4b34adb4be49e9e98f95 in term 1.
I20260807 22:41:19.694859 7625 leader_election.cc:302] T 70ea23cd008b40049ba1842dc5378dad P 9f84950bfa5f4b34adb4be49e9e98f95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89e2a91b70034062acb484173e8a6dfe, 9f84950bfa5f4b34adb4be49e9e98f95; no voters:
I20260807 22:41:19.694962 7852 raft_consensus.cc:2781] T 70ea23cd008b40049ba1842dc5378dad P 9f84950bfa5f4b34adb4be49e9e98f95 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:41:19.695112 7852 raft_consensus.cc:686] T 70ea23cd008b40049ba1842dc5378dad P 9f84950bfa5f4b34adb4be49e9e98f95 [term 1 LEADER]: Becoming Leader. State: Replica: 9f84950bfa5f4b34adb4be49e9e98f95, State: Running, Role: LEADER
I20260807 22:41:19.695212 7852 consensus_queue.cc:237] T 70ea23cd008b40049ba1842dc5378dad P 9f84950bfa5f4b34adb4be49e9e98f95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98650c2c93114122ba52f7a5ba4443ce" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 40075 } } peers { permanent_uuid: "89e2a91b70034062acb484173e8a6dfe" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 45835 } } peers { permanent_uuid: "9f84950bfa5f4b34adb4be49e9e98f95" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 43141 } }
I20260807 22:41:19.696151 7011 catalog_manager.cc:5495] T 70ea23cd008b40049ba1842dc5378dad P 9f84950bfa5f4b34adb4be49e9e98f95 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f84950bfa5f4b34adb4be49e9e98f95 (127.22.212.67). New cstate: current_term: 1 leader_uuid: "9f84950bfa5f4b34adb4be49e9e98f95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98650c2c93114122ba52f7a5ba4443ce" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 40075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89e2a91b70034062acb484173e8a6dfe" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f84950bfa5f4b34adb4be49e9e98f95" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 43141 } health_report { overall_health: HEALTHY } } }
I20260807 22:41:19.733166 7841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:19.730577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44252 (local address 127.22.212.67:43141)
0807 22:41:19.730640 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0807 22:41:19.730642 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:41:19.730652 (+ 10us) server_negotiation.cc:407] Connection header received
0807 22:41:19.730738 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:41:19.730739 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:41:19.730758 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:41:19.730839 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:41:19.730995 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:19.731488 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:19.732330 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:41:19.732525 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:41:19.732620 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:41:19.732798 (+ 178us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:41:19.732910 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:41:19.733003 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0807 22:41:19.733026 (+ 23us) server_negotiation.cc:299] Negotiation successful
0807 22:41:19.733054 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260807 22:41:19.735298 7484 raft_consensus.cc:1261] T 70ea23cd008b40049ba1842dc5378dad P 89e2a91b70034062acb484173e8a6dfe [term 1 FOLLOWER]: Refusing update from remote peer 9f84950bfa5f4b34adb4be49e9e98f95: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:41:19.735297 7255 raft_consensus.cc:1261] T 70ea23cd008b40049ba1842dc5378dad P 98650c2c93114122ba52f7a5ba4443ce [term 1 FOLLOWER]: Refusing update from remote peer 9f84950bfa5f4b34adb4be49e9e98f95: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:41:19.735704 7854 consensus_queue.cc:1035] T 70ea23cd008b40049ba1842dc5378dad P 9f84950bfa5f4b34adb4be49e9e98f95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89e2a91b70034062acb484173e8a6dfe" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:41:19.735836 7852 consensus_queue.cc:1035] T 70ea23cd008b40049ba1842dc5378dad P 9f84950bfa5f4b34adb4be49e9e98f95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98650c2c93114122ba52f7a5ba4443ce" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 40075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:41:19.739319 7866 mvcc.cc:205] Tried to move back new op lower bound from 7316039596992274432 to 7316039596832395264. Current Snapshot: MvccSnapshot[applied={T|T < 7316039596992274432}]
I20260807 22:41:19.741842 7011 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59284:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:41:19.741943 7011 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59284:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:41:19.742610 7011 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f85cae80cdf94983a81270313a0da85b: Sending DeleteTablet for 3 replicas of tablet 70ea23cd008b40049ba1842dc5378dad
I20260807 22:41:19.742969 7453 tablet_service.cc:1514] Processing DeleteTablet for tablet 70ea23cd008b40049ba1842dc5378dad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:41:19 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:38224
I20260807 22:41:19.742971 7220 tablet_service.cc:1514] Processing DeleteTablet for tablet 70ea23cd008b40049ba1842dc5378dad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:41:19 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:59852
I20260807 22:41:19.743203 7877 tablet_replica.cc:330] T 70ea23cd008b40049ba1842dc5378dad P 89e2a91b70034062acb484173e8a6dfe: stopping tablet replica
I20260807 22:41:19.743199 7695 tablet_service.cc:1514] Processing DeleteTablet for tablet 70ea23cd008b40049ba1842dc5378dad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:41:19 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:44250
I20260807 22:41:19.743310 7877 raft_consensus.cc:2229] T 70ea23cd008b40049ba1842dc5378dad P 89e2a91b70034062acb484173e8a6dfe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:41:19.743438 7877 raft_consensus.cc:2258] T 70ea23cd008b40049ba1842dc5378dad P 89e2a91b70034062acb484173e8a6dfe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:41:19.743458 7882 tablet_replica.cc:330] T 70ea23cd008b40049ba1842dc5378dad P 9f84950bfa5f4b34adb4be49e9e98f95: stopping tablet replica
I20260807 22:41:19.743640 7882 raft_consensus.cc:2229] T 70ea23cd008b40049ba1842dc5378dad P 9f84950bfa5f4b34adb4be49e9e98f95 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:41:19.743878 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 7120
I20260807 22:41:19.750269 7877 ts_tablet_manager.cc:1905] T 70ea23cd008b40049ba1842dc5378dad P 89e2a91b70034062acb484173e8a6dfe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:41:19.753000 7877 ts_tablet_manager.cc:1918] T 70ea23cd008b40049ba1842dc5378dad P 89e2a91b70034062acb484173e8a6dfe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:41:19.753104 7877 log.cc:1196] T 70ea23cd008b40049ba1842dc5378dad P 89e2a91b70034062acb484173e8a6dfe: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-1/wal/wals/70ea23cd008b40049ba1842dc5378dad
I20260807 22:41:19.753460 7877 ts_tablet_manager.cc:1939] T 70ea23cd008b40049ba1842dc5378dad P 89e2a91b70034062acb484173e8a6dfe: Deleting consensus metadata
I20260807 22:41:19.765832 6995 catalog_manager.cc:4841] TS 89e2a91b70034062acb484173e8a6dfe (127.22.212.66:45835): tablet 70ea23cd008b40049ba1842dc5378dad (table test-table [id=81656793770541758dd77f1c4c27fd47]) successfully deleted
I20260807 22:41:19.743804 7882 raft_consensus.cc:2258] T 70ea23cd008b40049ba1842dc5378dad P 9f84950bfa5f4b34adb4be49e9e98f95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:41:19.782090 7882 ts_tablet_manager.cc:1905] T 70ea23cd008b40049ba1842dc5378dad P 9f84950bfa5f4b34adb4be49e9e98f95: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:41:19.783797 7882 ts_tablet_manager.cc:1918] T 70ea23cd008b40049ba1842dc5378dad P 9f84950bfa5f4b34adb4be49e9e98f95: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:41:19.783977 7882 log.cc:1196] T 70ea23cd008b40049ba1842dc5378dad P 9f84950bfa5f4b34adb4be49e9e98f95: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786142418640232-23377-0/minicluster-data/ts-2/wal/wals/70ea23cd008b40049ba1842dc5378dad
I20260807 22:41:19.784309 7882 ts_tablet_manager.cc:1939] T 70ea23cd008b40049ba1842dc5378dad P 9f84950bfa5f4b34adb4be49e9e98f95: Deleting consensus metadata
I20260807 22:41:19.784854 6992 catalog_manager.cc:4841] TS 9f84950bfa5f4b34adb4be49e9e98f95 (127.22.212.67:43141): tablet 70ea23cd008b40049ba1842dc5378dad (table test-table [id=81656793770541758dd77f1c4c27fd47]) successfully deleted
W20260807 22:41:19.787112 6992 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.212.65:40075 (error 108)
I20260807 22:41:19.787364 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 7352
I20260807 22:41:19.794324 7833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:41:19.794170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:40075 (local address 127.0.0.1:59858)
0807 22:41:19.794226 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0807 22:41:19.794284 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.65:40075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260807 22:41:19.794529 6992 catalog_manager.cc:4584] TS 98650c2c93114122ba52f7a5ba4443ce (127.22.212.65:40075): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 70ea23cd008b40049ba1842dc5378dad: Network error: Client connection negotiation failed: client connection to 127.22.212.65:40075: connect: Connection refused (error 111)
I20260807 22:41:19.815267 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 7595
I20260807 22:41:19.828047 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 6969
2026-08-07T22:41:19Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2425 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:41:19 dist-test-slave-2d19 krb5kdc[7898](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:41:19 dist-test-slave-2d19 krb5kdc[7898](info): set up 2 sockets
Aug 07 22:41:19 dist-test-slave-2d19 krb5kdc[7898](info): commencing operation
krb5kdc: starting...
W20260807 22:41:21.090703 23377 mini_kdc.cc:121] Time spent starting KDC: real 1.233s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Aug 07 22:41:21 dist-test-slave-2d19 krb5kdc[7898](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142481, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:41:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:41:21Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.22.212.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.22.212.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.22.212.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/krb5kdc/rangeradmin_127.22.212.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.22.212.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/krb5kdc/rangeradmin_127.22.212.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.22.212.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.22.212.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.22.212.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/krb5kdc/rangerlookup_127.22.212.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.22.212.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/krb5kdc/rangerlookup_127.22.212.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.22.212.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.22.212.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.22.212.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/krb5kdc/HTTP_127.22.212.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.22.212.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/krb5kdc/HTTP_127.22.212.84@KRBTEST.COM.keytab.
I20260807 22:41:21.271135 23377 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-task6SvSzn/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/postgres -l logfile start
2026-08-07 22:41:23.857 UTC [7952] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-07 22:41:23.857 UTC [7952] LOG: listening on IPv4 address "127.22.212.84", port 42097
2026-08-07 22:41:23.861 UTC [7952] LOG: listening on Unix socket "/tmp/.s.PGSQL.42097"
2026-08-07 22:41:23.897 UTC [7956] LOG: database system was shut down at 2026-08-07 22:41:22 UTC
2026-08-07 22:41:23.901 UTC [7952] LOG: database system is ready to accept connections
I20260807 22:41:25.065747 23377 mini_postgres.cc:96] Postgres bound to 42097
2026-08-07 22:41:25.072 UTC [7969] FATAL: database "slave" does not exist
127.22.212.84:42097 - accepting connections
I20260807 22:41:25.073459 23377 mini_ranger.cc:161] Starting Ranger...
I20260807 22:41:25.089180 23377 mini_ranger.cc:84] Created miniranger Postgres user
I20260807 22:41:25.590920 23377 mini_ranger.cc:87] Created ranger Postgres database
I20260807 22:41:25.591019 23377 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ranger-admin
2026-08-07 22:41:25,883 [I] DB FLAVOR :POSTGRES
2026-08-07 22:41:25,883 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 22:41:25,883 [I] Checking connection..
2026-08-07 22:41:25,883 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.212.84:42097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-07 22:41:26,166 [I] Checking connection passed.
2026-08-07 22:41:26,166 [I] --------- Verifying version history table ---------
2026-08-07 22:41:26,166 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.212.84:42097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 22:41:26,407 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 22:41:26,407 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.212.84:42097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 22:41:26,675 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 22:41:26,675 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-07 22:41:26,675 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.212.84:42097/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-07 22:41:26.939 UTC [8070] WARNING: there is no transaction in progress
2026-08-07 22:41:26,948 [I] create_dbversion_catalog.sql file imported successfully
2026-08-07 22:41:26,948 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.212.84:42097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 22:41:27,200 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-07 22:41:27,200 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 22:41:27,200 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.212.84:42097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-07 22:41:27,469 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.212.84:42097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-07 22:41:27,705 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.212.84:42097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-2d19.c.gcp-upstream.internal','N') ;"
2026-08-07 22:41:27,992 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.212.84:42097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 22:41:28,268 [I] Table x_portal_user does not exist in database ranger
2026-08-07 22:41:28,269 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.212.84:42097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 22:41:28,520 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-07 22:41:28,520 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.212.84:42097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 22:41:28,773 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.212.84:42097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 22:41:29,033 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-07 22:41:29,033 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.212.84:42097/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-07 22:41:30.030 UTC [8260] WARNING: there is no transaction in progress
2026-08-07 22:41:30.046 UTC [8260] WARNING: there is no transaction in progress
2026-08-07 22:41:30.063 UTC [8260] WARNING: there is no transaction in progress
2026-08-07 22:41:30.079 UTC [8260] WARNING: there is no transaction in progress
2026-08-07 22:41:30.095 UTC [8260] WARNING: there is no transaction in progress
2026-08-07 22:41:30.114 UTC [8260] WARNING: there is no transaction in progress
2026-08-07 22:41:30.169 UTC [8260] WARNING: there is no transaction in progress
2026-08-07 22:41:30.176 UTC [8260] WARNING: there is no transaction in progress
2026-08-07 22:41:30.191 UTC [8260] WARNING: there is no transaction in progress
2026-08-07 22:41:30.202 UTC [8260] WARNING: there is no transaction in progress
2026-08-07 22:41:30.213 UTC [8260] WARNING: there is no transaction in progress
2026-08-07 22:41:30.227 UTC [8260] WARNING: there is no transaction in progress
2026-08-07 22:41:30.238 UTC [8260] WARNING: there is no transaction in progress
2026-08-07 22:41:30.244 UTC [8260] WARNING: there is no transaction in progress
2026-08-07 22:41:30.252 UTC [8260] WARNING: there is no transaction in progress
2026-08-07 22:41:30.259 UTC [8260] WARNING: there is no transaction in progress
2026-08-07 22:41:30,938 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-07 22:41:30,939 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.212.84:42097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-07 22:41:31,198 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-07 22:41:31,199 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.212.84:42097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 22:41:31,475 [I] Table x_portal_user already exists in database 'ranger'
2026-08-07 22:41:31,475 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.212.84:42097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 22:41:31,745 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-07 22:41:31,745 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.212.84:42097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 22:41:32,017 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.212.84:42097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 22:41:32,283 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.212.84:42097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-2d19.c.gcp-upstream.internal';"
2026-08-07 22:41:32,540 [I] CORE_DB_SCHEMA import status has been updated
2026-08-07 22:41:32,540 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.212.84:42097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-07 22:41:32,775 [I] DB_PATCHES have already been applied
I20260807 22:41:32.781931 23377 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ranger-admin:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-task6SvSzn/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260807 22:41:32.782001 23377 mini_ranger.cc:193] Using host: 127.22.212.84
I20260807 22:41:32.786185 23377 mini_ranger.cc:227] Ranger admin URL: http://127.22.212.84:60065
Aug 07, 2026 10:41:33 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 10:41:33 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 10:41:33 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ranger-admin/ews/webapp
Aug 07, 2026 10:41:33 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 07, 2026 10:41:33 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 07, 2026 10:41:33 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ranger-admin/ews/webapp].
Aug 07, 2026 10:41:33 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260807 22:41:34.170058 23377 mini_ranger.cc:160] Time spent starting Ranger: real 9.097s user 0.000s sys 0.011s
Aug 07, 2026 10:41:54 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 07, 2026 10:41:54 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 07, 2026 10:41:54 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 07, 2026 10:41:54 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 07, 2026 10:41:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 07, 2026 10:41:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 07, 2026 10:41:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 07, 2026 10:41:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 07, 2026 10:41:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 07, 2026 10:41:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 07, 2026 10:41:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 07, 2026 10:41:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 07, 2026 10:41:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 07, 2026 10:41:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 07, 2026 10:41:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 07, 2026 10:41:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 07, 2026 10:41:54 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 07, 2026 10:41:55 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260807 22:41:55.886094 23377 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.22.212.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.22.212.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.22.212.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/krb5kdc/rangerkms_127.22.212.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.22.212.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/krb5kdc/rangerkms_127.22.212.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.22.212.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.22.212.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.22.212.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/krb5kdc/HTTP_127.22.212.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.22.212.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/krb5kdc/HTTP_127.22.212.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 07 22:41:55 dist-test-slave-2d19 krb5kdc[7898](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142515, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260807 22:41:55.995000 23377 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260807 22:41:56.006569 23377 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260807 22:41:56.943005 23377 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260807 22:41:56.943096 23377 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ranger-kms
I20260807 22:41:56.943120 23377 mini_ranger_kms.cc:227] Using postgres at 127.22.212.84:42097
2026-08-07 22:41:57,173 [I] DB FLAVOR :POSTGRES
2026-08-07 22:41:57,173 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 22:41:57,173 [I] Checking connection
2026-08-07 22:41:57,173 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.212.84:42097/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-07 22:41:57,453 [I] connection success
2026-08-07 22:41:57,454 [I] --------- Verifying Ranger DB tables ---------
2026-08-07 22:41:57,454 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-07 22:41:57,454 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.212.84:42097/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-07 22:41:57,693 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-07 22:41:57,693 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 22:41:57,694 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-07 22:41:57,694 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.212.84:42097/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-07 22:41:57,964 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260807 22:41:58.455689 23377 mini_ranger_kms.cc:310] Created kms service
I20260807 22:41:58.662267 23377 mini_ranger_kms.cc:326] Created kudu user
I20260807 22:41:58.709707 23377 mini_ranger_kms.cc:343] Created rangerkms user
Aug 07 22:41:58 dist-test-slave-2d19 krb5kdc[7898](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142515, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.22.212.84@KRBTEST.COM
I20260807 22:41:59.098701 23377 mini_ranger_kms.cc:384] Added ranger policy
I20260807 22:41:59.098991 23377 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ranger-kms:/tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260807 22:41:59.099030 23377 mini_ranger_kms.cc:240] Using host: 127.22.212.84
I20260807 22:41:59.103278 23377 mini_ranger_kms.cc:276] Ranger KMS PID: 8558
I20260807 22:41:59.103406 23377 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.22.212.84:53811
Aug 07, 2026 10:42:00 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 10:42:00 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 10:42:00 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 07, 2026 10:42:00 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 07, 2026 10:42:01 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ranger-kms/ews/webapp].
Aug 07, 2026 10:42:01 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 07 22:42:01 dist-test-slave-2d19 krb5kdc[7898](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786142521, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.22.212.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:42:01.930339 23377 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.935s user 0.011s sys 0.203s
I20260807 22:42:01.930457 23377 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260807 22:42:01.930543 23377 mini_ranger_kms.cc:401] 127.22.212.84:53811/kms/v1/keys
Aug 07 22:42:02 dist-test-slave-2d19 krb5kdc[7898](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142521, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.22.212.84@KRBTEST.COM for HTTP/127.22.212.84@KRBTEST.COM
Aug 07 22:42:02 dist-test-slave-2d19 krb5kdc[7898](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142521, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.22.212.84@KRBTEST.COM for HTTP/127.22.212.84@KRBTEST.COM
Aug 07 22:42:05 dist-test-slave-2d19 krb5kdc[7898](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142525, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.22.212.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
I20260807 22:42:05.325510 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:35363
--webserver_interface=127.22.212.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:46135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:35363
--ranger_config_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.212.84:53811/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:42:05.460269 8645 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:42:05.460491 8645 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:42:05.460515 8645 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:42:05.461725 8645 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:42:05.461774 8645 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:42:05.461788 8645 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:42:05.461802 8645 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:42:05.461853 8645 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:42:05.463644 8645 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:46135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/master-0/wal
--ranger_kms_url=127.22.212.84:53811/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:35363
--ranger_config_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:35363
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8645
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:42:05.463904 8645 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:42:05.464176 8645 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:42:05.469780 8653 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:05.469825 8645 server_base.cc:1034] running on GCE node
W20260807 22:42:05.469859 8654 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:05.469825 8656 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:05.470314 8645 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:42:05.470623 8645 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:42:05.471791 8645 hybrid_clock.cc:648] HybridClock initialized: now 1786142525471770 us; error 41 us; skew 500 ppm
Aug 07 22:42:05 dist-test-slave-2d19 krb5kdc[7898](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142525, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:42:05.479884 8645 init.cc:377] Logged in from keytab as kudu/127.22.212.126@KRBTEST.COM (short username kudu)
I20260807 22:42:05.480448 8645 webserver.cc:460] Webserver started at http://127.22.212.126:43939/ using document root <none> and password file <none>
I20260807 22:42:05.480705 8645 fs_manager.cc:359] Metadata directory not provided
I20260807 22:42:05.480768 8645 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:42:05.480933 8645 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 22:42:05 dist-test-slave-2d19 krb5kdc[7898](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142525, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for HTTP/127.22.212.84@KRBTEST.COM
I20260807 22:42:05.544771 8645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "b27c8f74787844f294735c75c748e6d9"
format_stamp: "Formatted at 2026-08-07 22:42:05 on dist-test-slave-2d19"
server_key: "1e4df10da9905a542e8520269b8efbc2"
server_key_iv: "1525aa939f09db0ec16fecd09fa39bde"
server_key_version: "kuduclusterkey@0"
I20260807 22:42:05.545361 8645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "b27c8f74787844f294735c75c748e6d9"
format_stamp: "Formatted at 2026-08-07 22:42:05 on dist-test-slave-2d19"
server_key: "1e4df10da9905a542e8520269b8efbc2"
server_key_iv: "1525aa939f09db0ec16fecd09fa39bde"
server_key_version: "kuduclusterkey@0"
I20260807 22:42:05.548481 8645 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260807 22:42:05.569674 8670 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:05.569890 8645 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:42:05.569996 8645 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "b27c8f74787844f294735c75c748e6d9"
format_stamp: "Formatted at 2026-08-07 22:42:05 on dist-test-slave-2d19"
server_key: "1e4df10da9905a542e8520269b8efbc2"
server_key_iv: "1525aa939f09db0ec16fecd09fa39bde"
server_key_version: "kuduclusterkey@0"
I20260807 22:42:05.570111 8645 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:42:05.590140 8645 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:42:05.592494 8645 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:42:05.592687 8645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:42:05.601696 8645 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:35363
I20260807 22:42:05.601773 8753 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:35363 every 8 connection(s)
I20260807 22:42:05.602202 8645 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:42:05.603188 8755 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:42:05.605345 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 8645
I20260807 22:42:05.605450 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:42:05.605646 23377 external_mini_cluster.cc:1428] Setting key 3467db2783ba707e04af0a0cb1a4d1e8
I20260807 22:42:05.606796 8755 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b27c8f74787844f294735c75c748e6d9: Bootstrap starting.
I20260807 22:42:05.608134 8755 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b27c8f74787844f294735c75c748e6d9: Neither blocks nor log segments found. Creating new log.
I20260807 22:42:05.609014 8755 log.cc:824] T 00000000000000000000000000000000 P b27c8f74787844f294735c75c748e6d9: Log is configured to *not* fsync() on all Append() calls
I20260807 22:42:05.609838 8755 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b27c8f74787844f294735c75c748e6d9: No bootstrap required, opened a new log
I20260807 22:42:05.613240 8755 raft_consensus.cc:348] T 00000000000000000000000000000000 P b27c8f74787844f294735c75c748e6d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b27c8f74787844f294735c75c748e6d9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35363 } }
I20260807 22:42:05.613384 8755 raft_consensus.cc:374] T 00000000000000000000000000000000 P b27c8f74787844f294735c75c748e6d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:42:05.613407 8755 raft_consensus.cc:729] T 00000000000000000000000000000000 P b27c8f74787844f294735c75c748e6d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b27c8f74787844f294735c75c748e6d9, State: Initialized, Role: FOLLOWER
I20260807 22:42:05.613556 8755 consensus_queue.cc:260] T 00000000000000000000000000000000 P b27c8f74787844f294735c75c748e6d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b27c8f74787844f294735c75c748e6d9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35363 } }
I20260807 22:42:05.613638 8755 raft_consensus.cc:388] T 00000000000000000000000000000000 P b27c8f74787844f294735c75c748e6d9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:42:05.613683 8755 raft_consensus.cc:482] T 00000000000000000000000000000000 P b27c8f74787844f294735c75c748e6d9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:42:05.613739 8755 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b27c8f74787844f294735c75c748e6d9 [term 0 FOLLOWER]: Advancing to term 1
Aug 07 22:42:05 dist-test-slave-2d19 krb5kdc[7898](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142525, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:42:05.614734 8755 raft_consensus.cc:504] T 00000000000000000000000000000000 P b27c8f74787844f294735c75c748e6d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b27c8f74787844f294735c75c748e6d9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35363 } }
I20260807 22:42:05.614862 8755 leader_election.cc:302] T 00000000000000000000000000000000 P b27c8f74787844f294735c75c748e6d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b27c8f74787844f294735c75c748e6d9; no voters:
I20260807 22:42:05.615072 8755 leader_election.cc:288] T 00000000000000000000000000000000 P b27c8f74787844f294735c75c748e6d9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:42:05.615118 8769 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b27c8f74787844f294735c75c748e6d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:42:05.615325 8769 raft_consensus.cc:686] T 00000000000000000000000000000000 P b27c8f74787844f294735c75c748e6d9 [term 1 LEADER]: Becoming Leader. State: Replica: b27c8f74787844f294735c75c748e6d9, State: Running, Role: LEADER
I20260807 22:42:05.615543 8755 sys_catalog.cc:564] T 00000000000000000000000000000000 P b27c8f74787844f294735c75c748e6d9 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:42:05.615550 8769 consensus_queue.cc:237] T 00000000000000000000000000000000 P b27c8f74787844f294735c75c748e6d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b27c8f74787844f294735c75c748e6d9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35363 } }
I20260807 22:42:05.616495 8770 sys_catalog.cc:455] T 00000000000000000000000000000000 P b27c8f74787844f294735c75c748e6d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b27c8f74787844f294735c75c748e6d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b27c8f74787844f294735c75c748e6d9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35363 } } }
I20260807 22:42:05.616596 8770 sys_catalog.cc:458] T 00000000000000000000000000000000 P b27c8f74787844f294735c75c748e6d9 [sys.catalog]: This master's current role is: LEADER
I20260807 22:42:05.617056 8771 sys_catalog.cc:455] T 00000000000000000000000000000000 P b27c8f74787844f294735c75c748e6d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b27c8f74787844f294735c75c748e6d9. Latest consensus state: current_term: 1 leader_uuid: "b27c8f74787844f294735c75c748e6d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b27c8f74787844f294735c75c748e6d9" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35363 } } }
I20260807 22:42:05.617162 8771 sys_catalog.cc:458] T 00000000000000000000000000000000 P b27c8f74787844f294735c75c748e6d9 [sys.catalog]: This master's current role is: LEADER
I20260807 22:42:05.617705 8784 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:42:05.618445 8784 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:42:05.618988 8755 ranger_client.cc:318] Using new properties file: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 22:42:05.627974 8761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:05.606207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56758 (local address 127.22.212.126:35363)
0807 22:42:05.606398 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:05.606408 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:05.606446 (+ 38us) server_negotiation.cc:407] Connection header received
0807 22:42:05.607035 (+ 589us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:05.607044 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:05.607110 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:05.607270 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:05.608481 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:05.610272 (+ 1791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:05.611028 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:05.611943 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:05.612083 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:05.615102 (+ 3019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:05.615106 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:05.615106 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:05.615128 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:05.618473 (+ 3345us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:05.618864 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:05.618868 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:05.618868 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:05.619019 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:05.619254 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:05.619254 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:05.619255 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:05.619584 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:05.623951 (+ 4367us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:05.624659 (+ 708us) server_negotiation.cc:299] Negotiation successful
0807 22:42:05.627333 (+ 2674us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":75,"threads_started":1}
I20260807 22:42:05.633105 8784 catalog_manager.cc:1347] Generated new cluster ID: 592ea45cc2e7422d9ff3053a65931bb5
I20260807 22:42:05.633185 8784 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:42:05.646780 8784 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:42:05.647346 8784 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:42:05.652820 8784 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b27c8f74787844f294735c75c748e6d9: Generated new TSK 0
I20260807 22:42:05.653007 8784 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.212.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab.
Entry for principal kudu/127.22.212.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab.
I20260807 22:42:06.560209 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.212.84:53811/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.65:0
--local_ip_for_outbound_sockets=127.22.212.65
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:35363
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:46135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:42:06.680925 8837 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:42:06.681173 8837 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:42:06.681217 8837 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:42:06.682382 8837 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:42:06.682446 8837 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:42:06.682489 8837 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.65
I20260807 22:42:06.684108 8837 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:46135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.22.212.84:53811/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:35363
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8837
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.65
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:42:06.684413 8837 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:42:06.684654 8837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:42:06.690393 8843 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:06.690410 8846 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:06.690599 8837 server_base.cc:1034] running on GCE node
W20260807 22:42:06.690781 8850 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:06.691030 8837 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:42:06.691309 8837 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:42:06.692473 8837 hybrid_clock.cc:648] HybridClock initialized: now 1786142526692448 us; error 39 us; skew 500 ppm
Aug 07 22:42:06 dist-test-slave-2d19 krb5kdc[7898](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142526, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:42:06.695709 8837 init.cc:377] Logged in from keytab as kudu/127.22.212.65@KRBTEST.COM (short username kudu)
I20260807 22:42:06.696143 8837 webserver.cc:460] Webserver started at http://127.22.212.65:36049/ using document root <none> and password file <none>
I20260807 22:42:06.696429 8837 fs_manager.cc:359] Metadata directory not provided
I20260807 22:42:06.696502 8837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:42:06.696594 8837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 22:42:06 dist-test-slave-2d19 krb5kdc[7898](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142526, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for HTTP/127.22.212.84@KRBTEST.COM
I20260807 22:42:06.713590 8837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-0/data/instance:
uuid: "e594cc25d2994c7e91df7c6e8e3780a3"
format_stamp: "Formatted at 2026-08-07 22:42:06 on dist-test-slave-2d19"
server_key: "603b2d1e3a8ac628ad901c50d9c31847"
server_key_iv: "8deed07901f91c2f520657eadb77f5aa"
server_key_version: "kuduclusterkey@0"
I20260807 22:42:06.714306 8837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance:
uuid: "e594cc25d2994c7e91df7c6e8e3780a3"
format_stamp: "Formatted at 2026-08-07 22:42:06 on dist-test-slave-2d19"
server_key: "603b2d1e3a8ac628ad901c50d9c31847"
server_key_iv: "8deed07901f91c2f520657eadb77f5aa"
server_key_version: "kuduclusterkey@0"
I20260807 22:42:06.716889 8837 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:42:06.734411 8863 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:06.734602 8837 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260807 22:42:06.734699 8837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-0/wal
uuid: "e594cc25d2994c7e91df7c6e8e3780a3"
format_stamp: "Formatted at 2026-08-07 22:42:06 on dist-test-slave-2d19"
server_key: "603b2d1e3a8ac628ad901c50d9c31847"
server_key_iv: "8deed07901f91c2f520657eadb77f5aa"
server_key_version: "kuduclusterkey@0"
I20260807 22:42:06.734797 8837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:42:06.750083 8837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:42:06.752583 8837 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:42:06.752730 8837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:42:06.753068 8837 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:42:06.753495 8837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:42:06.753553 8837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:06.753584 8837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:42:06.753643 8837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:06.767215 8837 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.65:37667
I20260807 22:42:06.767879 8837 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
I20260807 22:42:06.771770 9047 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.65:37667 every 8 connection(s)
I20260807 22:42:06.773336 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 8837
I20260807 22:42:06.773442 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance
I20260807 22:42:06.773631 23377 external_mini_cluster.cc:1428] Setting key 4a11073410a0ec0287ba367af3e9326d
Aug 07 22:42:06 dist-test-slave-2d19 krb5kdc[7898](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142526, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.212.66@KRBTEST.COM; defaulting to no policy
I20260807 22:42:06.787372 9055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:06.772663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35363 (local address 127.22.212.65:40915)
0807 22:42:06.773218 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:06.773271 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 22:42:06.774561 (+ 1290us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:42:06.774981 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:42:06.774986 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:42:06.775410 (+ 424us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:42:06.775865 (+ 455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:06.775873 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:06.777242 (+ 1369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:06.777243 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:06.778774 (+ 1531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:06.778777 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:06.779346 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:06.779347 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:06.779547 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:06.780305 (+ 758us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:42:06.780318 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:42:06.782572 (+ 2254us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:42:06.785268 (+ 2696us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:06.785276 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:06.785279 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:06.785628 (+ 349us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:06.785929 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:06.785930 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:06.785930 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:06.786100 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:06.786515 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:42:06.786522 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:42:06.786747 (+ 225us) client_negotiation.cc:769] Sending connection context
0807 22:42:06.786860 (+ 113us) client_negotiation.cc:240] Negotiation successful
0807 22:42:06.787031 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":158,"threads_started":1}
I20260807 22:42:06.787740 9054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:06.772698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:40915 (local address 127.22.212.126:35363)
0807 22:42:06.774753 (+ 2055us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:06.774756 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:06.774764 (+ 8us) server_negotiation.cc:407] Connection header received
0807 22:42:06.774790 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:06.774791 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:06.774806 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:06.775975 (+ 1169us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:06.776020 (+ 45us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:06.777078 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:06.778890 (+ 1812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:06.779203 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:06.779248 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:06.782711 (+ 3463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:06.782712 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:06.782713 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:06.782722 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:06.785166 (+ 2444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:06.785736 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:06.785738 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:06.785738 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:06.785828 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:06.786191 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:06.786192 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:06.786193 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:06.786390 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:06.786484 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:06.787538 (+ 1054us) server_negotiation.cc:299] Negotiation successful
0807 22:42:06.787638 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2028,"thread_start_us":112,"threads_started":1}
I20260807 22:42:06.788323 9049 heartbeater.cc:347] Connected to a master server at 127.22.212.126:35363
I20260807 22:42:06.788431 9049 heartbeater.cc:464] Registering TS with master...
I20260807 22:42:06.788643 9049 heartbeater.cc:511] Master 127.22.212.126:35363 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.66@KRBTEST.COM" created.
I20260807 22:42:06.791618 8698 ts_manager.cc:194] Registered new tserver with Master: e594cc25d2994c7e91df7c6e8e3780a3 (127.22.212.65:37667)
I20260807 22:42:06.792385 8698 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.65@KRBTEST.COM'} at 127.22.212.65:40915
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab.
Entry for principal kudu/127.22.212.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab.
I20260807 22:42:06.817478 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.212.84:53811/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.66:0
--local_ip_for_outbound_sockets=127.22.212.66
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:35363
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:46135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:42:06.980912 9062 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:42:06.981308 9062 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:42:06.981395 9062 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:42:06.983394 9062 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:42:06.983566 9062 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:42:06.983659 9062 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.66
I20260807 22:42:06.986512 9062 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:46135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.22.212.84:53811/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:35363
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9062
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.66
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:42:06.987048 9062 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:42:06.987393 9062 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:42:06.996295 9073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:06.996996 9071 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:06.997730 9077 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:06.997982 9062 server_base.cc:1034] running on GCE node
I20260807 22:42:06.998327 9062 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:42:06.998615 9062 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:42:06.999763 9062 hybrid_clock.cc:648] HybridClock initialized: now 1786142526999742 us; error 34 us; skew 500 ppm
Aug 07 22:42:06 dist-test-slave-2d19 krb5kdc[7898](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142526, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:42:07.004218 9062 init.cc:377] Logged in from keytab as kudu/127.22.212.66@KRBTEST.COM (short username kudu)
I20260807 22:42:07.004938 9062 webserver.cc:460] Webserver started at http://127.22.212.66:42377/ using document root <none> and password file <none>
I20260807 22:42:07.005307 9062 fs_manager.cc:359] Metadata directory not provided
I20260807 22:42:07.005466 9062 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:42:07.005739 9062 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 22:42:07 dist-test-slave-2d19 krb5kdc[7898](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142526, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for HTTP/127.22.212.84@KRBTEST.COM
I20260807 22:42:07.031435 9062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-1/data/instance:
uuid: "d798c9cb31f94461871e81bbfb648626"
format_stamp: "Formatted at 2026-08-07 22:42:07 on dist-test-slave-2d19"
server_key: "4e54bacbc640936b9e9428157a423a78"
server_key_iv: "8ad338b3a3a59128d2c4e37003de9245"
server_key_version: "kuduclusterkey@0"
I20260807 22:42:07.032124 9062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance:
uuid: "d798c9cb31f94461871e81bbfb648626"
format_stamp: "Formatted at 2026-08-07 22:42:07 on dist-test-slave-2d19"
server_key: "4e54bacbc640936b9e9428157a423a78"
server_key_iv: "8ad338b3a3a59128d2c4e37003de9245"
server_key_version: "kuduclusterkey@0"
I20260807 22:42:07.037277 9062 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.000s
I20260807 22:42:07.062554 9092 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:07.062840 9062 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.001s sys 0.000s
I20260807 22:42:07.063001 9062 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-1/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-1/wal
uuid: "d798c9cb31f94461871e81bbfb648626"
format_stamp: "Formatted at 2026-08-07 22:42:07 on dist-test-slave-2d19"
server_key: "4e54bacbc640936b9e9428157a423a78"
server_key_iv: "8ad338b3a3a59128d2c4e37003de9245"
server_key_version: "kuduclusterkey@0"
I20260807 22:42:07.063118 9062 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
Aug 07 22:42:07 dist-test-slave-2d19 krb5kdc[7898](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786142527, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:42:07.102818 9062 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:42:07.105770 9062 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:42:07.105964 9062 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:42:07.106297 9062 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:42:07.106812 9062 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:42:07.106876 9062 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:07.106961 9062 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:42:07.106993 9062 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:07.123634 9062 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.66:46399
I20260807 22:42:07.124207 9062 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
I20260807 22:42:07.126107 9265 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.66:46399 every 8 connection(s)
I20260807 22:42:07.126642 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 9062
I20260807 22:42:07.126747 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance
I20260807 22:42:07.126931 23377 external_mini_cluster.cc:1428] Setting key 647e90e1ec6ab941b4be023f50681052
Aug 07 22:42:07 dist-test-slave-2d19 krb5kdc[7898](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142526, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.212.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.67@KRBTEST.COM" created.
I20260807 22:42:07.158490 9054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:07.131116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:34433 (local address 127.22.212.126:35363)
0807 22:42:07.131164 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:07.131167 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:07.131672 (+ 505us) server_negotiation.cc:407] Connection header received
0807 22:42:07.134208 (+ 2536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:07.134210 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:07.134228 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:07.134259 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:07.135156 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:07.135919 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:07.137685 (+ 1766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:07.137999 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:07.138050 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:07.147889 (+ 9839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:07.147891 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:07.147892 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:07.147911 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:07.150035 (+ 2124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:07.157039 (+ 7004us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:07.157041 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:07.157042 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:07.157136 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:07.157507 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:07.157508 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:07.157509 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:07.157663 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:07.157724 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:07.158239 (+ 515us) server_negotiation.cc:299] Negotiation successful
0807 22:42:07.158381 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 22:42:07.159420 9276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:07.130744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35363 (local address 127.22.212.66:34433)
0807 22:42:07.131510 (+ 766us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:07.131560 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 22:42:07.134072 (+ 2512us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:42:07.134480 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:42:07.134485 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:42:07.134746 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:42:07.135034 (+ 288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:07.135041 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:07.136047 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:07.136048 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:07.137575 (+ 1527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:07.137578 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:07.138154 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:07.138154 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:07.138356 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:07.144397 (+ 6041us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:42:07.144410 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:42:07.147706 (+ 3296us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:42:07.151611 (+ 3905us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:07.151625 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:07.151628 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:07.151997 (+ 369us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:07.157217 (+ 5220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:07.157218 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:07.157219 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:07.157424 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:07.157767 (+ 343us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:42:07.157776 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:42:07.157976 (+ 200us) client_negotiation.cc:769] Sending connection context
0807 22:42:07.158916 (+ 940us) client_negotiation.cc:240] Negotiation successful
0807 22:42:07.159128 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":707,"thread_start_us":159,"threads_started":1}
I20260807 22:42:07.160427 9267 heartbeater.cc:347] Connected to a master server at 127.22.212.126:35363
I20260807 22:42:07.160534 9267 heartbeater.cc:464] Registering TS with master...
I20260807 22:42:07.160748 9267 heartbeater.cc:511] Master 127.22.212.126:35363 requested a full tablet report, sending...
I20260807 22:42:07.161223 8698 ts_manager.cc:194] Registered new tserver with Master: d798c9cb31f94461871e81bbfb648626 (127.22.212.66:46399)
I20260807 22:42:07.161715 8698 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.66@KRBTEST.COM'} at 127.22.212.66:34433
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab.
Entry for principal kudu/127.22.212.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab.
I20260807 22:42:07.179492 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.212.84:53811/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.67:0
--local_ip_for_outbound_sockets=127.22.212.67
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:35363
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:46135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:42:07.342075 9278 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:42:07.342432 9278 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:42:07.342518 9278 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:42:07.344210 9278 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:42:07.344457 9278 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:42:07.344556 9278 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.67
I20260807 22:42:07.346911 9278 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:46135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.22.212.84:53811/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:35363
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9278
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.67
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:42:07.347407 9278 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:42:07.347733 9278 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:42:07.355873 9287 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:07.356302 9286 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:07.357560 9278 server_base.cc:1034] running on GCE node
W20260807 22:42:07.363227 9289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:07.363685 9278 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:42:07.364101 9278 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:42:07.365320 9278 hybrid_clock.cc:648] HybridClock initialized: now 1786142527365286 us; error 39 us; skew 500 ppm
Aug 07 22:42:07 dist-test-slave-2d19 krb5kdc[7898](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142527, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:42:07.370512 9278 init.cc:377] Logged in from keytab as kudu/127.22.212.67@KRBTEST.COM (short username kudu)
I20260807 22:42:07.371295 9278 webserver.cc:460] Webserver started at http://127.22.212.67:42169/ using document root <none> and password file <none>
I20260807 22:42:07.371662 9278 fs_manager.cc:359] Metadata directory not provided
I20260807 22:42:07.371807 9278 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:42:07.372165 9278 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 22:42:07 dist-test-slave-2d19 krb5kdc[7898](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142527, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for HTTP/127.22.212.84@KRBTEST.COM
I20260807 22:42:07.399675 9278 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-2/data/instance:
uuid: "1ee5a370f8ac4ea1967ba6770c30229f"
format_stamp: "Formatted at 2026-08-07 22:42:07 on dist-test-slave-2d19"
server_key: "714f97839920a70b54a8d3f2dee6282f"
server_key_iv: "c941f7d8d5149d3cbc14b2b09802978e"
server_key_version: "kuduclusterkey@0"
I20260807 22:42:07.403512 9278 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance:
uuid: "1ee5a370f8ac4ea1967ba6770c30229f"
format_stamp: "Formatted at 2026-08-07 22:42:07 on dist-test-slave-2d19"
server_key: "714f97839920a70b54a8d3f2dee6282f"
server_key_iv: "c941f7d8d5149d3cbc14b2b09802978e"
server_key_version: "kuduclusterkey@0"
I20260807 22:42:07.406656 9278 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.002s
I20260807 22:42:07.430261 9298 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:07.430591 9278 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.000s
I20260807 22:42:07.430704 9278 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-2/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-2/wal
uuid: "1ee5a370f8ac4ea1967ba6770c30229f"
format_stamp: "Formatted at 2026-08-07 22:42:07 on dist-test-slave-2d19"
server_key: "714f97839920a70b54a8d3f2dee6282f"
server_key_iv: "c941f7d8d5149d3cbc14b2b09802978e"
server_key_version: "kuduclusterkey@0"
I20260807 22:42:07.430814 9278 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:42:07.446848 9278 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:42:07.449916 9278 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:42:07.450129 9278 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:42:07.450495 9278 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:42:07.451010 9278 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:42:07.451083 9278 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:07.451124 9278 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:42:07.451149 9278 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:07.469338 9278 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.67:33595
I20260807 22:42:07.469867 9278 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
I20260807 22:42:07.472177 9477 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.67:33595 every 8 connection(s)
I20260807 22:42:07.477509 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 9278
I20260807 22:42:07.477612 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance
I20260807 22:42:07.477794 23377 external_mini_cluster.cc:1428] Setting key 5b65bda9b30a8d217e82f9d8f4cc0205
Aug 07 22:42:07 dist-test-slave-2d19 krb5kdc[7898](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142527, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:42:07.488112 9054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:07.473410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:35595 (local address 127.22.212.126:35363)
0807 22:42:07.473465 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:07.473467 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:07.473781 (+ 314us) server_negotiation.cc:407] Connection header received
0807 22:42:07.474797 (+ 1016us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:07.474799 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:07.474811 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:07.474846 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:07.476067 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:07.476926 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:07.479573 (+ 2647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:07.479901 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:07.479955 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:07.483611 (+ 3656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:07.483612 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:07.483613 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:07.483621 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:07.485990 (+ 2369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:07.486744 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:07.486746 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:07.486746 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:07.486833 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:07.487331 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:07.487332 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:07.487333 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:07.487476 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:07.487525 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:07.487907 (+ 382us) server_negotiation.cc:299] Negotiation successful
0807 22:42:07.488009 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260807 22:42:07.488819 9483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:07.473047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35363 (local address 127.22.212.67:35595)
0807 22:42:07.473618 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:07.473668 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 22:42:07.474666 (+ 998us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:42:07.475052 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:42:07.475056 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:42:07.475495 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:42:07.475944 (+ 449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:07.475953 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:07.477049 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:07.477050 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:07.479465 (+ 2415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:07.479469 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:07.480057 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:07.480058 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:07.480230 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:07.481021 (+ 791us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:42:07.481041 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:42:07.483454 (+ 2413us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:42:07.486161 (+ 2707us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:07.486169 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:07.486171 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:07.486616 (+ 445us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:07.486933 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:07.486934 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:07.486935 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:07.487240 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:07.487577 (+ 337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:42:07.487584 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:42:07.487752 (+ 168us) client_negotiation.cc:769] Sending connection context
0807 22:42:07.488377 (+ 625us) client_negotiation.cc:240] Negotiation successful
0807 22:42:07.488549 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":151,"threads_started":1}
I20260807 22:42:07.489542 9479 heartbeater.cc:347] Connected to a master server at 127.22.212.126:35363
I20260807 22:42:07.489657 9479 heartbeater.cc:464] Registering TS with master...
I20260807 22:42:07.489850 9479 heartbeater.cc:511] Master 127.22.212.126:35363 requested a full tablet report, sending...
I20260807 22:42:07.490319 8698 ts_manager.cc:194] Registered new tserver with Master: 1ee5a370f8ac4ea1967ba6770c30229f (127.22.212.67:33595)
I20260807 22:42:07.490713 8698 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.67@KRBTEST.COM'} at 127.22.212.67:35595
I20260807 22:42:07.500990 23377 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:42:07.511247 9054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:07.503460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43572 (local address 127.22.212.126:35363)
0807 22:42:07.503506 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:07.503508 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:07.503870 (+ 362us) server_negotiation.cc:407] Connection header received
0807 22:42:07.503991 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:07.503992 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:07.504005 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:07.504037 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:07.504991 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:07.505768 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:07.506781 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:07.506989 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:07.507071 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:07.508489 (+ 1418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:07.508490 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:07.508490 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:07.508499 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:07.509971 (+ 1472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:07.510353 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:07.510355 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:07.510356 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:07.510420 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:07.510633 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:07.510634 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:07.510634 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:07.510748 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:07.510853 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:07.510987 (+ 134us) server_negotiation.cc:299] Negotiation successful
0807 22:42:07.511122 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 22:42:07.513242 8698 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43572:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:42:07.515064 8698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:42:07.525950 9501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:07.518171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.66:46399 (local address 127.0.0.1:59932)
0807 22:42:07.520504 (+ 2333us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:07.520513 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 22:42:07.520592 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:42:07.521050 (+ 458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:42:07.521054 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:42:07.521057 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:42:07.521142 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:07.521144 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:07.522799 (+ 1655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:07.522800 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:07.524486 (+ 1686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:07.524488 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:07.525642 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:07.525643 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:07.525726 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:07.525741 (+ 15us) client_negotiation.cc:769] Sending connection context
0807 22:42:07.525785 (+ 44us) client_negotiation.cc:240] Negotiation successful
0807 22:42:07.525834 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2304,"thread_start_us":142,"threads_started":1}
I20260807 22:42:07.526387 9513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:07.518990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59932 (local address 127.22.212.66:46399)
0807 22:42:07.519287 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:07.519292 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:07.520592 (+ 1300us) server_negotiation.cc:407] Connection header received
0807 22:42:07.520702 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:07.520705 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:07.520733 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:07.520817 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:42:07.521248 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:07.522696 (+ 1448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:07.524655 (+ 1959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:07.525538 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:07.526083 (+ 545us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:07.526233 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:07.526263 (+ 30us) server_negotiation.cc:299] Negotiation successful
0807 22:42:07.526301 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":244,"thread_start_us":171,"threads_started":1}
I20260807 22:42:07.527181 9166 tablet_service.cc:1467] Processing CreateTablet for tablet 183f426e8aaf4df2b7538ad7e3e9049d (DEFAULT_TABLE table=test-table [id=a1c6e549f2f94b1e8910fdb28a30c8fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:42:07.527607 9166 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 183f426e8aaf4df2b7538ad7e3e9049d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:42:07.529039 9500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:07.518511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:37667 (local address 127.0.0.1:39610)
0807 22:42:07.520727 (+ 2216us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:07.520737 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 22:42:07.520785 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:42:07.521081 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:42:07.521082 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:42:07.521083 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:42:07.521645 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:07.521649 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:07.523393 (+ 1744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:07.523394 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:07.527490 (+ 4096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:07.527493 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:07.528689 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:07.528690 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:07.528772 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:07.528776 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 22:42:07.528846 (+ 70us) client_negotiation.cc:240] Negotiation successful
0807 22:42:07.528906 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2185,"mutex_wait_us":384,"thread_start_us":125,"threads_started":1}
I20260807 22:42:07.529559 9511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:07.518951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39610 (local address 127.22.212.65:37667)
0807 22:42:07.520380 (+ 1429us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:07.520385 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:07.520857 (+ 472us) server_negotiation.cc:407] Connection header received
0807 22:42:07.520907 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:07.520909 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:07.520925 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:07.521000 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:42:07.521748 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:07.522955 (+ 1207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:07.527589 (+ 4634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:07.528478 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:07.528572 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:07.528649 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:07.529386 (+ 737us) server_negotiation.cc:299] Negotiation successful
0807 22:42:07.529463 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1390,"thread_start_us":72,"threads_started":1}
I20260807 22:42:07.532461 8911 tablet_service.cc:1467] Processing CreateTablet for tablet 183f426e8aaf4df2b7538ad7e3e9049d (DEFAULT_TABLE table=test-table [id=a1c6e549f2f94b1e8910fdb28a30c8fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:42:07.532965 8911 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 183f426e8aaf4df2b7538ad7e3e9049d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:42:07.533500 9502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:07.518165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.67:33595 (local address 127.0.0.1:50504)
0807 22:42:07.518762 (+ 597us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:07.518839 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0807 22:42:07.518910 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:42:07.524398 (+ 5488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:42:07.524399 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:42:07.524401 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:42:07.524474 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:07.524475 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:07.529921 (+ 5446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:07.529936 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:07.531143 (+ 1207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:07.531146 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:07.533222 (+ 2076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:07.533223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:07.533291 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:07.533295 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 22:42:07.533382 (+ 87us) client_negotiation.cc:240] Negotiation successful
0807 22:42:07.533430 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":533,"thread_start_us":138,"threads_started":1}
I20260807 22:42:07.533560 9509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:07.518562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50504 (local address 127.22.212.67:33595)
0807 22:42:07.523210 (+ 4648us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:07.523215 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:07.523226 (+ 11us) server_negotiation.cc:407] Connection header received
0807 22:42:07.523281 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:07.523284 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:07.523300 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:07.524583 (+ 1283us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:42:07.524706 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:07.525850 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:07.531808 (+ 5958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:07.533140 (+ 1332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:07.533222 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:07.533373 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:07.533402 (+ 29us) server_negotiation.cc:299] Negotiation successful
0807 22:42:07.533440 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4589,"thread_start_us":129,"threads_started":1}
I20260807 22:42:07.534204 9378 tablet_service.cc:1467] Processing CreateTablet for tablet 183f426e8aaf4df2b7538ad7e3e9049d (DEFAULT_TABLE table=test-table [id=a1c6e549f2f94b1e8910fdb28a30c8fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:42:07.534526 9378 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 183f426e8aaf4df2b7538ad7e3e9049d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:42:07.538460 9516 tablet_bootstrap.cc:492] T 183f426e8aaf4df2b7538ad7e3e9049d P e594cc25d2994c7e91df7c6e8e3780a3: Bootstrap starting.
I20260807 22:42:07.539839 9516 tablet_bootstrap.cc:654] T 183f426e8aaf4df2b7538ad7e3e9049d P e594cc25d2994c7e91df7c6e8e3780a3: Neither blocks nor log segments found. Creating new log.
I20260807 22:42:07.540531 9516 log.cc:824] T 183f426e8aaf4df2b7538ad7e3e9049d P e594cc25d2994c7e91df7c6e8e3780a3: Log is configured to *not* fsync() on all Append() calls
I20260807 22:42:07.541369 9518 tablet_bootstrap.cc:492] T 183f426e8aaf4df2b7538ad7e3e9049d P 1ee5a370f8ac4ea1967ba6770c30229f: Bootstrap starting.
I20260807 22:42:07.541870 9516 tablet_bootstrap.cc:492] T 183f426e8aaf4df2b7538ad7e3e9049d P e594cc25d2994c7e91df7c6e8e3780a3: No bootstrap required, opened a new log
I20260807 22:42:07.541966 9516 ts_tablet_manager.cc:1397] T 183f426e8aaf4df2b7538ad7e3e9049d P e594cc25d2994c7e91df7c6e8e3780a3: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260807 22:42:07.546167 9518 tablet_bootstrap.cc:654] T 183f426e8aaf4df2b7538ad7e3e9049d P 1ee5a370f8ac4ea1967ba6770c30229f: Neither blocks nor log segments found. Creating new log.
I20260807 22:42:07.546018 9516 raft_consensus.cc:348] T 183f426e8aaf4df2b7538ad7e3e9049d P e594cc25d2994c7e91df7c6e8e3780a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ee5a370f8ac4ea1967ba6770c30229f" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 33595 } } peers { permanent_uuid: "d798c9cb31f94461871e81bbfb648626" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46399 } } peers { permanent_uuid: "e594cc25d2994c7e91df7c6e8e3780a3" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 37667 } }
I20260807 22:42:07.546213 9516 raft_consensus.cc:374] T 183f426e8aaf4df2b7538ad7e3e9049d P e594cc25d2994c7e91df7c6e8e3780a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:42:07.546258 9516 raft_consensus.cc:729] T 183f426e8aaf4df2b7538ad7e3e9049d P e594cc25d2994c7e91df7c6e8e3780a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e594cc25d2994c7e91df7c6e8e3780a3, State: Initialized, Role: FOLLOWER
I20260807 22:42:07.546398 9516 consensus_queue.cc:260] T 183f426e8aaf4df2b7538ad7e3e9049d P e594cc25d2994c7e91df7c6e8e3780a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ee5a370f8ac4ea1967ba6770c30229f" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 33595 } } peers { permanent_uuid: "d798c9cb31f94461871e81bbfb648626" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46399 } } peers { permanent_uuid: "e594cc25d2994c7e91df7c6e8e3780a3" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 37667 } }
I20260807 22:42:07.546842 9516 ts_tablet_manager.cc:1428] T 183f426e8aaf4df2b7538ad7e3e9049d P e594cc25d2994c7e91df7c6e8e3780a3: Time spent starting tablet: real 0.005s user 0.001s sys 0.004s
I20260807 22:42:07.547060 9049 heartbeater.cc:503] Master 127.22.212.126:35363 was elected leader, sending a full tablet report...
I20260807 22:42:07.547518 9518 log.cc:824] T 183f426e8aaf4df2b7538ad7e3e9049d P 1ee5a370f8ac4ea1967ba6770c30229f: Log is configured to *not* fsync() on all Append() calls
I20260807 22:42:07.548229 9514 tablet_bootstrap.cc:492] T 183f426e8aaf4df2b7538ad7e3e9049d P d798c9cb31f94461871e81bbfb648626: Bootstrap starting.
I20260807 22:42:07.548728 9518 tablet_bootstrap.cc:492] T 183f426e8aaf4df2b7538ad7e3e9049d P 1ee5a370f8ac4ea1967ba6770c30229f: No bootstrap required, opened a new log
I20260807 22:42:07.548804 9518 ts_tablet_manager.cc:1397] T 183f426e8aaf4df2b7538ad7e3e9049d P 1ee5a370f8ac4ea1967ba6770c30229f: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20260807 22:42:07.551088 9514 tablet_bootstrap.cc:654] T 183f426e8aaf4df2b7538ad7e3e9049d P d798c9cb31f94461871e81bbfb648626: Neither blocks nor log segments found. Creating new log.
I20260807 22:42:07.552116 9518 raft_consensus.cc:348] T 183f426e8aaf4df2b7538ad7e3e9049d P 1ee5a370f8ac4ea1967ba6770c30229f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ee5a370f8ac4ea1967ba6770c30229f" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 33595 } } peers { permanent_uuid: "d798c9cb31f94461871e81bbfb648626" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46399 } } peers { permanent_uuid: "e594cc25d2994c7e91df7c6e8e3780a3" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 37667 } }
I20260807 22:42:07.552325 9518 raft_consensus.cc:374] T 183f426e8aaf4df2b7538ad7e3e9049d P 1ee5a370f8ac4ea1967ba6770c30229f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:42:07.552248 9514 log.cc:824] T 183f426e8aaf4df2b7538ad7e3e9049d P d798c9cb31f94461871e81bbfb648626: Log is configured to *not* fsync() on all Append() calls
I20260807 22:42:07.552369 9518 raft_consensus.cc:729] T 183f426e8aaf4df2b7538ad7e3e9049d P 1ee5a370f8ac4ea1967ba6770c30229f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ee5a370f8ac4ea1967ba6770c30229f, State: Initialized, Role: FOLLOWER
I20260807 22:42:07.552493 9518 consensus_queue.cc:260] T 183f426e8aaf4df2b7538ad7e3e9049d P 1ee5a370f8ac4ea1967ba6770c30229f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ee5a370f8ac4ea1967ba6770c30229f" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 33595 } } peers { permanent_uuid: "d798c9cb31f94461871e81bbfb648626" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46399 } } peers { permanent_uuid: "e594cc25d2994c7e91df7c6e8e3780a3" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 37667 } }
I20260807 22:42:07.552863 9518 ts_tablet_manager.cc:1428] T 183f426e8aaf4df2b7538ad7e3e9049d P 1ee5a370f8ac4ea1967ba6770c30229f: Time spent starting tablet: real 0.004s user 0.001s sys 0.004s
I20260807 22:42:07.553006 9479 heartbeater.cc:503] Master 127.22.212.126:35363 was elected leader, sending a full tablet report...
I20260807 22:42:07.554158 9514 tablet_bootstrap.cc:492] T 183f426e8aaf4df2b7538ad7e3e9049d P d798c9cb31f94461871e81bbfb648626: No bootstrap required, opened a new log
I20260807 22:42:07.554309 9514 ts_tablet_manager.cc:1397] T 183f426e8aaf4df2b7538ad7e3e9049d P d798c9cb31f94461871e81bbfb648626: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20260807 22:42:07.560111 9514 raft_consensus.cc:348] T 183f426e8aaf4df2b7538ad7e3e9049d P d798c9cb31f94461871e81bbfb648626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ee5a370f8ac4ea1967ba6770c30229f" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 33595 } } peers { permanent_uuid: "d798c9cb31f94461871e81bbfb648626" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46399 } } peers { permanent_uuid: "e594cc25d2994c7e91df7c6e8e3780a3" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 37667 } }
I20260807 22:42:07.560503 9514 raft_consensus.cc:374] T 183f426e8aaf4df2b7538ad7e3e9049d P d798c9cb31f94461871e81bbfb648626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:42:07.560599 9514 raft_consensus.cc:729] T 183f426e8aaf4df2b7538ad7e3e9049d P d798c9cb31f94461871e81bbfb648626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d798c9cb31f94461871e81bbfb648626, State: Initialized, Role: FOLLOWER
I20260807 22:42:07.560824 9514 consensus_queue.cc:260] T 183f426e8aaf4df2b7538ad7e3e9049d P d798c9cb31f94461871e81bbfb648626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ee5a370f8ac4ea1967ba6770c30229f" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 33595 } } peers { permanent_uuid: "d798c9cb31f94461871e81bbfb648626" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46399 } } peers { permanent_uuid: "e594cc25d2994c7e91df7c6e8e3780a3" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 37667 } }
I20260807 22:42:07.561326 9514 ts_tablet_manager.cc:1428] T 183f426e8aaf4df2b7538ad7e3e9049d P d798c9cb31f94461871e81bbfb648626: Time spent starting tablet: real 0.007s user 0.004s sys 0.004s
I20260807 22:42:07.561548 9267 heartbeater.cc:503] Master 127.22.212.126:35363 was elected leader, sending a full tablet report...
I20260807 22:42:07.588994 9527 raft_consensus.cc:482] T 183f426e8aaf4df2b7538ad7e3e9049d P d798c9cb31f94461871e81bbfb648626 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:42:07.589259 9527 raft_consensus.cc:504] T 183f426e8aaf4df2b7538ad7e3e9049d P d798c9cb31f94461871e81bbfb648626 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ee5a370f8ac4ea1967ba6770c30229f" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 33595 } } peers { permanent_uuid: "d798c9cb31f94461871e81bbfb648626" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46399 } } peers { permanent_uuid: "e594cc25d2994c7e91df7c6e8e3780a3" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 37667 } }
I20260807 22:42:07.594693 9276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:07.590127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.67:33595 (local address 127.22.212.66:59497)
0807 22:42:07.590188 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:07.590205 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:42:07.590270 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:42:07.590480 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:42:07.590481 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:42:07.590483 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:42:07.590694 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:07.590698 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:07.591783 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:07.591784 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:07.593096 (+ 1312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:07.593099 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:07.594350 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:07.594351 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:07.594501 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:07.594505 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 22:42:07.594563 (+ 58us) client_negotiation.cc:240] Negotiation successful
0807 22:42:07.594609 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260807 22:42:07.595206 9509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:07.590252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:59497 (local address 127.22.212.67:33595)
0807 22:42:07.590301 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:07.590303 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:07.590314 (+ 11us) server_negotiation.cc:407] Connection header received
0807 22:42:07.590346 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:07.590347 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:07.590356 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:07.590419 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:42:07.590802 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:07.591561 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:07.593200 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:07.593792 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:07.593871 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:07.593883 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:07.595096 (+ 1213us) server_negotiation.cc:299] Negotiation successful
0807 22:42:07.595142 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 22:42:07.595763 9404 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "183f426e8aaf4df2b7538ad7e3e9049d" candidate_uuid: "d798c9cb31f94461871e81bbfb648626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ee5a370f8ac4ea1967ba6770c30229f" is_pre_election: true
I20260807 22:42:07.596043 9404 raft_consensus.cc:2454] T 183f426e8aaf4df2b7538ad7e3e9049d P 1ee5a370f8ac4ea1967ba6770c30229f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d798c9cb31f94461871e81bbfb648626 in term 0.
I20260807 22:42:07.596446 9093 leader_election.cc:302] T 183f426e8aaf4df2b7538ad7e3e9049d P d798c9cb31f94461871e81bbfb648626 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ee5a370f8ac4ea1967ba6770c30229f, d798c9cb31f94461871e81bbfb648626; no voters:
I20260807 22:42:07.599655 9276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:07.595910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:37667 (local address 127.22.212.66:34043)
0807 22:42:07.596213 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:07.596225 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:42:07.596292 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:42:07.596476 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:42:07.596477 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:42:07.596478 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:42:07.596512 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:07.596513 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:07.597456 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:07.597457 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:07.598459 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:07.598462 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:07.599440 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:07.599441 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:07.599499 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:07.599503 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 22:42:07.599550 (+ 47us) client_negotiation.cc:240] Negotiation successful
0807 22:42:07.599586 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285}
I20260807 22:42:07.600028 9511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:07.596020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:34043 (local address 127.22.212.65:37667)
0807 22:42:07.596066 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:07.596068 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:07.596346 (+ 278us) server_negotiation.cc:407] Connection header received
0807 22:42:07.596376 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:07.596377 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:07.596390 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:07.596434 (+ 44us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:42:07.596606 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:07.597304 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:07.598568 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:07.599318 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:07.599394 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:07.599404 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:07.599915 (+ 511us) server_negotiation.cc:299] Negotiation successful
0807 22:42:07.599963 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 22:42:07.600559 8964 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "183f426e8aaf4df2b7538ad7e3e9049d" candidate_uuid: "d798c9cb31f94461871e81bbfb648626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e594cc25d2994c7e91df7c6e8e3780a3" is_pre_election: true
I20260807 22:42:07.600723 8964 raft_consensus.cc:2454] T 183f426e8aaf4df2b7538ad7e3e9049d P e594cc25d2994c7e91df7c6e8e3780a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d798c9cb31f94461871e81bbfb648626 in term 0.
I20260807 22:42:07.601037 9527 leader_election.cc:288] T 183f426e8aaf4df2b7538ad7e3e9049d P d798c9cb31f94461871e81bbfb648626 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ee5a370f8ac4ea1967ba6770c30229f (127.22.212.67:33595), e594cc25d2994c7e91df7c6e8e3780a3 (127.22.212.65:37667)
I20260807 22:42:07.601186 9527 raft_consensus.cc:2781] T 183f426e8aaf4df2b7538ad7e3e9049d P d798c9cb31f94461871e81bbfb648626 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:42:07.601272 9527 raft_consensus.cc:482] T 183f426e8aaf4df2b7538ad7e3e9049d P d798c9cb31f94461871e81bbfb648626 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:42:07.603420 9527 raft_consensus.cc:3037] T 183f426e8aaf4df2b7538ad7e3e9049d P d798c9cb31f94461871e81bbfb648626 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:42:07.604835 9527 raft_consensus.cc:504] T 183f426e8aaf4df2b7538ad7e3e9049d P d798c9cb31f94461871e81bbfb648626 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ee5a370f8ac4ea1967ba6770c30229f" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 33595 } } peers { permanent_uuid: "d798c9cb31f94461871e81bbfb648626" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46399 } } peers { permanent_uuid: "e594cc25d2994c7e91df7c6e8e3780a3" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 37667 } }
I20260807 22:42:07.605264 9404 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "183f426e8aaf4df2b7538ad7e3e9049d" candidate_uuid: "d798c9cb31f94461871e81bbfb648626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ee5a370f8ac4ea1967ba6770c30229f"
I20260807 22:42:07.605357 9404 raft_consensus.cc:3037] T 183f426e8aaf4df2b7538ad7e3e9049d P 1ee5a370f8ac4ea1967ba6770c30229f [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:42:07.606722 9404 raft_consensus.cc:2454] T 183f426e8aaf4df2b7538ad7e3e9049d P 1ee5a370f8ac4ea1967ba6770c30229f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d798c9cb31f94461871e81bbfb648626 in term 1.
I20260807 22:42:07.607066 9093 leader_election.cc:302] T 183f426e8aaf4df2b7538ad7e3e9049d P d798c9cb31f94461871e81bbfb648626 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ee5a370f8ac4ea1967ba6770c30229f, d798c9cb31f94461871e81bbfb648626; no voters:
I20260807 22:42:07.607535 8964 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "183f426e8aaf4df2b7538ad7e3e9049d" candidate_uuid: "d798c9cb31f94461871e81bbfb648626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e594cc25d2994c7e91df7c6e8e3780a3"
I20260807 22:42:07.607641 8964 raft_consensus.cc:3037] T 183f426e8aaf4df2b7538ad7e3e9049d P e594cc25d2994c7e91df7c6e8e3780a3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:42:07.609025 8964 raft_consensus.cc:2454] T 183f426e8aaf4df2b7538ad7e3e9049d P e594cc25d2994c7e91df7c6e8e3780a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d798c9cb31f94461871e81bbfb648626 in term 1.
I20260807 22:42:07.609292 9527 leader_election.cc:288] T 183f426e8aaf4df2b7538ad7e3e9049d P d798c9cb31f94461871e81bbfb648626 [CANDIDATE]: Term 1 election: Requested vote from peers 1ee5a370f8ac4ea1967ba6770c30229f (127.22.212.67:33595), e594cc25d2994c7e91df7c6e8e3780a3 (127.22.212.65:37667)
I20260807 22:42:07.609416 9527 raft_consensus.cc:2781] T 183f426e8aaf4df2b7538ad7e3e9049d P d798c9cb31f94461871e81bbfb648626 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:42:07.609504 9527 raft_consensus.cc:686] T 183f426e8aaf4df2b7538ad7e3e9049d P d798c9cb31f94461871e81bbfb648626 [term 1 LEADER]: Becoming Leader. State: Replica: d798c9cb31f94461871e81bbfb648626, State: Running, Role: LEADER
I20260807 22:42:07.609639 9527 consensus_queue.cc:237] T 183f426e8aaf4df2b7538ad7e3e9049d P d798c9cb31f94461871e81bbfb648626 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ee5a370f8ac4ea1967ba6770c30229f" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 33595 } } peers { permanent_uuid: "d798c9cb31f94461871e81bbfb648626" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46399 } } peers { permanent_uuid: "e594cc25d2994c7e91df7c6e8e3780a3" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 37667 } }
I20260807 22:42:07.610761 8698 catalog_manager.cc:5495] T 183f426e8aaf4df2b7538ad7e3e9049d P d798c9cb31f94461871e81bbfb648626 reported cstate change: term changed from 0 to 1, leader changed from <none> to d798c9cb31f94461871e81bbfb648626 (127.22.212.66). New cstate: current_term: 1 leader_uuid: "d798c9cb31f94461871e81bbfb648626" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ee5a370f8ac4ea1967ba6770c30229f" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 33595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d798c9cb31f94461871e81bbfb648626" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e594cc25d2994c7e91df7c6e8e3780a3" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 37667 } health_report { overall_health: UNKNOWN } } }
I20260807 22:42:07.618984 9513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:07.614983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59934 (local address 127.22.212.66:46399)
0807 22:42:07.615173 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:07.615175 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:07.615181 (+ 6us) server_negotiation.cc:407] Connection header received
0807 22:42:07.615229 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:07.615230 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:07.615249 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:07.615311 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:42:07.615657 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:07.616427 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:07.617665 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:07.617978 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:07.618044 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:07.618294 (+ 250us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:42:07.618417 (+ 123us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:42:07.618493 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:07.618755 (+ 262us) server_negotiation.cc:299] Negotiation successful
0807 22:42:07.618775 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170}
I20260807 22:42:07.621973 8964 raft_consensus.cc:1261] T 183f426e8aaf4df2b7538ad7e3e9049d P e594cc25d2994c7e91df7c6e8e3780a3 [term 1 FOLLOWER]: Refusing update from remote peer d798c9cb31f94461871e81bbfb648626: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:42:07.622478 9528 consensus_queue.cc:1035] T 183f426e8aaf4df2b7538ad7e3e9049d P d798c9cb31f94461871e81bbfb648626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e594cc25d2994c7e91df7c6e8e3780a3" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 37667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:42:07.625010 9404 raft_consensus.cc:1261] T 183f426e8aaf4df2b7538ad7e3e9049d P 1ee5a370f8ac4ea1967ba6770c30229f [term 1 FOLLOWER]: Refusing update from remote peer d798c9cb31f94461871e81bbfb648626: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:42:07.625345 9528 consensus_queue.cc:1035] T 183f426e8aaf4df2b7538ad7e3e9049d P d798c9cb31f94461871e81bbfb648626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ee5a370f8ac4ea1967ba6770c30229f" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 33595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:42:07.626468 9533 mvcc.cc:205] Tried to move back new op lower bound from 7316039793136386048 to 7316039793090736128. Current Snapshot: MvccSnapshot[applied={T|T < 7316039793136386048}]
I20260807 22:42:07.627131 9534 mvcc.cc:205] Tried to move back new op lower bound from 7316039793136386048 to 7316039793090736128. Current Snapshot: MvccSnapshot[applied={T|T < 7316039793136386048}]
I20260807 22:42:07.633484 8696 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:42:07.633582 8696 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:42:07.634428 8696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b27c8f74787844f294735c75c748e6d9: Sending DeleteTablet for 3 replicas of tablet 183f426e8aaf4df2b7538ad7e3e9049d
I20260807 22:42:07.635046 9166 tablet_service.cc:1514] Processing DeleteTablet for tablet 183f426e8aaf4df2b7538ad7e3e9049d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:42:07 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:59932
I20260807 22:42:07.635350 8911 tablet_service.cc:1514] Processing DeleteTablet for tablet 183f426e8aaf4df2b7538ad7e3e9049d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:42:07 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:39610
I20260807 22:42:07.635890 9378 tablet_service.cc:1514] Processing DeleteTablet for tablet 183f426e8aaf4df2b7538ad7e3e9049d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:42:07 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:50504
I20260807 22:42:07.636332 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 8837
I20260807 22:42:07.653055 9542 mvcc.cc:205] Tried to move back new op lower bound from 7316039793136386048 to 7316039793090736128. Current Snapshot: MvccSnapshot[applied={T|T < 7316039793136386048}]
I20260807 22:42:07.653472 9546 tablet_replica.cc:330] T 183f426e8aaf4df2b7538ad7e3e9049d P d798c9cb31f94461871e81bbfb648626: stopping tablet replica
I20260807 22:42:07.653687 9546 raft_consensus.cc:2229] T 183f426e8aaf4df2b7538ad7e3e9049d P d798c9cb31f94461871e81bbfb648626 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:42:07.656838 9546 raft_consensus.cc:2258] T 183f426e8aaf4df2b7538ad7e3e9049d P d798c9cb31f94461871e81bbfb648626 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:42:07.657224 9548 tablet_replica.cc:330] T 183f426e8aaf4df2b7538ad7e3e9049d P 1ee5a370f8ac4ea1967ba6770c30229f: stopping tablet replica
I20260807 22:42:07.657588 9548 raft_consensus.cc:2229] T 183f426e8aaf4df2b7538ad7e3e9049d P 1ee5a370f8ac4ea1967ba6770c30229f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:42:07.657804 9548 raft_consensus.cc:2258] T 183f426e8aaf4df2b7538ad7e3e9049d P 1ee5a370f8ac4ea1967ba6770c30229f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:42:07.657871 9546 ts_tablet_manager.cc:1905] T 183f426e8aaf4df2b7538ad7e3e9049d P d798c9cb31f94461871e81bbfb648626: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:42:07.658357 9548 ts_tablet_manager.cc:1905] T 183f426e8aaf4df2b7538ad7e3e9049d P 1ee5a370f8ac4ea1967ba6770c30229f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:42:07.661549 9548 ts_tablet_manager.cc:1918] T 183f426e8aaf4df2b7538ad7e3e9049d P 1ee5a370f8ac4ea1967ba6770c30229f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:42:07.661736 9548 log.cc:1196] T 183f426e8aaf4df2b7538ad7e3e9049d P 1ee5a370f8ac4ea1967ba6770c30229f: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-2/wal/wals/183f426e8aaf4df2b7538ad7e3e9049d
I20260807 22:42:07.662432 9548 ts_tablet_manager.cc:1939] T 183f426e8aaf4df2b7538ad7e3e9049d P 1ee5a370f8ac4ea1967ba6770c30229f: Deleting consensus metadata
I20260807 22:42:07.664448 8671 catalog_manager.cc:4841] TS 1ee5a370f8ac4ea1967ba6770c30229f (127.22.212.67:33595): tablet 183f426e8aaf4df2b7538ad7e3e9049d (table test-table [id=a1c6e549f2f94b1e8910fdb28a30c8fa]) successfully deleted
I20260807 22:42:07.668243 9546 ts_tablet_manager.cc:1918] T 183f426e8aaf4df2b7538ad7e3e9049d P d798c9cb31f94461871e81bbfb648626: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:42:07.668385 9546 log.cc:1196] T 183f426e8aaf4df2b7538ad7e3e9049d P d798c9cb31f94461871e81bbfb648626: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786142418640232-23377-0/minicluster-data/ts-1/wal/wals/183f426e8aaf4df2b7538ad7e3e9049d
W20260807 22:42:07.668640 8676 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.212.65:37667 (error 108)
I20260807 22:42:07.668772 9546 ts_tablet_manager.cc:1939] T 183f426e8aaf4df2b7538ad7e3e9049d P d798c9cb31f94461871e81bbfb648626: Deleting consensus metadata
I20260807 22:42:07.669296 8672 catalog_manager.cc:4841] TS d798c9cb31f94461871e81bbfb648626 (127.22.212.66:46399): tablet 183f426e8aaf4df2b7538ad7e3e9049d (table test-table [id=a1c6e549f2f94b1e8910fdb28a30c8fa]) successfully deleted
I20260807 22:42:07.670991 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 9062
I20260807 22:42:07.673735 9502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:07.671126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:37667 (local address 127.0.0.1:39612)
0807 22:42:07.673653 (+ 2527us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:07.673696 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.65:37667: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2500}
W20260807 22:42:07.675345 8676 catalog_manager.cc:4584] TS e594cc25d2994c7e91df7c6e8e3780a3 (127.22.212.65:37667): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 183f426e8aaf4df2b7538ad7e3e9049d: Network error: Client connection negotiation failed: client connection to 127.22.212.65:37667: connect: Connection refused (error 111)
I20260807 22:42:07.705103 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 9278
I20260807 22:42:07.723486 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 8645
I20260807 22:42:07.737542 23377 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260807 22:42:08.082525 23377 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260807 22:42:08.082653 23377 mini_ranger.cc:66] Stopping Ranger...
I20260807 22:42:08.427352 23377 mini_ranger.cc:68] Stopped Ranger
2026-08-07 22:42:08.427 UTC [7952] LOG: received smart shutdown request
2026-08-07 22:42:08.431 UTC [7952] LOG: background worker "logical replication launcher" (PID 7966) exited with exit code 1
2026-08-07 22:42:08.431 UTC [7957] LOG: shutting down
2026-08-07 22:42:08.605 UTC [7952] LOG: database system is shut down
2026-08-07T22:42:08Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (48881 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:42:08 dist-test-slave-2d19 krb5kdc[9559](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:42:08 dist-test-slave-2d19 krb5kdc[9559](info): set up 2 sockets
Aug 07 22:42:08 dist-test-slave-2d19 krb5kdc[9559](info): commencing operation
krb5kdc: starting...
W20260807 22:42:09.992457 23377 mini_kdc.cc:121] Time spent starting KDC: real 1.253s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Aug 07 22:42:10 dist-test-slave-2d19 krb5kdc[9559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142530, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:42:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:42:10Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.22.212.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.22.212.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.22.212.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/rangeradmin_127.22.212.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.22.212.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/rangeradmin_127.22.212.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.22.212.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.22.212.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.22.212.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/rangerlookup_127.22.212.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.22.212.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/rangerlookup_127.22.212.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.22.212.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.22.212.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.22.212.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/HTTP_127.22.212.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.22.212.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/HTTP_127.22.212.84@KRBTEST.COM.keytab.
I20260807 22:42:10.171990 23377 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-task6SvSzn/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/postgres -l logfile start
2026-08-07 22:42:12.742 UTC [9609] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-07 22:42:12.742 UTC [9609] LOG: listening on IPv4 address "127.22.212.84", port 54609
2026-08-07 22:42:12.745 UTC [9609] LOG: listening on Unix socket "/tmp/.s.PGSQL.54609"
2026-08-07 22:42:12.768 UTC [9617] LOG: database system was shut down at 2026-08-07 22:42:11 UTC
2026-08-07 22:42:12.771 UTC [9609] LOG: database system is ready to accept connections
I20260807 22:42:13.941783 23377 mini_postgres.cc:96] Postgres bound to 54609
2026-08-07 22:42:13.949 UTC [9626] FATAL: database "slave" does not exist
127.22.212.84:54609 - accepting connections
I20260807 22:42:13.949637 23377 mini_ranger.cc:161] Starting Ranger...
I20260807 22:42:13.965198 23377 mini_ranger.cc:84] Created miniranger Postgres user
I20260807 22:42:14.488387 23377 mini_ranger.cc:87] Created ranger Postgres database
I20260807 22:42:14.488476 23377 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ranger-admin
2026-08-07 22:42:14,778 [I] DB FLAVOR :POSTGRES
2026-08-07 22:42:14,778 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 22:42:14,779 [I] Checking connection..
2026-08-07 22:42:14,779 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.212.84:54609/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-07 22:42:15,035 [I] Checking connection passed.
2026-08-07 22:42:15,035 [I] --------- Verifying version history table ---------
2026-08-07 22:42:15,035 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.212.84:54609/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 22:42:15,300 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 22:42:15,300 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.212.84:54609/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 22:42:15,536 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 22:42:15,536 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-07 22:42:15,536 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.212.84:54609/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-07 22:42:15.777 UTC [9731] WARNING: there is no transaction in progress
2026-08-07 22:42:15,786 [I] create_dbversion_catalog.sql file imported successfully
2026-08-07 22:42:15,787 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.212.84:54609/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 22:42:16,057 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-07 22:42:16,057 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 22:42:16,057 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.212.84:54609/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-07 22:42:16,327 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.212.84:54609/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-07 22:42:16,584 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.212.84:54609/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-2d19.c.gcp-upstream.internal','N') ;"
2026-08-07 22:42:16,844 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.212.84:54609/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 22:42:17,096 [I] Table x_portal_user does not exist in database ranger
2026-08-07 22:42:17,096 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.212.84:54609/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 22:42:17,345 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-07 22:42:17,345 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.212.84:54609/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 22:42:17,588 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.212.84:54609/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 22:42:17,842 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-07 22:42:17,843 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.212.84:54609/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-07 22:42:18.810 UTC [9915] WARNING: there is no transaction in progress
2026-08-07 22:42:18.828 UTC [9915] WARNING: there is no transaction in progress
2026-08-07 22:42:18.847 UTC [9915] WARNING: there is no transaction in progress
2026-08-07 22:42:18.864 UTC [9915] WARNING: there is no transaction in progress
2026-08-07 22:42:18.882 UTC [9915] WARNING: there is no transaction in progress
2026-08-07 22:42:18.901 UTC [9915] WARNING: there is no transaction in progress
2026-08-07 22:42:18.969 UTC [9915] WARNING: there is no transaction in progress
2026-08-07 22:42:18.976 UTC [9915] WARNING: there is no transaction in progress
2026-08-07 22:42:18.991 UTC [9915] WARNING: there is no transaction in progress
2026-08-07 22:42:19.002 UTC [9915] WARNING: there is no transaction in progress
2026-08-07 22:42:19.013 UTC [9915] WARNING: there is no transaction in progress
2026-08-07 22:42:19.028 UTC [9915] WARNING: there is no transaction in progress
2026-08-07 22:42:19.039 UTC [9915] WARNING: there is no transaction in progress
2026-08-07 22:42:19.046 UTC [9915] WARNING: there is no transaction in progress
2026-08-07 22:42:19.053 UTC [9915] WARNING: there is no transaction in progress
2026-08-07 22:42:19.060 UTC [9915] WARNING: there is no transaction in progress
2026-08-07 22:42:19,736 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-07 22:42:19,736 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.212.84:54609/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-07 22:42:19,979 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-07 22:42:19,979 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.212.84:54609/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 22:42:20,222 [I] Table x_portal_user already exists in database 'ranger'
2026-08-07 22:42:20,223 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.212.84:54609/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 22:42:20,482 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-07 22:42:20,482 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.212.84:54609/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 22:42:20,737 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.212.84:54609/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 22:42:20,996 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.212.84:54609/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-2d19.c.gcp-upstream.internal';"
2026-08-07 22:42:21,259 [I] CORE_DB_SCHEMA import status has been updated
2026-08-07 22:42:21,259 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.212.84:54609/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-07 22:42:21,526 [I] DB_PATCHES have already been applied
I20260807 22:42:21.531908 23377 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ranger-admin:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-task6SvSzn/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260807 22:42:21.531971 23377 mini_ranger.cc:193] Using host: 127.22.212.84
I20260807 22:42:21.535943 23377 mini_ranger.cc:227] Ranger admin URL: http://127.22.212.84:37781
Aug 07, 2026 10:42:21 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 10:42:21 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 10:42:21 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ranger-admin/ews/webapp
Aug 07, 2026 10:42:21 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 07, 2026 10:42:21 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 07, 2026 10:42:22 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ranger-admin/ews/webapp].
Aug 07, 2026 10:42:22 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260807 22:42:22.926074 23377 mini_ranger.cc:160] Time spent starting Ranger: real 8.976s user 0.000s sys 0.011s
Aug 07, 2026 10:42:44 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 07, 2026 10:42:44 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 07, 2026 10:42:44 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 07, 2026 10:42:45 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 07, 2026 10:42:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 07, 2026 10:42:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 07, 2026 10:42:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 07, 2026 10:42:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 07, 2026 10:42:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 07, 2026 10:42:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 07, 2026 10:42:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 07, 2026 10:42:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 07, 2026 10:42:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 07, 2026 10:42:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 07, 2026 10:42:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 07, 2026 10:42:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 07, 2026 10:42:45 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 07, 2026 10:42:45 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260807 22:42:46.577601 23377 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.22.212.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.22.212.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.22.212.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/rangerkms_127.22.212.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.22.212.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/rangerkms_127.22.212.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.22.212.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.22.212.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.22.212.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/HTTP_127.22.212.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.22.212.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/HTTP_127.22.212.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 07 22:42:46 dist-test-slave-2d19 krb5kdc[9559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142566, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260807 22:42:46.671847 23377 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260807 22:42:46.682124 23377 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260807 22:42:47.600986 23377 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260807 22:42:47.601064 23377 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ranger-kms
I20260807 22:42:47.601078 23377 mini_ranger_kms.cc:227] Using postgres at 127.22.212.84:54609
2026-08-07 22:42:47,791 [I] DB FLAVOR :POSTGRES
2026-08-07 22:42:47,792 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 22:42:47,792 [I] Checking connection
2026-08-07 22:42:47,792 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.212.84:54609/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-07 22:42:48,038 [I] connection success
2026-08-07 22:42:48,038 [I] --------- Verifying Ranger DB tables ---------
2026-08-07 22:42:48,038 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-07 22:42:48,039 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.212.84:54609/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-07 22:42:48,295 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-07 22:42:48,295 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 22:42:48,295 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-07 22:42:48,296 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.212.84:54609/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-07 22:42:48,584 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260807 22:42:49.101450 23377 mini_ranger_kms.cc:310] Created kms service
I20260807 22:42:49.276125 23377 mini_ranger_kms.cc:326] Created kudu user
I20260807 22:42:49.322402 23377 mini_ranger_kms.cc:343] Created rangerkms user
Aug 07 22:42:49 dist-test-slave-2d19 krb5kdc[9559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142566, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.22.212.84@KRBTEST.COM
I20260807 22:42:49.737133 23377 mini_ranger_kms.cc:384] Added ranger policy
I20260807 22:42:49.737365 23377 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ranger-kms:/tmp/dist-test-task6SvSzn/build/release/bin/postgresql.jar:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-task6SvSzn/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260807 22:42:49.737396 23377 mini_ranger_kms.cc:240] Using host: 127.22.212.84
I20260807 22:42:49.741905 23377 mini_ranger_kms.cc:276] Ranger KMS PID: 10210
I20260807 22:42:49.741992 23377 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.22.212.84:36849
Aug 07, 2026 10:42:50 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 10:42:50 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 10:42:50 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 07, 2026 10:42:50 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 07, 2026 10:42:51 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ranger-kms/ews/webapp].
Aug 07, 2026 10:42:51 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 07 22:42:52 dist-test-slave-2d19 krb5kdc[9559](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786142572, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.22.212.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:42:52.507272 23377 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.835s user 0.005s sys 0.167s
I20260807 22:42:52.507385 23377 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260807 22:42:52.507447 23377 mini_ranger_kms.cc:401] 127.22.212.84:36849/kms/v1/keys
Aug 07 22:42:52 dist-test-slave-2d19 krb5kdc[9559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142572, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.22.212.84@KRBTEST.COM for HTTP/127.22.212.84@KRBTEST.COM
Aug 07 22:42:53 dist-test-slave-2d19 krb5kdc[9559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142572, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.22.212.84@KRBTEST.COM for HTTP/127.22.212.84@KRBTEST.COM
Aug 07 22:42:55 dist-test-slave-2d19 krb5kdc[9559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142575, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.22.212.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
I20260807 22:42:55.267612 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:37595
--webserver_interface=127.22.212.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:35413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:37595
--ranger_config_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.212.84:36849/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:42:55.356842 10294 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:42:55.357065 10294 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:42:55.357090 10294 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:42:55.358265 10294 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:42:55.358314 10294 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:42:55.358328 10294 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:42:55.358340 10294 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:42:55.358353 10294 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:42:55.359984 10294 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:35413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/master-0/wal
--ranger_kms_url=127.22.212.84:36849/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:37595
--ranger_config_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:37595
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10294
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:42:55.360246 10294 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:42:55.360549 10294 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:42:55.366799 10303 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:55.366819 10306 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:55.366804 10302 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:55.367563 10294 server_base.cc:1034] running on GCE node
I20260807 22:42:55.367858 10294 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:42:55.368227 10294 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:42:55.369436 10294 hybrid_clock.cc:648] HybridClock initialized: now 1786142575369416 us; error 35 us; skew 500 ppm
Aug 07 22:42:55 dist-test-slave-2d19 krb5kdc[9559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142575, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:42:55.377691 10294 init.cc:377] Logged in from keytab as kudu/127.22.212.126@KRBTEST.COM (short username kudu)
I20260807 22:42:55.378283 10294 webserver.cc:460] Webserver started at http://127.22.212.126:40147/ using document root <none> and password file <none>
I20260807 22:42:55.378535 10294 fs_manager.cc:359] Metadata directory not provided
I20260807 22:42:55.378614 10294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:42:55.378769 10294 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 22:42:55 dist-test-slave-2d19 krb5kdc[9559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142575, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for HTTP/127.22.212.84@KRBTEST.COM
I20260807 22:42:55.440157 10294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "03dcd21e411f479fa746a35c3cb4e5c8"
format_stamp: "Formatted at 2026-08-07 22:42:55 on dist-test-slave-2d19"
server_key: "116bb3c1957785aabe2dac2969df3855"
server_key_iv: "4cefd3988d3bd2e6d31991e06c95642d"
server_key_version: "kuduclusterkey@0"
I20260807 22:42:55.440812 10294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "03dcd21e411f479fa746a35c3cb4e5c8"
format_stamp: "Formatted at 2026-08-07 22:42:55 on dist-test-slave-2d19"
server_key: "116bb3c1957785aabe2dac2969df3855"
server_key_iv: "4cefd3988d3bd2e6d31991e06c95642d"
server_key_version: "kuduclusterkey@0"
I20260807 22:42:55.442623 10294 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:42:55.456275 10316 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:55.456458 10294 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:42:55.456578 10294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "03dcd21e411f479fa746a35c3cb4e5c8"
format_stamp: "Formatted at 2026-08-07 22:42:55 on dist-test-slave-2d19"
server_key: "116bb3c1957785aabe2dac2969df3855"
server_key_iv: "4cefd3988d3bd2e6d31991e06c95642d"
server_key_version: "kuduclusterkey@0"
I20260807 22:42:55.456697 10294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:42:55.467135 10294 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:42:55.469244 10294 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:42:55.469398 10294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:42:55.474435 10294 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:37595
I20260807 22:42:55.474472 10391 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:37595 every 8 connection(s)
I20260807 22:42:55.474838 10294 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:42:55.475106 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 10294
I20260807 22:42:55.475214 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:42:55.475414 23377 external_mini_cluster.cc:1428] Setting key 3b4199ebbf5daf809407860343f5127f
I20260807 22:42:55.475703 10392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:42:55.479337 10392 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03dcd21e411f479fa746a35c3cb4e5c8: Bootstrap starting.
I20260807 22:42:55.480098 10392 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 03dcd21e411f479fa746a35c3cb4e5c8: Neither blocks nor log segments found. Creating new log.
I20260807 22:42:55.480481 10392 log.cc:824] T 00000000000000000000000000000000 P 03dcd21e411f479fa746a35c3cb4e5c8: Log is configured to *not* fsync() on all Append() calls
I20260807 22:42:55.481350 10392 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03dcd21e411f479fa746a35c3cb4e5c8: No bootstrap required, opened a new log
Aug 07 22:42:55 dist-test-slave-2d19 krb5kdc[9559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142575, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:42:55.483963 10392 raft_consensus.cc:348] T 00000000000000000000000000000000 P 03dcd21e411f479fa746a35c3cb4e5c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03dcd21e411f479fa746a35c3cb4e5c8" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 37595 } }
I20260807 22:42:55.484145 10392 raft_consensus.cc:374] T 00000000000000000000000000000000 P 03dcd21e411f479fa746a35c3cb4e5c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:42:55.484182 10392 raft_consensus.cc:729] T 00000000000000000000000000000000 P 03dcd21e411f479fa746a35c3cb4e5c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03dcd21e411f479fa746a35c3cb4e5c8, State: Initialized, Role: FOLLOWER
I20260807 22:42:55.484387 10392 consensus_queue.cc:260] T 00000000000000000000000000000000 P 03dcd21e411f479fa746a35c3cb4e5c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03dcd21e411f479fa746a35c3cb4e5c8" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 37595 } }
I20260807 22:42:55.484472 10392 raft_consensus.cc:388] T 00000000000000000000000000000000 P 03dcd21e411f479fa746a35c3cb4e5c8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:42:55.484501 10392 raft_consensus.cc:482] T 00000000000000000000000000000000 P 03dcd21e411f479fa746a35c3cb4e5c8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:42:55.484586 10392 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 03dcd21e411f479fa746a35c3cb4e5c8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:42:55.485318 10392 raft_consensus.cc:504] T 00000000000000000000000000000000 P 03dcd21e411f479fa746a35c3cb4e5c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03dcd21e411f479fa746a35c3cb4e5c8" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 37595 } }
I20260807 22:42:55.485502 10392 leader_election.cc:302] T 00000000000000000000000000000000 P 03dcd21e411f479fa746a35c3cb4e5c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 03dcd21e411f479fa746a35c3cb4e5c8; no voters:
I20260807 22:42:55.485754 10392 leader_election.cc:288] T 00000000000000000000000000000000 P 03dcd21e411f479fa746a35c3cb4e5c8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:42:55.485806 10397 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 03dcd21e411f479fa746a35c3cb4e5c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:42:55.485809 10395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:55.475900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47986 (local address 127.22.212.126:37595)
0807 22:42:55.476139 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:55.476149 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:55.476180 (+ 31us) server_negotiation.cc:407] Connection header received
0807 22:42:55.476973 (+ 793us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:55.476981 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:55.477032 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:55.477189 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:55.477857 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:55.478760 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:55.479560 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:55.479958 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:55.480079 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:55.482596 (+ 2517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:55.482601 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:55.482601 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:55.482613 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:55.484197 (+ 1584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:55.484630 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:55.484633 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:55.484633 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:55.484728 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:55.484927 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:55.484928 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:55.484928 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:55.485173 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:55.485334 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:55.485436 (+ 102us) server_negotiation.cc:299] Negotiation successful
0807 22:42:55.485555 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":104,"threads_started":1}
I20260807 22:42:55.486027 10397 raft_consensus.cc:686] T 00000000000000000000000000000000 P 03dcd21e411f479fa746a35c3cb4e5c8 [term 1 LEADER]: Becoming Leader. State: Replica: 03dcd21e411f479fa746a35c3cb4e5c8, State: Running, Role: LEADER
I20260807 22:42:55.486114 10392 sys_catalog.cc:564] T 00000000000000000000000000000000 P 03dcd21e411f479fa746a35c3cb4e5c8 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:42:55.486114 10397 consensus_queue.cc:237] T 00000000000000000000000000000000 P 03dcd21e411f479fa746a35c3cb4e5c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03dcd21e411f479fa746a35c3cb4e5c8" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 37595 } }
I20260807 22:42:55.486476 10397 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03dcd21e411f479fa746a35c3cb4e5c8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 03dcd21e411f479fa746a35c3cb4e5c8. Latest consensus state: current_term: 1 leader_uuid: "03dcd21e411f479fa746a35c3cb4e5c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03dcd21e411f479fa746a35c3cb4e5c8" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 37595 } } }
I20260807 22:42:55.486560 10397 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03dcd21e411f479fa746a35c3cb4e5c8 [sys.catalog]: This master's current role is: LEADER
I20260807 22:42:55.487120 10406 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03dcd21e411f479fa746a35c3cb4e5c8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "03dcd21e411f479fa746a35c3cb4e5c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03dcd21e411f479fa746a35c3cb4e5c8" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 37595 } } }
I20260807 22:42:55.487229 10406 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03dcd21e411f479fa746a35c3cb4e5c8 [sys.catalog]: This master's current role is: LEADER
I20260807 22:42:55.487388 10413 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:42:55.487669 10392 ranger_client.cc:318] Using new properties file: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 22:42:55.487919 10413 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:42:55.497784 10413 catalog_manager.cc:1347] Generated new cluster ID: 246a5e30f6b34ae6a53a3d5d321374ac
I20260807 22:42:55.497875 10413 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:42:55.510078 10413 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:42:55.511415 10413 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:42:55.521018 10413 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 03dcd21e411f479fa746a35c3cb4e5c8: Generated new TSK 0
I20260807 22:42:55.521322 10413 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.212.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab.
Entry for principal kudu/127.22.212.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab.
I20260807 22:42:56.213488 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.212.84:36849/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.65:0
--local_ip_for_outbound_sockets=127.22.212.65
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:37595
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:35413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:42:56.320228 10463 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:42:56.320601 10463 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:42:56.320669 10463 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:42:56.322352 10463 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:42:56.322471 10463 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:42:56.322548 10463 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.65
I20260807 22:42:56.324744 10463 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:35413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.22.212.84:36849/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:37595
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10463
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.65
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:42:56.325127 10463 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:42:56.325436 10463 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:42:56.332050 10475 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:56.332050 10470 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:56.332123 10469 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:56.332456 10463 server_base.cc:1034] running on GCE node
I20260807 22:42:56.332665 10463 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:42:56.332924 10463 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:42:56.334100 10463 hybrid_clock.cc:648] HybridClock initialized: now 1786142576334072 us; error 46 us; skew 500 ppm
Aug 07 22:42:56 dist-test-slave-2d19 krb5kdc[9559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142576, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:42:56.336858 10463 init.cc:377] Logged in from keytab as kudu/127.22.212.65@KRBTEST.COM (short username kudu)
I20260807 22:42:56.337324 10463 webserver.cc:460] Webserver started at http://127.22.212.65:43271/ using document root <none> and password file <none>
I20260807 22:42:56.337597 10463 fs_manager.cc:359] Metadata directory not provided
I20260807 22:42:56.337670 10463 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:42:56.337823 10463 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 22:42:56 dist-test-slave-2d19 krb5kdc[9559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142576, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for HTTP/127.22.212.84@KRBTEST.COM
I20260807 22:42:56.352353 10463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-0/data/instance:
uuid: "0124c3ec4b0a412c8093a851431447ce"
format_stamp: "Formatted at 2026-08-07 22:42:56 on dist-test-slave-2d19"
server_key: "912989a0c758b7554396c6b18f1ee0f3"
server_key_iv: "35869ac2ba244affb8e6ac30a77bc295"
server_key_version: "kuduclusterkey@0"
I20260807 22:42:56.352955 10463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance:
uuid: "0124c3ec4b0a412c8093a851431447ce"
format_stamp: "Formatted at 2026-08-07 22:42:56 on dist-test-slave-2d19"
server_key: "912989a0c758b7554396c6b18f1ee0f3"
server_key_iv: "35869ac2ba244affb8e6ac30a77bc295"
server_key_version: "kuduclusterkey@0"
I20260807 22:42:56.354477 10463 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 22:42:56.370204 10485 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:56.370491 10463 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.000s sys 0.000s
I20260807 22:42:56.370608 10463 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-0/wal
uuid: "0124c3ec4b0a412c8093a851431447ce"
format_stamp: "Formatted at 2026-08-07 22:42:56 on dist-test-slave-2d19"
server_key: "912989a0c758b7554396c6b18f1ee0f3"
server_key_iv: "35869ac2ba244affb8e6ac30a77bc295"
server_key_version: "kuduclusterkey@0"
I20260807 22:42:56.370710 10463 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:42:56.412272 10463 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:42:56.414963 10463 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:42:56.415180 10463 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:42:56.415467 10463 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:42:56.415910 10463 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:42:56.416009 10463 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:56.416112 10463 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:42:56.416188 10463 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:56.423825 10463 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.65:38687
I20260807 22:42:56.423940 10659 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.65:38687 every 8 connection(s)
I20260807 22:42:56.424420 10463 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
Aug 07 22:42:56 dist-test-slave-2d19 krb5kdc[9559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142576, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:42:56.430824 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 10463
I20260807 22:42:56.430934 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance
I20260807 22:42:56.431178 23377 external_mini_cluster.cc:1428] Setting key bb03a38aed729d7f69bcec9ba534cad9
I20260807 22:42:56.442055 10665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:56.425278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:37595 (local address 127.22.212.65:44287)
0807 22:42:56.425451 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:56.425496 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 22:42:56.426015 (+ 519us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:42:56.426290 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:42:56.426294 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:42:56.426495 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:42:56.426702 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:56.426707 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:56.427429 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:56.427431 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:56.428305 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:56.428308 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:56.428734 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:56.428735 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:56.428865 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:56.429425 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:42:56.429433 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:42:56.430873 (+ 1440us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:42:56.439995 (+ 9122us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:56.440006 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:56.440010 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:56.440480 (+ 470us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:56.440743 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:56.440744 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:56.440744 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:56.440888 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:56.441222 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:42:56.441230 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:42:56.441468 (+ 238us) client_negotiation.cc:769] Sending connection context
0807 22:42:56.441604 (+ 136us) client_negotiation.cc:240] Negotiation successful
0807 22:42:56.441792 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":96,"threads_started":1}
I20260807 22:42:56.442687 10669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:56.425302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:44287 (local address 127.22.212.126:37595)
0807 22:42:56.425579 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:56.425582 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:56.425594 (+ 12us) server_negotiation.cc:407] Connection header received
0807 22:42:56.426131 (+ 537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:56.426132 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:56.426147 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:56.426216 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:56.426794 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:56.427327 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:56.428397 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:56.428621 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:56.428706 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:56.430992 (+ 2286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:56.430994 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:56.430994 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:56.431002 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:56.439856 (+ 8854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:56.440592 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:56.440593 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:56.440594 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:56.440670 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:56.440962 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:56.440963 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:56.440964 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:56.441111 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:56.441178 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:56.442463 (+ 1285us) server_negotiation.cc:299] Negotiation successful
0807 22:42:56.442583 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":244,"thread_start_us":125,"threads_started":1}
I20260807 22:42:56.443511 10662 heartbeater.cc:347] Connected to a master server at 127.22.212.126:37595
I20260807 22:42:56.443630 10662 heartbeater.cc:464] Registering TS with master...
I20260807 22:42:56.443841 10662 heartbeater.cc:511] Master 127.22.212.126:37595 requested a full tablet report, sending...
I20260807 22:42:56.444576 10343 ts_manager.cc:194] Registered new tserver with Master: 0124c3ec4b0a412c8093a851431447ce (127.22.212.65:38687)
I20260807 22:42:56.445487 10343 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.65@KRBTEST.COM'} at 127.22.212.65:44287
WARNING: no policy specified for kudu/127.22.212.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab.
Entry for principal kudu/127.22.212.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab.
I20260807 22:42:56.479501 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.212.84:36849/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.66:0
--local_ip_for_outbound_sockets=127.22.212.66
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:37595
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:35413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 22:42:56 dist-test-slave-2d19 krb5kdc[9559](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786142576, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260807 22:42:56.578068 10676 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:42:56.578440 10676 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:42:56.578531 10676 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:42:56.580330 10676 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:42:56.580436 10676 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:42:56.580502 10676 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.66
I20260807 22:42:56.582763 10676 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:35413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.22.212.84:36849/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:37595
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10676
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.66
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:42:56.583228 10676 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:42:56.583549 10676 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:42:56.590802 10682 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:56.591197 10687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:56.591923 10676 server_base.cc:1034] running on GCE node
W20260807 22:42:56.592171 10681 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:56.592519 10676 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:42:56.592842 10676 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:42:56.596130 10676 hybrid_clock.cc:648] HybridClock initialized: now 1786142576596090 us; error 58 us; skew 500 ppm
Aug 07 22:42:56 dist-test-slave-2d19 krb5kdc[9559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142576, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:42:56.599673 10676 init.cc:377] Logged in from keytab as kudu/127.22.212.66@KRBTEST.COM (short username kudu)
I20260807 22:42:56.604390 10676 webserver.cc:460] Webserver started at http://127.22.212.66:45653/ using document root <none> and password file <none>
I20260807 22:42:56.604751 10676 fs_manager.cc:359] Metadata directory not provided
I20260807 22:42:56.604895 10676 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:42:56.605113 10676 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 22:42:56 dist-test-slave-2d19 krb5kdc[9559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142576, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for HTTP/127.22.212.84@KRBTEST.COM
I20260807 22:42:56.639221 10676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-1/data/instance:
uuid: "5cd898a32ddc4844a11914b2185d0f01"
format_stamp: "Formatted at 2026-08-07 22:42:56 on dist-test-slave-2d19"
server_key: "036566f0ef3e1b92d6d6f4cca1910da4"
server_key_iv: "7cb93e9f6451ca91848c0d38cb149c19"
server_key_version: "kuduclusterkey@0"
I20260807 22:42:56.640178 10676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance:
uuid: "5cd898a32ddc4844a11914b2185d0f01"
format_stamp: "Formatted at 2026-08-07 22:42:56 on dist-test-slave-2d19"
server_key: "036566f0ef3e1b92d6d6f4cca1910da4"
server_key_iv: "7cb93e9f6451ca91848c0d38cb149c19"
server_key_version: "kuduclusterkey@0"
I20260807 22:42:56.642540 10676 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.001s
I20260807 22:42:56.671617 10697 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:56.671955 10676 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260807 22:42:56.672080 10676 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-1/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-1/wal
uuid: "5cd898a32ddc4844a11914b2185d0f01"
format_stamp: "Formatted at 2026-08-07 22:42:56 on dist-test-slave-2d19"
server_key: "036566f0ef3e1b92d6d6f4cca1910da4"
server_key_iv: "7cb93e9f6451ca91848c0d38cb149c19"
server_key_version: "kuduclusterkey@0"
I20260807 22:42:56.672186 10676 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:42:56.704574 10676 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:42:56.706588 10676 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:42:56.706744 10676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:42:56.706969 10676 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:42:56.707320 10676 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:42:56.707373 10676 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:56.707409 10676 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:42:56.707436 10676 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:56.714159 10676 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.66:44125
I20260807 22:42:56.714529 10676 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
I20260807 22:42:56.715790 10872 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.66:44125 every 8 connection(s)
Aug 07 22:42:56 dist-test-slave-2d19 krb5kdc[9559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142576, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:42:56.723544 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 10676
I20260807 22:42:56.723656 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance
I20260807 22:42:56.723879 23377 external_mini_cluster.cc:1428] Setting key 294f4cdac51431b8fcfcdee68bbb278e
I20260807 22:42:56.724303 10669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:56.715354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:49141 (local address 127.22.212.126:37595)
0807 22:42:56.715415 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:56.715417 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:56.715664 (+ 247us) server_negotiation.cc:407] Connection header received
0807 22:42:56.716291 (+ 627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:56.716292 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:56.716310 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:56.716357 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:56.716946 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:56.717451 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:56.718435 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:56.718660 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:56.718735 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:56.721136 (+ 2401us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:56.721138 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:56.721138 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:56.721145 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:56.722517 (+ 1372us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:56.723032 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:56.723033 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:56.723034 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:56.723102 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:56.723433 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:56.723434 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:56.723434 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:56.723585 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:56.723660 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:56.724071 (+ 411us) server_negotiation.cc:299] Negotiation successful
0807 22:42:56.724178 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260807 22:42:56.724807 10877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:56.715348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:37595 (local address 127.22.212.66:49141)
0807 22:42:56.715533 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:56.715585 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 22:42:56.716150 (+ 565us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:42:56.716445 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:42:56.716449 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:42:56.716646 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:42:56.716841 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:56.716845 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:56.717554 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:56.717555 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:56.718345 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:56.718347 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:56.718754 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:56.718755 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:56.718881 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:56.719443 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:42:56.719451 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:42:56.721024 (+ 1573us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:42:56.722607 (+ 1583us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:56.722614 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:56.722617 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:56.722954 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:56.723173 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:56.723174 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:56.723174 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:56.723349 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:56.723693 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:42:56.723700 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:42:56.723873 (+ 173us) client_negotiation.cc:769] Sending connection context
0807 22:42:56.724415 (+ 542us) client_negotiation.cc:240] Negotiation successful
0807 22:42:56.724578 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":101,"threads_started":1}
I20260807 22:42:56.726559 10875 heartbeater.cc:347] Connected to a master server at 127.22.212.126:37595
I20260807 22:42:56.726665 10875 heartbeater.cc:464] Registering TS with master...
I20260807 22:42:56.726861 10875 heartbeater.cc:511] Master 127.22.212.126:37595 requested a full tablet report, sending...
I20260807 22:42:56.732515 10343 ts_manager.cc:194] Registered new tserver with Master: 5cd898a32ddc4844a11914b2185d0f01 (127.22.212.66:44125)
WARNING: no policy specified for kudu/127.22.212.67@KRBTEST.COM; defaulting to no policy
I20260807 22:42:56.733052 10343 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.66@KRBTEST.COM'} at 127.22.212.66:49141
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab.
Entry for principal kudu/127.22.212.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab.
I20260807 22:42:56.751888 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.212.84:36849/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.67:0
--local_ip_for_outbound_sockets=127.22.212.67
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:37595
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:35413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:42:56.859987 10885 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:42:56.860199 10885 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:42:56.860224 10885 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:42:56.861408 10885 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:42:56.861456 10885 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:42:56.861483 10885 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.67
I20260807 22:42:56.862980 10885 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:35413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.22.212.84:36849/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:37595
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10885
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.67
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:42:56.863250 10885 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:42:56.863586 10885 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:42:56.876691 10894 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:56.876799 10885 server_base.cc:1034] running on GCE node
W20260807 22:42:56.877017 10897 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:56.876693 10895 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:56.877406 10885 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:42:56.877712 10885 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:42:56.878881 10885 hybrid_clock.cc:648] HybridClock initialized: now 1786142576878853 us; error 43 us; skew 500 ppm
Aug 07 22:42:56 dist-test-slave-2d19 krb5kdc[9559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142576, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:42:56.882609 10885 init.cc:377] Logged in from keytab as kudu/127.22.212.67@KRBTEST.COM (short username kudu)
I20260807 22:42:56.883227 10885 webserver.cc:460] Webserver started at http://127.22.212.67:42145/ using document root <none> and password file <none>
I20260807 22:42:56.883553 10885 fs_manager.cc:359] Metadata directory not provided
I20260807 22:42:56.883634 10885 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:42:56.883805 10885 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 22:42:56 dist-test-slave-2d19 krb5kdc[9559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142576, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for HTTP/127.22.212.84@KRBTEST.COM
I20260807 22:42:56.906126 10885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-2/data/instance:
uuid: "2135574ce9ff40da8011f0e627e2a76a"
format_stamp: "Formatted at 2026-08-07 22:42:56 on dist-test-slave-2d19"
server_key: "3f84a0561fb3734a29bd56cb5d865813"
server_key_iv: "a89ed35fe0b1a8652716b2a19eb14d51"
server_key_version: "kuduclusterkey@0"
I20260807 22:42:56.906649 10885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance:
uuid: "2135574ce9ff40da8011f0e627e2a76a"
format_stamp: "Formatted at 2026-08-07 22:42:56 on dist-test-slave-2d19"
server_key: "3f84a0561fb3734a29bd56cb5d865813"
server_key_iv: "a89ed35fe0b1a8652716b2a19eb14d51"
server_key_version: "kuduclusterkey@0"
I20260807 22:42:56.909971 10885 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.004s
I20260807 22:42:56.924975 10910 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:56.925356 10885 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 22:42:56.925462 10885 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-2/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-2/wal
uuid: "2135574ce9ff40da8011f0e627e2a76a"
format_stamp: "Formatted at 2026-08-07 22:42:56 on dist-test-slave-2d19"
server_key: "3f84a0561fb3734a29bd56cb5d865813"
server_key_iv: "a89ed35fe0b1a8652716b2a19eb14d51"
server_key_version: "kuduclusterkey@0"
I20260807 22:42:56.925562 10885 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:42:56.965298 10885 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:42:56.968098 10885 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:42:56.968360 10885 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:42:56.968657 10885 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:42:56.969115 10885 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:42:56.969215 10885 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:56.969292 10885 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:42:56.969352 10885 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:56.976657 10885 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.67:40599
I20260807 22:42:56.977172 10885 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
I20260807 22:42:56.980062 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 10885
I20260807 22:42:56.980166 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance
I20260807 22:42:56.980370 23377 external_mini_cluster.cc:1428] Setting key 15ae8a7c3599596003977ce177ac7239
Aug 07 22:42:56 dist-test-slave-2d19 krb5kdc[9559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142576, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:42:56.988303 10669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:56.978373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:44187 (local address 127.22.212.126:37595)
0807 22:42:56.978418 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:56.978420 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:56.978431 (+ 11us) server_negotiation.cc:407] Connection header received
0807 22:42:56.979003 (+ 572us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:56.979005 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:56.979021 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:56.979070 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:56.979673 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:56.980445 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:56.981936 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:56.982264 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:56.982313 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:56.985032 (+ 2719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:56.985034 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:56.985034 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:56.985042 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:56.986740 (+ 1698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:56.987176 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:56.987178 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:56.987178 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:56.987238 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:56.987519 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:56.987520 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:56.987520 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:56.987688 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:56.987764 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:56.988064 (+ 300us) server_negotiation.cc:299] Negotiation successful
0807 22:42:56.988152 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 22:42:56.988500 11088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:56.978067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:37595 (local address 127.22.212.67:44187)
0807 22:42:56.978242 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:56.978287 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 22:42:56.978872 (+ 585us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:42:56.979161 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:42:56.979166 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:42:56.979373 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:42:56.979581 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:56.979587 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:56.980564 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:56.980565 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:56.981826 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:56.981830 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:56.982412 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:56.982413 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:56.982566 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:56.983175 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:42:56.983186 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:42:56.984903 (+ 1717us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:42:56.986841 (+ 1938us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:56.986850 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:56.986852 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:56.987097 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:56.987317 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:56.987318 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:56.987318 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:56.987459 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:56.987770 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:42:56.987778 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:42:56.987922 (+ 144us) client_negotiation.cc:769] Sending connection context
0807 22:42:56.988042 (+ 120us) client_negotiation.cc:240] Negotiation successful
0807 22:42:56.988212 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":95,"threads_started":1}
I20260807 22:42:56.989022 11084 heartbeater.cc:347] Connected to a master server at 127.22.212.126:37595
I20260807 22:42:56.989152 11084 heartbeater.cc:464] Registering TS with master...
I20260807 22:42:56.989343 11084 heartbeater.cc:511] Master 127.22.212.126:37595 requested a full tablet report, sending...
I20260807 22:42:56.989768 10343 ts_manager.cc:194] Registered new tserver with Master: 2135574ce9ff40da8011f0e627e2a76a (127.22.212.67:40599)
I20260807 22:42:56.990283 10343 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.67@KRBTEST.COM'} at 127.22.212.67:44187
I20260807 22:42:56.992126 23377 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:42:56.992937 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 10463
I20260807 22:42:56.993010 11083 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.67:40599 every 8 connection(s)
I20260807 22:42:57.028975 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 10676
I20260807 22:42:57.037779 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 10885
I20260807 22:42:57.061890 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 10294
I20260807 22:42:57.077849 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:37595
--webserver_interface=127.22.212.126
--webserver_port=40147
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:35413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:37595
--ranger_config_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.212.84:36849/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.22.212.84:36849/kms with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:42:57.163928 11089 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:42:57.164160 11089 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:42:57.164181 11089 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:42:57.165369 11089 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:42:57.165413 11089 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:42:57.165428 11089 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:42:57.165441 11089 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:42:57.165453 11089 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:42:57.166977 11089 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:35413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.22.212.84:36849/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:37595
--ranger_config_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:37595
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=40147
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11089
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:42:57.167176 11089 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:42:57.167340 11089 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:42:57.172362 11110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:57.172403 11112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:57.172403 11108 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:57.172454 11089 server_base.cc:1034] running on GCE node
I20260807 22:42:57.172802 11089 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:42:57.173094 11089 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:42:57.174232 11089 hybrid_clock.cc:648] HybridClock initialized: now 1786142577174222 us; error 29 us; skew 500 ppm
Aug 07 22:42:57 dist-test-slave-2d19 krb5kdc[9559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142577, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:42:57.176817 11089 init.cc:377] Logged in from keytab as kudu/127.22.212.126@KRBTEST.COM (short username kudu)
I20260807 22:42:57.177300 11089 webserver.cc:460] Webserver started at http://127.22.212.126:40147/ using document root <none> and password file <none>
I20260807 22:42:57.177547 11089 fs_manager.cc:359] Metadata directory not provided
I20260807 22:42:57.177625 11089 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 22:42:57 dist-test-slave-2d19 krb5kdc[9559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142577, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for HTTP/127.22.212.84@KRBTEST.COM
I20260807 22:42:57.259845 11089 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:42:57.260848 11125 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:57.261137 11089 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260807 22:42:57.261250 11089 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "03dcd21e411f479fa746a35c3cb4e5c8"
format_stamp: "Formatted at 2026-08-07 22:42:55 on dist-test-slave-2d19"
server_key: "116bb3c1957785aabe2dac2969df3855"
server_key_iv: "4cefd3988d3bd2e6d31991e06c95642d"
server_key_version: "kuduclusterkey@0"
I20260807 22:42:57.261739 11089 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:42:57.274813 11089 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:42:57.277020 11089 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:42:57.277189 11089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:42:57.282558 11089 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:37595
I20260807 22:42:57.282585 11204 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:37595 every 8 connection(s)
I20260807 22:42:57.283108 11089 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:42:57.284442 11205 sys_catalog.cc:263] Verifying existing consensus state
I20260807 22:42:57.285339 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 11089
I20260807 22:42:57.285485 11205 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03dcd21e411f479fa746a35c3cb4e5c8: Bootstrap starting.
I20260807 22:42:57.285660 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.212.84:36849/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.65:38687
--local_ip_for_outbound_sockets=127.22.212.65
--tserver_master_addrs=127.22.212.126:37595
--webserver_port=43271
--webserver_interface=127.22.212.65
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:35413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.22.212.84:36849/kms with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:42:57.294247 11205 log.cc:824] T 00000000000000000000000000000000 P 03dcd21e411f479fa746a35c3cb4e5c8: Log is configured to *not* fsync() on all Append() calls
I20260807 22:42:57.296011 11205 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03dcd21e411f479fa746a35c3cb4e5c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 22:42:57.296387 11205 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03dcd21e411f479fa746a35c3cb4e5c8: Bootstrap complete.
I20260807 22:42:57.298827 11205 raft_consensus.cc:348] T 00000000000000000000000000000000 P 03dcd21e411f479fa746a35c3cb4e5c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03dcd21e411f479fa746a35c3cb4e5c8" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 37595 } }
I20260807 22:42:57.299098 11205 raft_consensus.cc:729] T 00000000000000000000000000000000 P 03dcd21e411f479fa746a35c3cb4e5c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03dcd21e411f479fa746a35c3cb4e5c8, State: Initialized, Role: FOLLOWER
I20260807 22:42:57.299296 11205 consensus_queue.cc:260] T 00000000000000000000000000000000 P 03dcd21e411f479fa746a35c3cb4e5c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03dcd21e411f479fa746a35c3cb4e5c8" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 37595 } }
I20260807 22:42:57.299400 11205 raft_consensus.cc:388] T 00000000000000000000000000000000 P 03dcd21e411f479fa746a35c3cb4e5c8 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:42:57.299470 11205 raft_consensus.cc:482] T 00000000000000000000000000000000 P 03dcd21e411f479fa746a35c3cb4e5c8 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:42:57.299547 11205 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 03dcd21e411f479fa746a35c3cb4e5c8 [term 1 FOLLOWER]: Advancing to term 2
I20260807 22:42:57.300652 11205 raft_consensus.cc:504] T 00000000000000000000000000000000 P 03dcd21e411f479fa746a35c3cb4e5c8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03dcd21e411f479fa746a35c3cb4e5c8" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 37595 } }
I20260807 22:42:57.300771 11205 leader_election.cc:302] T 00000000000000000000000000000000 P 03dcd21e411f479fa746a35c3cb4e5c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 03dcd21e411f479fa746a35c3cb4e5c8; no voters:
I20260807 22:42:57.300967 11205 leader_election.cc:288] T 00000000000000000000000000000000 P 03dcd21e411f479fa746a35c3cb4e5c8 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 22:42:57.301004 11209 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 03dcd21e411f479fa746a35c3cb4e5c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 22:42:57.301223 11209 raft_consensus.cc:686] T 00000000000000000000000000000000 P 03dcd21e411f479fa746a35c3cb4e5c8 [term 2 LEADER]: Becoming Leader. State: Replica: 03dcd21e411f479fa746a35c3cb4e5c8, State: Running, Role: LEADER
I20260807 22:42:57.301321 11205 sys_catalog.cc:564] T 00000000000000000000000000000000 P 03dcd21e411f479fa746a35c3cb4e5c8 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:42:57.301375 11209 consensus_queue.cc:237] T 00000000000000000000000000000000 P 03dcd21e411f479fa746a35c3cb4e5c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03dcd21e411f479fa746a35c3cb4e5c8" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 37595 } }
I20260807 22:42:57.301693 11209 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03dcd21e411f479fa746a35c3cb4e5c8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "03dcd21e411f479fa746a35c3cb4e5c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03dcd21e411f479fa746a35c3cb4e5c8" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 37595 } } }
I20260807 22:42:57.301836 11209 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03dcd21e411f479fa746a35c3cb4e5c8 [sys.catalog]: This master's current role is: LEADER
I20260807 22:42:57.302026 11209 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03dcd21e411f479fa746a35c3cb4e5c8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 03dcd21e411f479fa746a35c3cb4e5c8. Latest consensus state: current_term: 2 leader_uuid: "03dcd21e411f479fa746a35c3cb4e5c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03dcd21e411f479fa746a35c3cb4e5c8" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 37595 } } }
I20260807 22:42:57.302150 11209 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03dcd21e411f479fa746a35c3cb4e5c8 [sys.catalog]: This master's current role is: LEADER
I20260807 22:42:57.302297 11223 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:42:57.302892 11223 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:42:57.303086 11223 catalog_manager.cc:1259] Loaded cluster ID: 246a5e30f6b34ae6a53a3d5d321374ac
I20260807 22:42:57.303169 11223 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:42:57.303261 11205 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 22:42:57.304422 11223 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:42:57.304641 11223 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 03dcd21e411f479fa746a35c3cb4e5c8: Loaded TSK: 0
I20260807 22:42:57.304888 11223 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 22:42:57.419963 11207 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:42:57.420405 11207 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:42:57.420521 11207 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:42:57.422341 11207 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:42:57.422575 11207 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:42:57.422670 11207 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.65
I20260807 22:42:57.424899 11207 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:35413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.22.212.84:36849/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.65:38687
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.212.65
--webserver_port=43271
--tserver_master_addrs=127.22.212.126:37595
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11207
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.65
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:42:57.425414 11207 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:42:57.425748 11207 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:42:57.432775 11276 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:57.433110 11273 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:57.433344 11207 server_base.cc:1034] running on GCE node
W20260807 22:42:57.440410 11278 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:57.440960 11207 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:42:57.441282 11207 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:42:57.442461 11207 hybrid_clock.cc:648] HybridClock initialized: now 1786142577442427 us; error 52 us; skew 500 ppm
Aug 07 22:42:57 dist-test-slave-2d19 krb5kdc[9559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142577, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:42:57.446002 11207 init.cc:377] Logged in from keytab as kudu/127.22.212.65@KRBTEST.COM (short username kudu)
I20260807 22:42:57.446587 11207 webserver.cc:460] Webserver started at http://127.22.212.65:43271/ using document root <none> and password file <none>
I20260807 22:42:57.447301 11207 fs_manager.cc:359] Metadata directory not provided
I20260807 22:42:57.447436 11207 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 22:42:57 dist-test-slave-2d19 krb5kdc[9559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142577, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for HTTP/127.22.212.84@KRBTEST.COM
I20260807 22:42:57.479305 11207 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.000s
I20260807 22:42:57.480660 11289 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:57.480887 11207 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260807 22:42:57.480981 11207 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-0/wal
uuid: "0124c3ec4b0a412c8093a851431447ce"
format_stamp: "Formatted at 2026-08-07 22:42:56 on dist-test-slave-2d19"
server_key: "912989a0c758b7554396c6b18f1ee0f3"
server_key_iv: "35869ac2ba244affb8e6ac30a77bc295"
server_key_version: "kuduclusterkey@0"
I20260807 22:42:57.481434 11207 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:42:57.499787 11207 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:42:57.502607 11207 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:42:57.502823 11207 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:42:57.503134 11207 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:42:57.503613 11207 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:42:57.503728 11207 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:57.503851 11207 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:42:57.503947 11207 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:57.510694 11207 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.65:38687
I20260807 22:42:57.511215 11207 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
I20260807 22:42:57.512957 11480 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.65:38687 every 8 connection(s)
I20260807 22:42:57.518460 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 11207
I20260807 22:42:57.518783 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.212.84:36849/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.66:44125
--local_ip_for_outbound_sockets=127.22.212.66
--tserver_master_addrs=127.22.212.126:37595
--webserver_port=45653
--webserver_interface=127.22.212.66
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:35413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.22.212.84:36849/kms with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 22:42:57 dist-test-slave-2d19 krb5kdc[9559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142577, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:42:57.531016 11483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:57.514221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:37595 (local address 127.22.212.65:60801)
0807 22:42:57.514610 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:57.514665 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 22:42:57.515503 (+ 838us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:42:57.517159 (+ 1656us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:42:57.517164 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:42:57.517385 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:42:57.517654 (+ 269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:57.517660 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:57.519669 (+ 2009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:57.519670 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:57.521954 (+ 2284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:57.521957 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:57.522828 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:57.522830 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:57.522988 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:57.523648 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:42:57.523658 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:42:57.526121 (+ 2463us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:42:57.529069 (+ 2948us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:57.529075 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:57.529078 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:57.529385 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:57.529692 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:57.529693 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:57.529693 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:57.529827 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:57.530318 (+ 491us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:42:57.530324 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:42:57.530482 (+ 158us) client_negotiation.cc:769] Sending connection context
0807 22:42:57.530577 (+ 95us) client_negotiation.cc:240] Negotiation successful
0807 22:42:57.530743 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":90,"threads_started":1}
I20260807 22:42:57.532753 11488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:57.514283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:60801 (local address 127.22.212.126:37595)
0807 22:42:57.516433 (+ 2150us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:57.516443 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:57.516481 (+ 38us) server_negotiation.cc:407] Connection header received
0807 22:42:57.516633 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:57.516640 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:57.516700 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:57.517788 (+ 1088us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:57.517894 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:57.519544 (+ 1650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:57.522073 (+ 2529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:57.522693 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:57.523534 (+ 841us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:57.526296 (+ 2762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:57.526301 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:57.526301 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:57.526311 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:57.528967 (+ 2656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:57.529494 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:57.529497 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:57.529497 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:57.529608 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:57.529923 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:57.529923 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:57.529924 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:57.530228 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:57.531665 (+ 1437us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:57.531744 (+ 79us) server_negotiation.cc:299] Negotiation successful
0807 22:42:57.532539 (+ 795us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2090,"thread_start_us":73,"threads_started":1}
I20260807 22:42:57.533716 11481 heartbeater.cc:347] Connected to a master server at 127.22.212.126:37595
I20260807 22:42:57.533814 11481 heartbeater.cc:464] Registering TS with master...
I20260807 22:42:57.534020 11481 heartbeater.cc:511] Master 127.22.212.126:37595 requested a full tablet report, sending...
W20260807 22:42:57.534953 11481 heartbeater.cc:644] Failed to heartbeat to 127.22.212.126:37595 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 22:42:57.535029 11481 heartbeater.cc:464] Registering TS with master...
I20260807 22:42:57.535094 11481 heartbeater.cc:511] Master 127.22.212.126:37595 requested a full tablet report, sending...
I20260807 22:42:57.535486 11481 heartbeater.cc:464] Registering TS with master...
I20260807 22:42:57.535559 11481 heartbeater.cc:511] Master 127.22.212.126:37595 requested a full tablet report, sending...
W20260807 22:42:57.535871 11481 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 22:42:57.641709 11491 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:42:57.642073 11491 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:42:57.642175 11491 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:42:57.643869 11491 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:42:57.644112 11491 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:42:57.644200 11491 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.66
I20260807 22:42:57.646335 11491 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:35413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.22.212.84:36849/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.66:44125
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.212.66
--webserver_port=45653
--tserver_master_addrs=127.22.212.126:37595
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11491
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.66
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:42:57.646840 11491 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:42:57.647176 11491 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:42:57.654371 11503 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:57.654745 11491 server_base.cc:1034] running on GCE node
W20260807 22:42:57.657071 11501 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:57.657830 11500 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:57.658443 11491 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:42:57.658785 11491 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:42:57.662101 11491 hybrid_clock.cc:648] HybridClock initialized: now 1786142577662065 us; error 51 us; skew 500 ppm
Aug 07 22:42:57 dist-test-slave-2d19 krb5kdc[9559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142577, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:42:57.665060 11491 init.cc:377] Logged in from keytab as kudu/127.22.212.66@KRBTEST.COM (short username kudu)
I20260807 22:42:57.665604 11491 webserver.cc:460] Webserver started at http://127.22.212.66:45653/ using document root <none> and password file <none>
I20260807 22:42:57.665930 11491 fs_manager.cc:359] Metadata directory not provided
I20260807 22:42:57.666034 11491 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 22:42:57 dist-test-slave-2d19 krb5kdc[9559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142577, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for HTTP/127.22.212.84@KRBTEST.COM
I20260807 22:42:57.698920 11491 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260807 22:42:57.703766 11519 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:57.704000 11491 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.000s
I20260807 22:42:57.704089 11491 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-1/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-1/wal
uuid: "5cd898a32ddc4844a11914b2185d0f01"
format_stamp: "Formatted at 2026-08-07 22:42:56 on dist-test-slave-2d19"
server_key: "036566f0ef3e1b92d6d6f4cca1910da4"
server_key_iv: "7cb93e9f6451ca91848c0d38cb149c19"
server_key_version: "kuduclusterkey@0"
I20260807 22:42:57.704576 11491 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:42:57.729027 11491 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:42:57.731720 11491 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:42:57.731909 11491 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:42:57.732157 11491 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:42:57.732569 11491 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:42:57.732616 11491 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:57.732647 11491 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:42:57.732666 11491 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:57.739809 11491 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.66:44125
I20260807 22:42:57.741086 11693 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.66:44125 every 8 connection(s)
I20260807 22:42:57.741267 11491 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
I20260807 22:42:57.749271 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 11491
Aug 07 22:42:57 dist-test-slave-2d19 krb5kdc[9559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142577, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:42:57.749578 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.212.84:36849/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.67:40599
--local_ip_for_outbound_sockets=127.22.212.67
--tserver_master_addrs=127.22.212.126:37595
--webserver_port=42145
--webserver_interface=127.22.212.67
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:35413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.22.212.84:36849/kms with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:42:57.756093 11488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:57.742627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:46657 (local address 127.22.212.126:37595)
0807 22:42:57.742689 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:57.742692 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:57.742874 (+ 182us) server_negotiation.cc:407] Connection header received
0807 22:42:57.743540 (+ 666us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:57.743541 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:57.743558 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:57.743590 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:57.744451 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:57.745255 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:57.746752 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:57.747078 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:57.747125 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:57.752613 (+ 5488us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:57.752615 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:57.752615 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:57.752624 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:57.754440 (+ 1816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:57.754946 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:57.754947 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:57.754947 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:57.755010 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:57.755293 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:57.755294 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:57.755294 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:57.755432 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:57.755498 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:57.755881 (+ 383us) server_negotiation.cc:299] Negotiation successful
0807 22:42:57.755991 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260807 22:42:57.756364 11699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:57.742341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:37595 (local address 127.22.212.66:46657)
0807 22:42:57.742719 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:57.742765 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 22:42:57.743401 (+ 636us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:42:57.743773 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:42:57.743777 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:42:57.744015 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:42:57.744334 (+ 319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:57.744342 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:57.745380 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:57.745381 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:57.746642 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:57.746645 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:57.747240 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:57.747241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:57.747390 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:57.748034 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:42:57.748044 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:42:57.752482 (+ 4438us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:42:57.754524 (+ 2042us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:57.754532 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:57.754535 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:57.754838 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:57.755082 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:57.755083 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:57.755083 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:57.755218 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:57.755527 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:42:57.755533 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:42:57.755703 (+ 170us) client_negotiation.cc:769] Sending connection context
0807 22:42:57.755825 (+ 122us) client_negotiation.cc:240] Negotiation successful
0807 22:42:57.756007 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":86,"threads_started":1}
I20260807 22:42:57.756839 11694 heartbeater.cc:347] Connected to a master server at 127.22.212.126:37595
I20260807 22:42:57.756958 11694 heartbeater.cc:464] Registering TS with master...
I20260807 22:42:57.757165 11694 heartbeater.cc:511] Master 127.22.212.126:37595 requested a full tablet report, sending...
W20260807 22:42:57.757988 11694 heartbeater.cc:644] Failed to heartbeat to 127.22.212.126:37595 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 22:42:57.758076 11694 heartbeater.cc:464] Registering TS with master...
I20260807 22:42:57.758140 11694 heartbeater.cc:511] Master 127.22.212.126:37595 requested a full tablet report, sending...
I20260807 22:42:57.758543 11694 heartbeater.cc:464] Registering TS with master...
I20260807 22:42:57.758625 11694 heartbeater.cc:511] Master 127.22.212.126:37595 requested a full tablet report, sending...
W20260807 22:42:57.758994 11694 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 22:42:57.861981 11700 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:42:57.862269 11700 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:42:57.862306 11700 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:42:57.864003 11700 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:42:57.864065 11700 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:42:57.864104 11700 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.67
I20260807 22:42:57.866299 11700 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:35413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.22.212.84:36849/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.67:40599
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.212.67
--webserver_port=42145
--tserver_master_addrs=127.22.212.126:37595
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11700
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.67
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:42:57.866595 11700 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:42:57.866856 11700 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:42:57.875640 11709 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:57.875607 11712 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:42:57.876454 11708 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:42:57.877225 11700 server_base.cc:1034] running on GCE node
I20260807 22:42:57.877508 11700 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:42:57.877826 11700 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:42:57.879021 11700 hybrid_clock.cc:648] HybridClock initialized: now 1786142577878998 us; error 41 us; skew 500 ppm
Aug 07 22:42:57 dist-test-slave-2d19 krb5kdc[9559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142577, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:42:57.882377 11700 init.cc:377] Logged in from keytab as kudu/127.22.212.67@KRBTEST.COM (short username kudu)
I20260807 22:42:57.882961 11700 webserver.cc:460] Webserver started at http://127.22.212.67:42145/ using document root <none> and password file <none>
I20260807 22:42:57.883261 11700 fs_manager.cc:359] Metadata directory not provided
I20260807 22:42:57.883361 11700 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 22:42:57 dist-test-slave-2d19 krb5kdc[9559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142577, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for HTTP/127.22.212.84@KRBTEST.COM
I20260807 22:42:57.906455 11700 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:42:57.907183 11723 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:57.907337 11700 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 22:42:57.907424 11700 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-2/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-2/wal
uuid: "2135574ce9ff40da8011f0e627e2a76a"
format_stamp: "Formatted at 2026-08-07 22:42:56 on dist-test-slave-2d19"
server_key: "3f84a0561fb3734a29bd56cb5d865813"
server_key_iv: "a89ed35fe0b1a8652716b2a19eb14d51"
server_key_version: "kuduclusterkey@0"
I20260807 22:42:57.908735 11700 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:42:57.923847 11700 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:42:57.926234 11700 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:42:57.926385 11700 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:42:57.926617 11700 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:42:57.926949 11700 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:42:57.926990 11700 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:57.927019 11700 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:42:57.927043 11700 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:42:57.934558 11700 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.67:40599
I20260807 22:42:57.934652 11901 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.67:40599 every 8 connection(s)
I20260807 22:42:57.935050 11700 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
I20260807 22:42:57.941326 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 11700
Aug 07 22:42:57 dist-test-slave-2d19 krb5kdc[9559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142577, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:42:57.950378 11488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:57.935935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:41641 (local address 127.22.212.126:37595)
0807 22:42:57.939302 (+ 3367us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:57.939304 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:57.939318 (+ 14us) server_negotiation.cc:407] Connection header received
0807 22:42:57.939350 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:57.939351 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:57.939364 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:57.939445 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:57.940238 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:57.941067 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:57.943305 (+ 2238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:57.943624 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:57.943670 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:57.946663 (+ 2993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:57.946664 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:57.946665 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:57.946673 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:57.948498 (+ 1825us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:57.949181 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:57.949182 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:57.949182 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:57.949246 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:57.949592 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:57.949594 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:57.949594 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:57.949747 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:57.949823 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:57.950198 (+ 375us) server_negotiation.cc:299] Negotiation successful
0807 22:42:57.950283 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3308}
I20260807 22:42:57.950793 11911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:57.935940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:37595 (local address 127.22.212.67:41641)
0807 22:42:57.936157 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:57.937024 (+ 867us) client_negotiation.cc:174] Beginning negotiation
0807 22:42:57.937505 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:42:57.939583 (+ 2078us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:42:57.939588 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:42:57.939826 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:42:57.940112 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:57.940120 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:57.941896 (+ 1776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:57.941897 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:57.943192 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:57.943195 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:57.943784 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:57.943785 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:57.943941 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:57.944765 (+ 824us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:42:57.944776 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:42:57.946529 (+ 1753us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:42:57.948844 (+ 2315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:57.948851 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:57.948853 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:57.949087 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:57.949349 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:42:57.949350 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:42:57.949350 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:42:57.949502 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:42:57.949829 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:42:57.949837 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:42:57.950028 (+ 191us) client_negotiation.cc:769] Sending connection context
0807 22:42:57.950160 (+ 132us) client_negotiation.cc:240] Negotiation successful
0807 22:42:57.950321 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":133,"threads_started":1}
I20260807 22:42:57.951336 11902 heartbeater.cc:347] Connected to a master server at 127.22.212.126:37595
I20260807 22:42:57.951494 11902 heartbeater.cc:464] Registering TS with master...
I20260807 22:42:57.951711 11902 heartbeater.cc:511] Master 127.22.212.126:37595 requested a full tablet report, sending...
W20260807 22:42:57.952863 11902 heartbeater.cc:644] Failed to heartbeat to 127.22.212.126:37595 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 22:42:57.952973 11902 heartbeater.cc:464] Registering TS with master...
I20260807 22:42:57.953052 11902 heartbeater.cc:511] Master 127.22.212.126:37595 requested a full tablet report, sending...
I20260807 22:42:57.953449 11902 heartbeater.cc:464] Registering TS with master...
I20260807 22:42:57.953534 11902 heartbeater.cc:511] Master 127.22.212.126:37595 requested a full tablet report, sending...
I20260807 22:42:57.954703 11913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:57.945562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49968 (local address 127.22.212.126:37595)
0807 22:42:57.945737 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:57.945739 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:57.945747 (+ 8us) server_negotiation.cc:407] Connection header received
0807 22:42:57.945769 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:57.945770 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:57.945781 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:57.945849 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:57.947162 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:57.948234 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:57.949317 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:57.949642 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:57.949726 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:57.951237 (+ 1511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:57.951238 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:57.951239 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:57.951246 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:57.952984 (+ 1738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:57.953748 (+ 764us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:57.953749 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:57.953749 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:57.953813 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:57.954069 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:57.954070 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:57.954071 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:57.954212 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:57.954381 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:57.954495 (+ 114us) server_negotiation.cc:299] Negotiation successful
0807 22:42:57.954599 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":74,"threads_started":1}
W20260807 22:42:57.955502 11902 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 07 22:42:58 dist-test-slave-2d19 krb5kdc[9559](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786142578, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:42:58.536073 11481 heartbeater.cc:464] Registering TS with master...
I20260807 22:42:58.536231 11481 heartbeater.cc:511] Master 127.22.212.126:37595 requested a full tablet report, sending...
I20260807 22:42:58.536713 11151 ts_manager.cc:194] Registered new tserver with Master: 0124c3ec4b0a412c8093a851431447ce (127.22.212.65:38687)
I20260807 22:42:58.537734 11151 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.65@KRBTEST.COM'} at 127.22.212.65:60801
I20260807 22:42:58.759225 11694 heartbeater.cc:464] Registering TS with master...
I20260807 22:42:58.759394 11694 heartbeater.cc:511] Master 127.22.212.126:37595 requested a full tablet report, sending...
I20260807 22:42:58.759966 11151 ts_manager.cc:194] Registered new tserver with Master: 5cd898a32ddc4844a11914b2185d0f01 (127.22.212.66:44125)
I20260807 22:42:58.760643 11151 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.66@KRBTEST.COM'} at 127.22.212.66:46657
Aug 07 22:42:58 dist-test-slave-2d19 krb5kdc[9559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142578, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for HTTP/127.22.212.84@KRBTEST.COM
I20260807 22:42:58.955703 11902 heartbeater.cc:464] Registering TS with master...
I20260807 22:42:58.955884 11902 heartbeater.cc:511] Master 127.22.212.126:37595 requested a full tablet report, sending...
I20260807 22:42:58.956212 11151 ts_manager.cc:194] Registered new tserver with Master: 2135574ce9ff40da8011f0e627e2a76a (127.22.212.67:40599)
I20260807 22:42:58.956809 11151 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.67@KRBTEST.COM'} at 127.22.212.67:41641
I20260807 22:42:58.962313 23377 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:42:58.972783 11940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:58.963919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49982 (local address 127.22.212.126:37595)
0807 22:42:58.964310 (+ 391us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:58.964312 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:58.964488 (+ 176us) server_negotiation.cc:407] Connection header received
0807 22:42:58.964515 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:58.964516 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:58.964529 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:58.964588 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:42:58.965358 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:58.966186 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:58.967294 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:58.967592 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:58.967663 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:58.969229 (+ 1566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:42:58.969230 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:42:58.969230 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:42:58.969237 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:42:58.971062 (+ 1825us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:58.971463 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:58.971464 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:58.971464 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:58.971527 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:42:58.971743 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:42:58.971744 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:42:58.971745 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:42:58.971896 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:42:58.971991 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:58.972560 (+ 569us) server_negotiation.cc:299] Negotiation successful
0807 22:42:58.972673 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":76,"threads_started":1}
I20260807 22:42:58.975227 11151 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49982:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:42:58.977649 11151 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:42:58.999733 11959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:58.985925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.67:40599 (local address 127.0.0.1:45756)
0807 22:42:58.986344 (+ 419us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:58.986391 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 22:42:58.986462 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:42:58.987322 (+ 860us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:42:58.987326 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:42:58.987329 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:42:58.987407 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:58.987409 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:58.989611 (+ 2202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:58.989612 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:58.990949 (+ 1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:58.990953 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:58.999397 (+ 8444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:58.999398 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:58.999499 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:58.999516 (+ 17us) client_negotiation.cc:769] Sending connection context
0807 22:42:58.999579 (+ 63us) client_negotiation.cc:240] Negotiation successful
0807 22:42:58.999639 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":78,"threads_started":1}
I20260807 22:42:59.000864 11963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:58.986620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45756 (local address 127.22.212.67:40599)
0807 22:42:58.987039 (+ 419us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:58.987043 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:58.987064 (+ 21us) server_negotiation.cc:407] Connection header received
0807 22:42:58.987100 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:58.987103 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:58.987119 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:58.987482 (+ 363us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:42:58.987568 (+ 86us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:58.989004 (+ 1436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:58.991328 (+ 2324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:58.992181 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:59.000601 (+ 8420us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:59.000695 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:59.000729 (+ 34us) server_negotiation.cc:299] Negotiation successful
0807 22:42:59.000782 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":389,"thread_start_us":53,"threads_started":1}
I20260807 22:42:59.001888 11800 tablet_service.cc:1467] Processing CreateTablet for tablet 02b1798907ef496e9fea5e1352ee750f (DEFAULT_TABLE table=test-table [id=126b70bf611846d1a61b0278175e1f7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:42:59.002305 11800 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02b1798907ef496e9fea5e1352ee750f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:42:59.002962 11957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:58.985993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.66:44125 (local address 127.0.0.1:46564)
0807 22:42:58.989136 (+ 3143us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:58.989146 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 22:42:58.989196 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:42:58.992706 (+ 3510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:42:58.992707 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:42:58.992709 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:42:58.992770 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:58.992771 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:58.995490 (+ 2719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:58.995491 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:58.996662 (+ 1171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:58.996666 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:59.002731 (+ 6065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:59.002731 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:59.002799 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:59.002802 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:42:59.002840 (+ 38us) client_negotiation.cc:240] Negotiation successful
0807 22:42:59.002886 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3123,"thread_start_us":97,"threads_started":1}
I20260807 22:42:59.003322 11962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:58.986456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46564 (local address 127.22.212.66:44125)
0807 22:42:58.987258 (+ 802us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:58.987262 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:58.989258 (+ 1996us) server_negotiation.cc:407] Connection header received
0807 22:42:58.989300 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:58.989303 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:58.989321 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:58.989390 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:42:58.992858 (+ 3468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:58.994235 (+ 1377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:58.996772 (+ 2537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:58.999169 (+ 2397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:58.999247 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:58.999320 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:59.003181 (+ 3861us) server_negotiation.cc:299] Negotiation successful
0807 22:42:59.003238 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":774,"thread_start_us":62,"threads_started":1}
I20260807 22:42:59.003589 11961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:58.986280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54290 (local address 127.22.212.65:38687)
0807 22:42:58.986944 (+ 664us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:58.986950 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:58.989555 (+ 2605us) server_negotiation.cc:407] Connection header received
0807 22:42:58.992388 (+ 2833us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:58.992391 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:58.992408 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:58.992465 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:42:58.994347 (+ 1882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:58.995401 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:59.001218 (+ 5817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:59.002401 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:59.002459 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:59.002512 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:59.003465 (+ 953us) server_negotiation.cc:299] Negotiation successful
0807 22:42:59.003516 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":625,"thread_start_us":56,"threads_started":1}
I20260807 22:42:59.003783 11958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:58.986186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:38687 (local address 127.0.0.1:54290)
0807 22:42:58.989493 (+ 3307us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:58.989503 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 22:42:58.992284 (+ 2781us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:42:58.992582 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:42:58.992583 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:42:58.992585 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:42:58.992638 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:58.992640 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:58.997536 (+ 4896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:58.997537 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:58.998643 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:58.998646 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:59.002580 (+ 3934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:59.002581 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:59.002654 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:59.002658 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 22:42:59.003668 (+ 1010us) client_negotiation.cc:240] Negotiation successful
0807 22:42:59.003715 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3291,"thread_start_us":100,"threads_started":1}
I20260807 22:42:59.004611 11370 tablet_service.cc:1467] Processing CreateTablet for tablet 02b1798907ef496e9fea5e1352ee750f (DEFAULT_TABLE table=test-table [id=126b70bf611846d1a61b0278175e1f7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:42:59.004946 11370 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02b1798907ef496e9fea5e1352ee750f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:42:59.004981 11590 tablet_service.cc:1467] Processing CreateTablet for tablet 02b1798907ef496e9fea5e1352ee750f (DEFAULT_TABLE table=test-table [id=126b70bf611846d1a61b0278175e1f7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:42:59.005343 11590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02b1798907ef496e9fea5e1352ee750f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:42:59.006340 11967 tablet_bootstrap.cc:492] T 02b1798907ef496e9fea5e1352ee750f P 2135574ce9ff40da8011f0e627e2a76a: Bootstrap starting.
I20260807 22:42:59.007014 11967 tablet_bootstrap.cc:654] T 02b1798907ef496e9fea5e1352ee750f P 2135574ce9ff40da8011f0e627e2a76a: Neither blocks nor log segments found. Creating new log.
I20260807 22:42:59.007326 11967 log.cc:824] T 02b1798907ef496e9fea5e1352ee750f P 2135574ce9ff40da8011f0e627e2a76a: Log is configured to *not* fsync() on all Append() calls
I20260807 22:42:59.008103 11967 tablet_bootstrap.cc:492] T 02b1798907ef496e9fea5e1352ee750f P 2135574ce9ff40da8011f0e627e2a76a: No bootstrap required, opened a new log
I20260807 22:42:59.008167 11967 ts_tablet_manager.cc:1397] T 02b1798907ef496e9fea5e1352ee750f P 2135574ce9ff40da8011f0e627e2a76a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 22:42:59.010713 11967 raft_consensus.cc:348] T 02b1798907ef496e9fea5e1352ee750f P 2135574ce9ff40da8011f0e627e2a76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2135574ce9ff40da8011f0e627e2a76a" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 40599 } } peers { permanent_uuid: "5cd898a32ddc4844a11914b2185d0f01" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 44125 } } peers { permanent_uuid: "0124c3ec4b0a412c8093a851431447ce" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38687 } }
I20260807 22:42:59.010893 11967 raft_consensus.cc:374] T 02b1798907ef496e9fea5e1352ee750f P 2135574ce9ff40da8011f0e627e2a76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:42:59.010924 11967 raft_consensus.cc:729] T 02b1798907ef496e9fea5e1352ee750f P 2135574ce9ff40da8011f0e627e2a76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2135574ce9ff40da8011f0e627e2a76a, State: Initialized, Role: FOLLOWER
I20260807 22:42:59.011050 11967 consensus_queue.cc:260] T 02b1798907ef496e9fea5e1352ee750f P 2135574ce9ff40da8011f0e627e2a76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2135574ce9ff40da8011f0e627e2a76a" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 40599 } } peers { permanent_uuid: "5cd898a32ddc4844a11914b2185d0f01" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 44125 } } peers { permanent_uuid: "0124c3ec4b0a412c8093a851431447ce" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38687 } }
I20260807 22:42:59.011317 11967 ts_tablet_manager.cc:1428] T 02b1798907ef496e9fea5e1352ee750f P 2135574ce9ff40da8011f0e627e2a76a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 22:42:59.011442 11902 heartbeater.cc:503] Master 127.22.212.126:37595 was elected leader, sending a full tablet report...
I20260807 22:42:59.011848 11971 tablet_bootstrap.cc:492] T 02b1798907ef496e9fea5e1352ee750f P 5cd898a32ddc4844a11914b2185d0f01: Bootstrap starting.
I20260807 22:42:59.012806 11971 tablet_bootstrap.cc:654] T 02b1798907ef496e9fea5e1352ee750f P 5cd898a32ddc4844a11914b2185d0f01: Neither blocks nor log segments found. Creating new log.
I20260807 22:42:59.013123 11971 log.cc:824] T 02b1798907ef496e9fea5e1352ee750f P 5cd898a32ddc4844a11914b2185d0f01: Log is configured to *not* fsync() on all Append() calls
I20260807 22:42:59.014045 11971 tablet_bootstrap.cc:492] T 02b1798907ef496e9fea5e1352ee750f P 5cd898a32ddc4844a11914b2185d0f01: No bootstrap required, opened a new log
I20260807 22:42:59.014115 11971 ts_tablet_manager.cc:1397] T 02b1798907ef496e9fea5e1352ee750f P 5cd898a32ddc4844a11914b2185d0f01: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 22:42:59.016469 11970 tablet_bootstrap.cc:492] T 02b1798907ef496e9fea5e1352ee750f P 0124c3ec4b0a412c8093a851431447ce: Bootstrap starting.
I20260807 22:42:59.016467 11971 raft_consensus.cc:348] T 02b1798907ef496e9fea5e1352ee750f P 5cd898a32ddc4844a11914b2185d0f01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2135574ce9ff40da8011f0e627e2a76a" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 40599 } } peers { permanent_uuid: "5cd898a32ddc4844a11914b2185d0f01" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 44125 } } peers { permanent_uuid: "0124c3ec4b0a412c8093a851431447ce" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38687 } }
I20260807 22:42:59.016664 11971 raft_consensus.cc:374] T 02b1798907ef496e9fea5e1352ee750f P 5cd898a32ddc4844a11914b2185d0f01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:42:59.016716 11971 raft_consensus.cc:729] T 02b1798907ef496e9fea5e1352ee750f P 5cd898a32ddc4844a11914b2185d0f01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cd898a32ddc4844a11914b2185d0f01, State: Initialized, Role: FOLLOWER
I20260807 22:42:59.016866 11971 consensus_queue.cc:260] T 02b1798907ef496e9fea5e1352ee750f P 5cd898a32ddc4844a11914b2185d0f01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2135574ce9ff40da8011f0e627e2a76a" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 40599 } } peers { permanent_uuid: "5cd898a32ddc4844a11914b2185d0f01" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 44125 } } peers { permanent_uuid: "0124c3ec4b0a412c8093a851431447ce" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38687 } }
I20260807 22:42:59.017139 11971 ts_tablet_manager.cc:1428] T 02b1798907ef496e9fea5e1352ee750f P 5cd898a32ddc4844a11914b2185d0f01: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 22:42:59.017266 11694 heartbeater.cc:503] Master 127.22.212.126:37595 was elected leader, sending a full tablet report...
I20260807 22:42:59.017333 11970 tablet_bootstrap.cc:654] T 02b1798907ef496e9fea5e1352ee750f P 0124c3ec4b0a412c8093a851431447ce: Neither blocks nor log segments found. Creating new log.
I20260807 22:42:59.017720 11970 log.cc:824] T 02b1798907ef496e9fea5e1352ee750f P 0124c3ec4b0a412c8093a851431447ce: Log is configured to *not* fsync() on all Append() calls
I20260807 22:42:59.018836 11970 tablet_bootstrap.cc:492] T 02b1798907ef496e9fea5e1352ee750f P 0124c3ec4b0a412c8093a851431447ce: No bootstrap required, opened a new log
I20260807 22:42:59.018918 11970 ts_tablet_manager.cc:1397] T 02b1798907ef496e9fea5e1352ee750f P 0124c3ec4b0a412c8093a851431447ce: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260807 22:42:59.021493 11970 raft_consensus.cc:348] T 02b1798907ef496e9fea5e1352ee750f P 0124c3ec4b0a412c8093a851431447ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2135574ce9ff40da8011f0e627e2a76a" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 40599 } } peers { permanent_uuid: "5cd898a32ddc4844a11914b2185d0f01" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 44125 } } peers { permanent_uuid: "0124c3ec4b0a412c8093a851431447ce" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38687 } }
I20260807 22:42:59.021687 11970 raft_consensus.cc:374] T 02b1798907ef496e9fea5e1352ee750f P 0124c3ec4b0a412c8093a851431447ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:42:59.021723 11970 raft_consensus.cc:729] T 02b1798907ef496e9fea5e1352ee750f P 0124c3ec4b0a412c8093a851431447ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0124c3ec4b0a412c8093a851431447ce, State: Initialized, Role: FOLLOWER
I20260807 22:42:59.021853 11970 consensus_queue.cc:260] T 02b1798907ef496e9fea5e1352ee750f P 0124c3ec4b0a412c8093a851431447ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2135574ce9ff40da8011f0e627e2a76a" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 40599 } } peers { permanent_uuid: "5cd898a32ddc4844a11914b2185d0f01" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 44125 } } peers { permanent_uuid: "0124c3ec4b0a412c8093a851431447ce" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38687 } }
I20260807 22:42:59.022107 11970 ts_tablet_manager.cc:1428] T 02b1798907ef496e9fea5e1352ee750f P 0124c3ec4b0a412c8093a851431447ce: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260807 22:42:59.022238 11481 heartbeater.cc:503] Master 127.22.212.126:37595 was elected leader, sending a full tablet report...
W20260807 22:42:59.186434 11903 tablet.cc:2369] T 02b1798907ef496e9fea5e1352ee750f P 2135574ce9ff40da8011f0e627e2a76a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 22:42:59.244143 11698 tablet.cc:2369] T 02b1798907ef496e9fea5e1352ee750f P 5cd898a32ddc4844a11914b2185d0f01: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 07 22:42:59 dist-test-slave-2d19 krb5kdc[9559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142578, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for HTTP/127.22.212.84@KRBTEST.COM
W20260807 22:42:59.265727 11482 tablet.cc:2369] T 02b1798907ef496e9fea5e1352ee750f P 0124c3ec4b0a412c8093a851431447ce: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:42:59.349987 11983 raft_consensus.cc:482] T 02b1798907ef496e9fea5e1352ee750f P 0124c3ec4b0a412c8093a851431447ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:42:59.350216 11983 raft_consensus.cc:504] T 02b1798907ef496e9fea5e1352ee750f P 0124c3ec4b0a412c8093a851431447ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2135574ce9ff40da8011f0e627e2a76a" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 40599 } } peers { permanent_uuid: "5cd898a32ddc4844a11914b2185d0f01" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 44125 } } peers { permanent_uuid: "0124c3ec4b0a412c8093a851431447ce" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38687 } }
I20260807 22:42:59.350808 11983 leader_election.cc:288] T 02b1798907ef496e9fea5e1352ee750f P 0124c3ec4b0a412c8093a851431447ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2135574ce9ff40da8011f0e627e2a76a (127.22.212.67:40599), 5cd898a32ddc4844a11914b2185d0f01 (127.22.212.66:44125)
I20260807 22:42:59.363432 11962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:59.351719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:40179 (local address 127.22.212.66:44125)
0807 22:42:59.351780 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:59.351782 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:59.356480 (+ 4698us) server_negotiation.cc:407] Connection header received
0807 22:42:59.356615 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:59.356616 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:59.356626 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:59.356658 (+ 32us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:42:59.357116 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:59.357846 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:59.360176 (+ 2330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:59.360846 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:59.360899 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:59.360910 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:59.363297 (+ 2387us) server_negotiation.cc:299] Negotiation successful
0807 22:42:59.363351 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 22:42:59.363845 11986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:59.351321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.66:44125 (local address 127.22.212.65:40179)
0807 22:42:59.356388 (+ 5067us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:59.356402 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:42:59.356513 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:42:59.356740 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:42:59.356741 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:42:59.356743 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:42:59.357012 (+ 269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:59.357016 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:59.357951 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:59.357952 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:59.359399 (+ 1447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:59.359402 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:59.361919 (+ 2517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:59.361920 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:59.363189 (+ 1269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:59.363195 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 22:42:59.363594 (+ 399us) client_negotiation.cc:240] Negotiation successful
0807 22:42:59.363641 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5022,"thread_start_us":166,"threads_started":1}
I20260807 22:42:59.364349 11625 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02b1798907ef496e9fea5e1352ee750f" candidate_uuid: "0124c3ec4b0a412c8093a851431447ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cd898a32ddc4844a11914b2185d0f01" is_pre_election: true
I20260807 22:42:59.364537 11625 raft_consensus.cc:2454] T 02b1798907ef496e9fea5e1352ee750f P 5cd898a32ddc4844a11914b2185d0f01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0124c3ec4b0a412c8093a851431447ce in term 0.
I20260807 22:42:59.364872 11292 leader_election.cc:302] T 02b1798907ef496e9fea5e1352ee750f P 0124c3ec4b0a412c8093a851431447ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0124c3ec4b0a412c8093a851431447ce, 5cd898a32ddc4844a11914b2185d0f01; no voters:
I20260807 22:42:59.365072 11983 raft_consensus.cc:2781] T 02b1798907ef496e9fea5e1352ee750f P 0124c3ec4b0a412c8093a851431447ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:42:59.365147 11983 raft_consensus.cc:482] T 02b1798907ef496e9fea5e1352ee750f P 0124c3ec4b0a412c8093a851431447ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:42:59.365180 11983 raft_consensus.cc:3037] T 02b1798907ef496e9fea5e1352ee750f P 0124c3ec4b0a412c8093a851431447ce [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:42:59.365428 11963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:59.351659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:48017 (local address 127.22.212.67:40599)
0807 22:42:59.351728 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:59.351731 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:59.356226 (+ 4495us) server_negotiation.cc:407] Connection header received
0807 22:42:59.356368 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:59.356369 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:59.356380 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:59.356410 (+ 30us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:42:59.356818 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:59.357560 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:59.363796 (+ 6236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:59.364451 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:59.364504 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:59.364512 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:59.365266 (+ 754us) server_negotiation.cc:299] Negotiation successful
0807 22:42:59.365317 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260807 22:42:59.365934 11988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:59.351006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.67:40599 (local address 127.22.212.65:48017)
0807 22:42:59.356125 (+ 5119us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:59.356141 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 22:42:59.356282 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:42:59.356481 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:42:59.356482 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:42:59.356484 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:42:59.356724 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:59.356726 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:59.357664 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:59.357665 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:59.359133 (+ 1468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:42:59.359136 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:42:59.364846 (+ 5710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:42:59.364847 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:42:59.365066 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:59.365072 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 22:42:59.365719 (+ 647us) client_negotiation.cc:240] Negotiation successful
0807 22:42:59.365785 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5069,"thread_start_us":155,"threads_started":1}
I20260807 22:42:59.366827 11983 raft_consensus.cc:504] T 02b1798907ef496e9fea5e1352ee750f P 0124c3ec4b0a412c8093a851431447ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2135574ce9ff40da8011f0e627e2a76a" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 40599 } } peers { permanent_uuid: "5cd898a32ddc4844a11914b2185d0f01" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 44125 } } peers { permanent_uuid: "0124c3ec4b0a412c8093a851431447ce" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38687 } }
I20260807 22:42:59.366989 11983 leader_election.cc:288] T 02b1798907ef496e9fea5e1352ee750f P 0124c3ec4b0a412c8093a851431447ce [CANDIDATE]: Term 1 election: Requested vote from peers 2135574ce9ff40da8011f0e627e2a76a (127.22.212.67:40599), 5cd898a32ddc4844a11914b2185d0f01 (127.22.212.66:44125)
I20260807 22:42:59.367182 11826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02b1798907ef496e9fea5e1352ee750f" candidate_uuid: "0124c3ec4b0a412c8093a851431447ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2135574ce9ff40da8011f0e627e2a76a" is_pre_election: true
I20260807 22:42:59.367395 11826 raft_consensus.cc:2454] T 02b1798907ef496e9fea5e1352ee750f P 2135574ce9ff40da8011f0e627e2a76a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0124c3ec4b0a412c8093a851431447ce in term 0.
I20260807 22:42:59.367729 11825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02b1798907ef496e9fea5e1352ee750f" candidate_uuid: "0124c3ec4b0a412c8093a851431447ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2135574ce9ff40da8011f0e627e2a76a"
I20260807 22:42:59.367849 11825 raft_consensus.cc:3037] T 02b1798907ef496e9fea5e1352ee750f P 2135574ce9ff40da8011f0e627e2a76a [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:42:59.369280 11825 raft_consensus.cc:2454] T 02b1798907ef496e9fea5e1352ee750f P 2135574ce9ff40da8011f0e627e2a76a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0124c3ec4b0a412c8093a851431447ce in term 1.
I20260807 22:42:59.369539 11625 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02b1798907ef496e9fea5e1352ee750f" candidate_uuid: "0124c3ec4b0a412c8093a851431447ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cd898a32ddc4844a11914b2185d0f01"
I20260807 22:42:59.369611 11294 leader_election.cc:302] T 02b1798907ef496e9fea5e1352ee750f P 0124c3ec4b0a412c8093a851431447ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0124c3ec4b0a412c8093a851431447ce, 2135574ce9ff40da8011f0e627e2a76a; no voters:
I20260807 22:42:59.369623 11625 raft_consensus.cc:3037] T 02b1798907ef496e9fea5e1352ee750f P 5cd898a32ddc4844a11914b2185d0f01 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:42:59.369763 11983 raft_consensus.cc:2781] T 02b1798907ef496e9fea5e1352ee750f P 0124c3ec4b0a412c8093a851431447ce [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:42:59.369985 11983 raft_consensus.cc:686] T 02b1798907ef496e9fea5e1352ee750f P 0124c3ec4b0a412c8093a851431447ce [term 1 LEADER]: Becoming Leader. State: Replica: 0124c3ec4b0a412c8093a851431447ce, State: Running, Role: LEADER
I20260807 22:42:59.370079 11983 consensus_queue.cc:237] T 02b1798907ef496e9fea5e1352ee750f P 0124c3ec4b0a412c8093a851431447ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2135574ce9ff40da8011f0e627e2a76a" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 40599 } } peers { permanent_uuid: "5cd898a32ddc4844a11914b2185d0f01" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 44125 } } peers { permanent_uuid: "0124c3ec4b0a412c8093a851431447ce" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38687 } }
I20260807 22:42:59.370909 11625 raft_consensus.cc:2454] T 02b1798907ef496e9fea5e1352ee750f P 5cd898a32ddc4844a11914b2185d0f01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0124c3ec4b0a412c8093a851431447ce in term 1.
I20260807 22:42:59.371172 11151 catalog_manager.cc:5495] T 02b1798907ef496e9fea5e1352ee750f P 0124c3ec4b0a412c8093a851431447ce reported cstate change: term changed from 0 to 1, leader changed from <none> to 0124c3ec4b0a412c8093a851431447ce (127.22.212.65). New cstate: current_term: 1 leader_uuid: "0124c3ec4b0a412c8093a851431447ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2135574ce9ff40da8011f0e627e2a76a" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 40599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cd898a32ddc4844a11914b2185d0f01" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 44125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0124c3ec4b0a412c8093a851431447ce" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 38687 } health_report { overall_health: HEALTHY } } }
I20260807 22:42:59.433584 11961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:59.430112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54304 (local address 127.22.212.65:38687)
0807 22:42:59.430195 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0807 22:42:59.430197 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:42:59.430206 (+ 9us) server_negotiation.cc:407] Connection header received
0807 22:42:59.430250 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:42:59.430251 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:42:59.430275 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:42:59.430354 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:42:59.430543 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:59.431303 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:59.432485 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:42:59.432781 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:42:59.432844 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:42:59.433036 (+ 192us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:42:59.433186 (+ 150us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:42:59.433263 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 22:42:59.433484 (+ 221us) server_negotiation.cc:299] Negotiation successful
0807 22:42:59.433506 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 22:42:59.436334 11625 raft_consensus.cc:1261] T 02b1798907ef496e9fea5e1352ee750f P 5cd898a32ddc4844a11914b2185d0f01 [term 1 FOLLOWER]: Refusing update from remote peer 0124c3ec4b0a412c8093a851431447ce: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:42:59.436749 11991 consensus_queue.cc:1035] T 02b1798907ef496e9fea5e1352ee750f P 0124c3ec4b0a412c8093a851431447ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cd898a32ddc4844a11914b2185d0f01" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 44125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:42:59.439395 11825 raft_consensus.cc:1261] T 02b1798907ef496e9fea5e1352ee750f P 2135574ce9ff40da8011f0e627e2a76a [term 1 FOLLOWER]: Refusing update from remote peer 0124c3ec4b0a412c8093a851431447ce: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:42:59.439687 11991 consensus_queue.cc:1035] T 02b1798907ef496e9fea5e1352ee750f P 0124c3ec4b0a412c8093a851431447ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "2135574ce9ff40da8011f0e627e2a76a" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 40599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:42:59.446303 11999 mvcc.cc:205] Tried to move back new op lower bound from 7316040005367496704 to 7316040005100290048. Current Snapshot: MvccSnapshot[applied={T|T < 7316040005367496704}]
I20260807 22:42:59.446493 12002 mvcc.cc:205] Tried to move back new op lower bound from 7316040005367496704 to 7316040005100290048. Current Snapshot: MvccSnapshot[applied={T|T < 7316040005367496704}]
I20260807 22:42:59.448804 12000 mvcc.cc:205] Tried to move back new op lower bound from 7316040005367496704 to 7316040005100290048. Current Snapshot: MvccSnapshot[applied={T|T < 7316040005367496704}]
I20260807 22:42:59.452436 11151 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49982:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:42:59.452557 11151 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49982:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:42:59.453418 11151 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 03dcd21e411f479fa746a35c3cb4e5c8: Sending DeleteTablet for 3 replicas of tablet 02b1798907ef496e9fea5e1352ee750f
I20260807 22:42:59.454119 11800 tablet_service.cc:1514] Processing DeleteTablet for tablet 02b1798907ef496e9fea5e1352ee750f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:42:59 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:45756
I20260807 22:42:59.454609 11370 tablet_service.cc:1514] Processing DeleteTablet for tablet 02b1798907ef496e9fea5e1352ee750f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:42:59 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:54290
I20260807 22:42:59.454921 11590 tablet_service.cc:1514] Processing DeleteTablet for tablet 02b1798907ef496e9fea5e1352ee750f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:42:59 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:46564
I20260807 22:42:59.455773 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 11207
I20260807 22:42:59.468075 12010 tablet_replica.cc:330] T 02b1798907ef496e9fea5e1352ee750f P 2135574ce9ff40da8011f0e627e2a76a: stopping tablet replica
I20260807 22:42:59.468286 12010 raft_consensus.cc:2229] T 02b1798907ef496e9fea5e1352ee750f P 2135574ce9ff40da8011f0e627e2a76a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:42:59.468437 12010 raft_consensus.cc:2258] T 02b1798907ef496e9fea5e1352ee750f P 2135574ce9ff40da8011f0e627e2a76a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:42:59.468644 12012 tablet_replica.cc:330] T 02b1798907ef496e9fea5e1352ee750f P 5cd898a32ddc4844a11914b2185d0f01: stopping tablet replica
I20260807 22:42:59.469862 12012 raft_consensus.cc:2229] T 02b1798907ef496e9fea5e1352ee750f P 5cd898a32ddc4844a11914b2185d0f01 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:42:59.469992 12012 raft_consensus.cc:2258] T 02b1798907ef496e9fea5e1352ee750f P 5cd898a32ddc4844a11914b2185d0f01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:42:59.470533 12012 ts_tablet_manager.cc:1905] T 02b1798907ef496e9fea5e1352ee750f P 5cd898a32ddc4844a11914b2185d0f01: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:42:59.472303 12010 ts_tablet_manager.cc:1905] T 02b1798907ef496e9fea5e1352ee750f P 2135574ce9ff40da8011f0e627e2a76a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:42:59.475575 12012 ts_tablet_manager.cc:1918] T 02b1798907ef496e9fea5e1352ee750f P 5cd898a32ddc4844a11914b2185d0f01: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:42:59.475669 12012 log.cc:1196] T 02b1798907ef496e9fea5e1352ee750f P 5cd898a32ddc4844a11914b2185d0f01: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-1/wal/wals/02b1798907ef496e9fea5e1352ee750f
I20260807 22:42:59.475947 12012 ts_tablet_manager.cc:1939] T 02b1798907ef496e9fea5e1352ee750f P 5cd898a32ddc4844a11914b2185d0f01: Deleting consensus metadata
I20260807 22:42:59.477067 12010 ts_tablet_manager.cc:1918] T 02b1798907ef496e9fea5e1352ee750f P 2135574ce9ff40da8011f0e627e2a76a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:42:59.477164 12010 log.cc:1196] T 02b1798907ef496e9fea5e1352ee750f P 2135574ce9ff40da8011f0e627e2a76a: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786142418640232-23377-0/minicluster-data/ts-2/wal/wals/02b1798907ef496e9fea5e1352ee750f
I20260807 22:42:59.477432 12010 ts_tablet_manager.cc:1939] T 02b1798907ef496e9fea5e1352ee750f P 2135574ce9ff40da8011f0e627e2a76a: Deleting consensus metadata
I20260807 22:42:59.477939 11130 catalog_manager.cc:4841] TS 2135574ce9ff40da8011f0e627e2a76a (127.22.212.67:40599): tablet 02b1798907ef496e9fea5e1352ee750f (table test-table [id=126b70bf611846d1a61b0278175e1f7d]) successfully deleted
I20260807 22:42:59.480595 11127 catalog_manager.cc:4841] TS 5cd898a32ddc4844a11914b2185d0f01 (127.22.212.66:44125): tablet 02b1798907ef496e9fea5e1352ee750f (table test-table [id=126b70bf611846d1a61b0278175e1f7d]) successfully deleted
W20260807 22:42:59.483597 11130 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.212.65:38687 (error 108)
I20260807 22:42:59.484773 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 11491
I20260807 22:42:59.484786 11957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:42:59.484617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:38687 (local address 127.0.0.1:54320)
0807 22:42:59.484679 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0807 22:42:59.484743 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.65:38687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260807 22:42:59.488554 11130 catalog_manager.cc:4584] TS 0124c3ec4b0a412c8093a851431447ce (127.22.212.65:38687): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 02b1798907ef496e9fea5e1352ee750f: Network error: Client connection negotiation failed: client connection to 127.22.212.65:38687: connect: Connection refused (error 111)
I20260807 22:42:59.495604 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 11700
I20260807 22:42:59.538503 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 11089
I20260807 22:42:59.551582 23377 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260807 22:42:59.897954 23377 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260807 22:42:59.898064 23377 mini_ranger.cc:66] Stopping Ranger...
I20260807 22:43:00.242889 23377 mini_ranger.cc:68] Stopped Ranger
2026-08-07 22:43:00.243 UTC [9609] LOG: received smart shutdown request
2026-08-07 22:43:00.248 UTC [9609] LOG: background worker "logical replication launcher" (PID 9624) exited with exit code 1
2026-08-07 22:43:00.248 UTC [9618] LOG: shutting down
2026-08-07 22:43:00.451 UTC [9609] LOG: database system is shut down
2026-08-07T22:43:00Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (51844 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:43:00 dist-test-slave-2d19 krb5kdc[12031](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:43:00 dist-test-slave-2d19 krb5kdc[12031](info): set up 2 sockets
Aug 07 22:43:00 dist-test-slave-2d19 krb5kdc[12031](info): commencing operation
krb5kdc: starting...
W20260807 22:43:01.866431 23377 mini_kdc.cc:121] Time spent starting KDC: real 1.282s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Aug 07 22:43:01 dist-test-slave-2d19 krb5kdc[12031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142581, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:43:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:43:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.212.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
I20260807 22:43:01.997462 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:35197
--webserver_interface=127.22.212.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:45869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:35197,127.22.212.125:35517,127.22.212.124:42079
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:43:02.085333 12049 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:43:02.085595 12049 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:43:02.085637 12049 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:43:02.086810 12049 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:43:02.086887 12049 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:43:02.086912 12049 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:43:02.086941 12049 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:43:02.086963 12049 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:43:02.088620 12049 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:45869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:35197,127.22.212.125:35517,127.22.212.124:42079
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:35197
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12049
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:43:02.088912 12049 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:43:02.089159 12049 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:43:02.094424 12057 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:43:02.094430 12056 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:43:02.094542 12061 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:43:02.094549 12049 server_base.cc:1034] running on GCE node
I20260807 22:43:02.094961 12049 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:43:02.095208 12049 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:43:02.096388 12049 hybrid_clock.cc:648] HybridClock initialized: now 1786142582096363 us; error 60 us; skew 500 ppm
Aug 07 22:43:02 dist-test-slave-2d19 krb5kdc[12031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142582, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:43:02.098984 12049 init.cc:377] Logged in from keytab as kudu/127.22.212.126@KRBTEST.COM (short username kudu)
I20260807 22:43:02.099455 12049 webserver.cc:460] Webserver started at http://127.22.212.126:40473/ using document root <none> and password file <none>
I20260807 22:43:02.099671 12049 fs_manager.cc:359] Metadata directory not provided
I20260807 22:43:02.099713 12049 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:43:02.099807 12049 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:43:02.100916 12049 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "9c4bcd68c2274429acb89f9efdd69649"
format_stamp: "Formatted at 2026-08-07 22:43:02 on dist-test-slave-2d19"
server_key: "d01ac257a5d5da5b9a9378c47c3ac4df"
server_key_iv: "0269f7696e575dec053e6c3c487951b4"
server_key_version: "encryptionkey@0"
I20260807 22:43:02.101238 12049 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "9c4bcd68c2274429acb89f9efdd69649"
format_stamp: "Formatted at 2026-08-07 22:43:02 on dist-test-slave-2d19"
server_key: "d01ac257a5d5da5b9a9378c47c3ac4df"
server_key_iv: "0269f7696e575dec053e6c3c487951b4"
server_key_version: "encryptionkey@0"
I20260807 22:43:02.102519 12049 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 22:43:02.103313 12073 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:43:02.103492 12049 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:43:02.103588 12049 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "9c4bcd68c2274429acb89f9efdd69649"
format_stamp: "Formatted at 2026-08-07 22:43:02 on dist-test-slave-2d19"
server_key: "d01ac257a5d5da5b9a9378c47c3ac4df"
server_key_iv: "0269f7696e575dec053e6c3c487951b4"
server_key_version: "encryptionkey@0"
I20260807 22:43:02.103675 12049 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:43:02.124926 12049 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:43:02.127089 12049 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:43:02.127249 12049 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:43:02.132227 12049 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:35197
I20260807 22:43:02.132313 12161 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:35197 every 8 connection(s)
I20260807 22:43:02.132702 12049 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:43:02.133620 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 12049
I20260807 22:43:02.133714 12162 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:43:02.133746 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:43:02.133960 23377 external_mini_cluster.cc:1428] Setting key fa30e87d8ffff071b0b952ee5610eef5
I20260807 22:43:02.136174 12162 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35197 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.22.212.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.125@KRBTEST.COM" created.
Aug 07 22:43:02 dist-test-slave-2d19 krb5kdc[12031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142582, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:43:02.150617 12169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:02.137163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60262 (local address 127.22.212.126:35197)
0807 22:43:02.137325 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:02.137330 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:02.137372 (+ 42us) server_negotiation.cc:407] Connection header received
0807 22:43:02.137803 (+ 431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:02.137806 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:02.137829 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:02.137936 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:43:02.138581 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.139955 (+ 1374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.141129 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.141663 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.141788 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:02.147160 (+ 5372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:43:02.147168 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:43:02.147168 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:43:02.147175 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:43:02.148912 (+ 1737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:02.149349 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:02.149353 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:02.149353 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:02.149446 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:02.149685 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:02.149686 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:02.149687 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:02.149910 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:43:02.150008 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:02.150213 (+ 205us) server_negotiation.cc:299] Negotiation successful
0807 22:43:02.150357 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":74,"threads_started":1}
I20260807 22:43:02.150619 12167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:02.136948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35197 (local address 127.0.0.1:60262)
0807 22:43:02.137123 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:02.137167 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 22:43:02.137642 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:43:02.137961 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:43:02.137964 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:43:02.138245 (+ 281us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:43:02.138459 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:02.138465 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.140072 (+ 1607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.140073 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:02.141008 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:02.141011 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.141761 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.141762 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:02.141819 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:02.142391 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:43:02.142400 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:43:02.147032 (+ 4632us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:43:02.149024 (+ 1992us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:02.149031 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:02.149033 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:02.149237 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:02.149521 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:02.149522 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:02.149522 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:02.149612 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:02.149986 (+ 374us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:43:02.149991 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:43:02.150062 (+ 71us) client_negotiation.cc:769] Sending connection context
0807 22:43:02.150178 (+ 116us) client_negotiation.cc:240] Negotiation successful
0807 22:43:02.150425 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"mutex_wait_us":98,"thread_start_us":99,"threads_started":1}
I20260807 22:43:02.151489 12162 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.212.125" port: 35517 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:43:02.151949 12167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:02.151764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.125:35517 (local address 127.0.0.1:40402)
0807 22:43:02.151817 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:02.151866 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.125:35517: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260807 22:43:02.152100 12075 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.212.125:35517: connect: Connection refused (error 111)
I20260807 22:43:02.152545 12167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:02.152444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.125:35517 (local address 127.0.0.1:40414)
0807 22:43:02.152494 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:02.152519 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.125:35517: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260807 22:43:02.152655 12162 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.212.125:35517: Network error: Client connection negotiation failed: client connection to 127.22.212.125:35517: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.125.keytab.
Entry for principal kudu/127.22.212.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.125.keytab.
I20260807 22:43:02.163993 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.125:35517
--webserver_interface=127.22.212.125
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.125.keytab
--principal=kudu/127.22.212.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:45869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:35197,127.22.212.125:35517,127.22.212.124:42079
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:43:02.201895 12162 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.212.125" port: 35517 } attempt: 1
I20260807 22:43:02.202527 12167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:02.202372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.125:35517 (local address 127.0.0.1:40420)
0807 22:43:02.202451 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:02.202497 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.125:35517: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260807 22:43:02.202984 12167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:02.202881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.125:35517 (local address 127.0.0.1:40432)
0807 22:43:02.202935 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:02.202965 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.125:35517: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260807 22:43:02.203123 12162 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.212.125:35517: Network error: Client connection negotiation failed: client connection to 127.22.212.125:35517: connect: Connection refused (error 111)
W20260807 22:43:02.249526 12173 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:43:02.249737 12173 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:43:02.249761 12173 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:43:02.250833 12173 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:43:02.250870 12173 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:43:02.250885 12173 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:43:02.250896 12173 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:43:02.250908 12173 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:43:02.252483 12173 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:45869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:35197,127.22.212.125:35517,127.22.212.124:42079
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.125.keytab
--principal=kudu/127.22.212.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.125:35517
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.22.212.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12173
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:43:02.252707 12173 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:43:02.252883 12173 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:43:02.258270 12185 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:43:02.258251 12181 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:43:02.258373 12173 server_base.cc:1034] running on GCE node
W20260807 22:43:02.258251 12182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:43:02.258888 12173 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:43:02.259238 12173 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:43:02.260407 12173 hybrid_clock.cc:648] HybridClock initialized: now 1786142582260385 us; error 40 us; skew 500 ppm
Aug 07 22:43:02 dist-test-slave-2d19 krb5kdc[12031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142582, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:43:02.263058 12173 init.cc:377] Logged in from keytab as kudu/127.22.212.125@KRBTEST.COM (short username kudu)
I20260807 22:43:02.263567 12173 webserver.cc:460] Webserver started at http://127.22.212.125:37691/ using document root <none> and password file <none>
I20260807 22:43:02.263816 12173 fs_manager.cc:359] Metadata directory not provided
I20260807 22:43:02.263890 12173 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:43:02.264045 12173 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:43:02.265192 12173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-1/data/instance:
uuid: "4d70996fe5334cdeb5d01264bd57cc1b"
format_stamp: "Formatted at 2026-08-07 22:43:02 on dist-test-slave-2d19"
server_key: "fc9076d95f7148f8b7b14cdd6c4a7bd1"
server_key_iv: "fdb8c0eb07d348a2565e4262a0c1b5e5"
server_key_version: "encryptionkey@0"
I20260807 22:43:02.265583 12173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-1/wal/instance:
uuid: "4d70996fe5334cdeb5d01264bd57cc1b"
format_stamp: "Formatted at 2026-08-07 22:43:02 on dist-test-slave-2d19"
server_key: "fc9076d95f7148f8b7b14cdd6c4a7bd1"
server_key_iv: "fdb8c0eb07d348a2565e4262a0c1b5e5"
server_key_version: "encryptionkey@0"
I20260807 22:43:02.266980 12173 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 22:43:02.267732 12198 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:43:02.267915 12173 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 22:43:02.268024 12173 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-1/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-1/wal
uuid: "4d70996fe5334cdeb5d01264bd57cc1b"
format_stamp: "Formatted at 2026-08-07 22:43:02 on dist-test-slave-2d19"
server_key: "fc9076d95f7148f8b7b14cdd6c4a7bd1"
server_key_iv: "fdb8c0eb07d348a2565e4262a0c1b5e5"
server_key_version: "encryptionkey@0"
I20260807 22:43:02.268110 12173 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:43:02.271281 12162 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.212.125" port: 35517 } attempt: 2
I20260807 22:43:02.271704 12167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:02.271584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.125:35517 (local address 127.0.0.1:40440)
0807 22:43:02.271641 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:02.271677 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.125:35517: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260807 22:43:02.272079 12167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:02.271990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.125:35517 (local address 127.0.0.1:40446)
0807 22:43:02.272030 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:02.272062 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.125:35517: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260807 22:43:02.272184 12162 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.212.125:35517: Network error: Client connection negotiation failed: client connection to 127.22.212.125:35517: connect: Connection refused (error 111)
I20260807 22:43:02.295725 12173 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:43:02.297755 12173 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:43:02.297916 12173 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:43:02.302264 12173 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.125:35517
I20260807 22:43:02.302305 12279 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.125:35517 every 8 connection(s)
I20260807 22:43:02.302783 12173 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-1/data/info.pb
I20260807 22:43:02.303711 12283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:43:02.305377 12283 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35197 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:43:02.310024 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 12173
I20260807 22:43:02.310149 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-1/wal/instance
I20260807 22:43:02.310362 23377 external_mini_cluster.cc:1428] Setting key d6ba5cf3755b62d29d9b66f7466051fb
Aug 07 22:43:02 dist-test-slave-2d19 krb5kdc[12031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142582, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.125@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:43:02.314878 12169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:02.306153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60270 (local address 127.22.212.126:35197)
0807 22:43:02.306220 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:02.306222 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:02.306450 (+ 228us) server_negotiation.cc:407] Connection header received
0807 22:43:02.307002 (+ 552us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:02.307003 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:02.307019 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:02.307086 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:43:02.307734 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.308239 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.309250 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.309464 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.309557 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:02.311840 (+ 2283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:43:02.311842 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:43:02.311842 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:43:02.311850 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:43:02.313390 (+ 1540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:02.313864 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:02.313865 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:02.313866 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:02.313926 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:02.314203 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:02.314204 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:02.314204 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:02.314321 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:43:02.314399 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:02.314701 (+ 302us) server_negotiation.cc:299] Negotiation successful
0807 22:43:02.314786 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260807 22:43:02.315066 12286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:02.306123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35197 (local address 127.0.0.1:60270)
0807 22:43:02.306323 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:02.306362 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 22:43:02.306894 (+ 532us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:43:02.307160 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:43:02.307163 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:43:02.307418 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:43:02.307629 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:02.307633 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.308369 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.308370 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:02.309139 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:02.309141 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.309571 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.309572 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:02.309700 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:02.310284 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:43:02.310292 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:43:02.311737 (+ 1445us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:43:02.313499 (+ 1762us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:02.313507 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:02.313510 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:02.313766 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:02.314002 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:02.314003 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:02.314003 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:02.314120 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:02.314392 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:43:02.314400 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:43:02.314554 (+ 154us) client_negotiation.cc:769] Sending connection context
0807 22:43:02.314668 (+ 114us) client_negotiation.cc:240] Negotiation successful
0807 22:43:02.314822 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":88,"threads_started":1}
I20260807 22:43:02.315836 12283 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.212.125" port: 35517 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.22.212.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.124@KRBTEST.COM" created.
Aug 07 22:43:02 dist-test-slave-2d19 krb5kdc[12031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142582, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.125@KRBTEST.COM for kudu/127.22.212.125@KRBTEST.COM
I20260807 22:43:02.325574 12286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:02.316104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.125:35517 (local address 127.0.0.1:40456)
0807 22:43:02.316162 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:02.316172 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 22:43:02.316212 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:43:02.316530 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:43:02.316531 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:43:02.316687 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:43:02.316735 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:02.316737 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.317618 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.317619 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:02.318107 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:02.318108 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.318612 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.318613 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:02.318679 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:02.319115 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:43:02.319125 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:43:02.322462 (+ 3337us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:43:02.324416 (+ 1954us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:02.324416 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:02.324417 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:02.324640 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:02.324867 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:02.324868 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:02.324868 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:02.324923 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:02.325233 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:43:02.325233 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:43:02.325272 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 22:43:02.325333 (+ 61us) client_negotiation.cc:240] Negotiation successful
0807 22:43:02.325435 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260807 22:43:02.325645 12288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:02.316194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40456 (local address 127.22.212.125:35517)
0807 22:43:02.316379 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:02.316383 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:02.316400 (+ 17us) server_negotiation.cc:407] Connection header received
0807 22:43:02.316417 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:02.316418 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:02.316429 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:02.316516 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:43:02.316825 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.317496 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.318205 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.318506 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.318612 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:02.322623 (+ 4011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:43:02.322630 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:43:02.322631 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:43:02.322637 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:43:02.324305 (+ 1668us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:02.324734 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:02.324738 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:02.324739 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:02.324797 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:02.325004 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:02.325005 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:02.325006 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:02.325157 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:43:02.325255 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:02.325374 (+ 119us) server_negotiation.cc:299] Negotiation successful
0807 22:43:02.325510 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":47,"server-negotiator.queue_time_us":149,"thread_start_us":113,"threads_started":1}
I20260807 22:43:02.326785 12283 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.212.124" port: 42079 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:43:02.327191 12286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:02.327027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:42079 (local address 127.0.0.1:50418)
0807 22:43:02.327092 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:02.327153 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.124:42079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260807 22:43:02.327459 12199 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.212.124:42079: connect: Connection refused (error 111)
I20260807 22:43:02.328667 12286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:02.328536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:42079 (local address 127.0.0.1:50422)
0807 22:43:02.328597 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:02.328635 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.124:42079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260807 22:43:02.328840 12283 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.212.124:42079: Network error: Client connection negotiation failed: client connection to 127.22.212.124:42079: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.124.keytab.
Entry for principal kudu/127.22.212.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.124.keytab.
I20260807 22:43:02.338835 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.124:42079
--webserver_interface=127.22.212.124
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.124.keytab
--principal=kudu/127.22.212.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:45869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:35197,127.22.212.125:35517,127.22.212.124:42079
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:43:02.363354 12162 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.212.125" port: 35517 } attempt: 3
Aug 07 22:43:02 dist-test-slave-2d19 krb5kdc[12031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142582, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for kudu/127.22.212.125@KRBTEST.COM
I20260807 22:43:02.370851 12167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:02.363795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.125:35517 (local address 127.0.0.1:40470)
0807 22:43:02.363854 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:02.363871 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:43:02.363952 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:43:02.364124 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:43:02.364125 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:43:02.364374 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:43:02.364443 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:02.364445 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.365178 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.365180 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:02.365703 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:02.365705 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.366109 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.366111 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:02.366199 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:02.366730 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:43:02.366735 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:43:02.368184 (+ 1449us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:43:02.369757 (+ 1573us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:02.369758 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:02.369758 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:02.369937 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:02.370174 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:02.370175 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:02.370175 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:02.370240 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:02.370502 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:43:02.370503 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:43:02.370550 (+ 47us) client_negotiation.cc:769] Sending connection context
0807 22:43:02.370644 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 22:43:02.370746 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260807 22:43:02.370870 12288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:02.363886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40470 (local address 127.22.212.125:35517)
0807 22:43:02.363964 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:02.363966 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:02.363979 (+ 13us) server_negotiation.cc:407] Connection header received
0807 22:43:02.364013 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:02.364013 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:02.364025 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:02.364102 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:43:02.364567 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.365085 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.365806 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.366024 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.366110 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:02.368300 (+ 2190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:43:02.368302 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:43:02.368302 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:43:02.368312 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:43:02.369661 (+ 1349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:02.370030 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:02.370032 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:02.370032 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:02.370092 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:02.370318 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:02.370319 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:02.370319 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:02.370431 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:43:02.370511 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:02.370684 (+ 173us) server_negotiation.cc:299] Negotiation successful
0807 22:43:02.370763 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 22:43:02.371493 12162 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.212.124" port: 42079 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:43:02.371894 12167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:02.371771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:42079 (local address 127.0.0.1:50430)
0807 22:43:02.371824 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:02.371856 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.124:42079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260807 22:43:02.372283 12167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:02.372161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:42079 (local address 127.0.0.1:50438)
0807 22:43:02.372210 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:02.372235 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.124:42079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260807 22:43:02.372366 12162 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.212.124:42079: Network error: Client connection negotiation failed: client connection to 127.22.212.124:42079: connect: Connection refused (error 111)
I20260807 22:43:02.378082 12283 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.212.124" port: 42079 } attempt: 1
I20260807 22:43:02.378477 12286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:02.378358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:42079 (local address 127.0.0.1:50440)
0807 22:43:02.378420 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:02.378449 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.124:42079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260807 22:43:02.378804 12286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:02.378703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:42079 (local address 127.0.0.1:50446)
0807 22:43:02.378756 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:02.378780 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.124:42079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260807 22:43:02.378901 12283 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.212.124:42079: Network error: Client connection negotiation failed: client connection to 127.22.212.124:42079: connect: Connection refused (error 111)
I20260807 22:43:02.403575 12162 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.212.124" port: 42079 } attempt: 1
I20260807 22:43:02.404146 12167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:02.403985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:42079 (local address 127.0.0.1:50452)
0807 22:43:02.404059 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:02.404109 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.124:42079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260807 22:43:02.404596 12167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:02.404486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:42079 (local address 127.0.0.1:50460)
0807 22:43:02.404539 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:02.404571 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.124:42079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260807 22:43:02.404750 12162 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.212.124:42079: Network error: Client connection negotiation failed: client connection to 127.22.212.124:42079: connect: Connection refused (error 111)
W20260807 22:43:02.428093 12292 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:43:02.428447 12292 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:43:02.428493 12292 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:43:02.429675 12292 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:43:02.429761 12292 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:43:02.429786 12292 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:43:02.429808 12292 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:43:02.429836 12292 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:43:02.431361 12292 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:45869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:35197,127.22.212.125:35517,127.22.212.124:42079
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.124.keytab
--principal=kudu/127.22.212.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.124:42079
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.22.212.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12292
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:43:02.431649 12292 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:43:02.431931 12292 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:43:02.437110 12301 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:43:02.437198 12292 server_base.cc:1034] running on GCE node
W20260807 22:43:02.437074 12302 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:43:02.437093 12307 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:43:02.437727 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:43:02.437997 12292 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:43:02.439177 12292 hybrid_clock.cc:648] HybridClock initialized: now 1786142582439166 us; error 45 us; skew 500 ppm
Aug 07 22:43:02 dist-test-slave-2d19 krb5kdc[12031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142582, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:43:02.441829 12292 init.cc:377] Logged in from keytab as kudu/127.22.212.124@KRBTEST.COM (short username kudu)
I20260807 22:43:02.442303 12292 webserver.cc:460] Webserver started at http://127.22.212.124:41749/ using document root <none> and password file <none>
I20260807 22:43:02.442514 12292 fs_manager.cc:359] Metadata directory not provided
I20260807 22:43:02.442559 12292 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:43:02.442651 12292 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:43:02.443684 12292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-2/data/instance:
uuid: "7b57854657644f0da56eb6b81ccf69dd"
format_stamp: "Formatted at 2026-08-07 22:43:02 on dist-test-slave-2d19"
server_key: "e45e670c55722ae54c197778f56fcad2"
server_key_iv: "9c70e4384039629a837c0943067a15de"
server_key_version: "encryptionkey@0"
I20260807 22:43:02.444018 12292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-2/wal/instance:
uuid: "7b57854657644f0da56eb6b81ccf69dd"
format_stamp: "Formatted at 2026-08-07 22:43:02 on dist-test-slave-2d19"
server_key: "e45e670c55722ae54c197778f56fcad2"
server_key_iv: "9c70e4384039629a837c0943067a15de"
server_key_version: "encryptionkey@0"
I20260807 22:43:02.445405 12292 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 22:43:02.446139 12318 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:43:02.446336 12292 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:43:02.446434 12292 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-2/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-2/wal
uuid: "7b57854657644f0da56eb6b81ccf69dd"
format_stamp: "Formatted at 2026-08-07 22:43:02 on dist-test-slave-2d19"
server_key: "e45e670c55722ae54c197778f56fcad2"
server_key_iv: "9c70e4384039629a837c0943067a15de"
server_key_version: "encryptionkey@0"
I20260807 22:43:02.446494 12292 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:43:02.447054 12283 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.212.124" port: 42079 } attempt: 2
I20260807 22:43:02.447464 12286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:02.447338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:42079 (local address 127.0.0.1:50470)
0807 22:43:02.447398 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:02.447436 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.124:42079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260807 22:43:02.447808 12286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:02.447746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:42079 (local address 127.0.0.1:50484)
0807 22:43:02.447770 (+ 24us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:02.447792 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.124:42079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":13}
W20260807 22:43:02.447911 12283 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.212.124:42079: Network error: Client connection negotiation failed: client connection to 127.22.212.124:42079: connect: Connection refused (error 111)
I20260807 22:43:02.469594 12292 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:43:02.471758 12292 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:43:02.471928 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:43:02.475943 12292 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.124:42079
I20260807 22:43:02.475993 12407 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.124:42079 every 8 connection(s)
I20260807 22:43:02.476419 12292 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-2/data/info.pb
I20260807 22:43:02.477355 12409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:43:02.478924 12409 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35197 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:43:02.479941 12162 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.212.124" port: 42079 } attempt: 2
Aug 07 22:43:02 dist-test-slave-2d19 krb5kdc[12031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142582, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for kudu/127.22.212.124@KRBTEST.COM
Aug 07 22:43:02 dist-test-slave-2d19 krb5kdc[12031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142582, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.124@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:43:02.485181 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 12292
I20260807 22:43:02.485286 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786142418640232-23377-0/minicluster-data/master-2/wal/instance
I20260807 22:43:02.485487 23377 external_mini_cluster.cc:1428] Setting key ce744d267f5800cf66335d52df45e0f8
I20260807 22:43:02.488840 12167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:02.480227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:42079 (local address 127.0.0.1:50498)
0807 22:43:02.480304 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:02.480314 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 22:43:02.480363 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:43:02.480732 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:43:02.480732 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:43:02.480910 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:43:02.480991 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:02.480993 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.482005 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.482006 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:02.482492 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:02.482494 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.482980 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.482981 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:02.483043 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:02.483501 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:43:02.483507 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:43:02.485010 (+ 1503us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:43:02.487293 (+ 2283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:02.487294 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:02.487294 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:02.487597 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:02.487853 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:02.487853 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:02.487854 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:02.487927 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:02.488443 (+ 516us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:43:02.488444 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:43:02.488490 (+ 46us) client_negotiation.cc:769] Sending connection context
0807 22:43:02.488623 (+ 133us) client_negotiation.cc:240] Negotiation successful
0807 22:43:02.488715 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260807 22:43:02.489094 12411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:02.479655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35197 (local address 127.0.0.1:60274)
0807 22:43:02.479838 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:02.479882 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 22:43:02.480493 (+ 611us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:43:02.480699 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:43:02.480703 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:43:02.480969 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:43:02.481123 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:02.481128 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.481990 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.481991 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:02.482679 (+ 688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:02.482681 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.483059 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.483060 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:02.483140 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:02.483728 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:43:02.483739 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:43:02.485669 (+ 1930us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:43:02.487808 (+ 2139us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:02.487814 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:02.487817 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:02.488132 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:02.488369 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:02.488370 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:02.488370 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:02.488441 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:02.488751 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:43:02.488756 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:43:02.488797 (+ 41us) client_negotiation.cc:769] Sending connection context
0807 22:43:02.488891 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 22:43:02.488988 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":104,"threads_started":1}
I20260807 22:43:02.489094 12412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:02.480330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50498 (local address 127.22.212.124:42079)
0807 22:43:02.480493 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:02.480497 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:02.480525 (+ 28us) server_negotiation.cc:407] Connection header received
0807 22:43:02.480598 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:02.480604 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:02.480623 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:02.480722 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:43:02.481082 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.481913 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.482573 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.482896 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.483018 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:02.485093 (+ 2075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:43:02.485102 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:43:02.485102 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:43:02.485113 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:43:02.487201 (+ 2088us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:02.487681 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:02.487685 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:02.487685 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:02.487790 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:02.488004 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:02.488005 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:02.488006 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:02.488378 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:43:02.488462 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:02.488710 (+ 248us) server_negotiation.cc:299] Negotiation successful
0807 22:43:02.488854 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":79,"threads_started":1}
I20260807 22:43:02.489562 12169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:02.479848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60274 (local address 127.22.212.126:35197)
0807 22:43:02.479936 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:02.479938 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:02.479952 (+ 14us) server_negotiation.cc:407] Connection header received
0807 22:43:02.480610 (+ 658us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:02.480612 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:02.480624 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:02.480680 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:43:02.481211 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.481849 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.482773 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.482978 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.483052 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:02.485762 (+ 2710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:43:02.485764 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:43:02.485764 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:43:02.485773 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:43:02.487733 (+ 1960us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:02.488211 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:02.488212 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:02.488212 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:02.488292 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:02.488522 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:02.488523 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:02.488524 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:02.488660 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:43:02.488725 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:02.489390 (+ 665us) server_negotiation.cc:299] Negotiation successful
0807 22:43:02.489480 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 22:43:02.490183 12409 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.212.125" port: 35517 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:43:02.491530 12162 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c4bcd68c2274429acb89f9efdd69649: Bootstrap starting.
Aug 07 22:43:02 dist-test-slave-2d19 krb5kdc[12031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142581, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.212.124@KRBTEST.COM
I20260807 22:43:02.492312 12162 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9c4bcd68c2274429acb89f9efdd69649: Neither blocks nor log segments found. Creating new log.
I20260807 22:43:02.492808 12162 log.cc:824] T 00000000000000000000000000000000 P 9c4bcd68c2274429acb89f9efdd69649: Log is configured to *not* fsync() on all Append() calls
I20260807 22:43:02.493813 12162 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c4bcd68c2274429acb89f9efdd69649: No bootstrap required, opened a new log
Aug 07 22:43:02 dist-test-slave-2d19 krb5kdc[12031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142582, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.124@KRBTEST.COM for kudu/127.22.212.125@KRBTEST.COM
I20260807 22:43:02.496062 12162 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9c4bcd68c2274429acb89f9efdd69649 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4bcd68c2274429acb89f9efdd69649" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35197 } } peers { permanent_uuid: "4d70996fe5334cdeb5d01264bd57cc1b" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 35517 } } peers { permanent_uuid: "7b57854657644f0da56eb6b81ccf69dd" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 42079 } }
I20260807 22:43:02.496225 12162 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9c4bcd68c2274429acb89f9efdd69649 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:43:02.496317 12415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:02.485845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50508 (local address 127.22.212.124:42079)
0807 22:43:02.486050 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:02.486052 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:02.486060 (+ 8us) server_negotiation.cc:407] Connection header received
0807 22:43:02.486147 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:02.486148 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:02.486159 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:02.486238 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:43:02.487008 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.487820 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.488849 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.489139 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.489205 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:02.492148 (+ 2943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:43:02.492149 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:43:02.492150 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:43:02.492157 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:43:02.494669 (+ 2512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:02.495094 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:02.495096 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:02.495096 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:02.495157 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:02.495360 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:02.495361 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:02.495362 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:02.495499 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:43:02.495651 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:02.496047 (+ 396us) server_negotiation.cc:299] Negotiation successful
0807 22:43:02.496135 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":107,"threads_started":1}
I20260807 22:43:02.496330 12162 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9c4bcd68c2274429acb89f9efdd69649 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c4bcd68c2274429acb89f9efdd69649, State: Initialized, Role: FOLLOWER
I20260807 22:43:02.496505 12162 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c4bcd68c2274429acb89f9efdd69649 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4bcd68c2274429acb89f9efdd69649" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35197 } } peers { permanent_uuid: "4d70996fe5334cdeb5d01264bd57cc1b" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 35517 } } peers { permanent_uuid: "7b57854657644f0da56eb6b81ccf69dd" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 42079 } }
I20260807 22:43:02.496850 12419 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c4bcd68c2274429acb89f9efdd69649 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4bcd68c2274429acb89f9efdd69649" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35197 } } peers { permanent_uuid: "4d70996fe5334cdeb5d01264bd57cc1b" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 35517 } } peers { permanent_uuid: "7b57854657644f0da56eb6b81ccf69dd" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 42079 } } }
I20260807 22:43:02.496917 12162 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9c4bcd68c2274429acb89f9efdd69649 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:43:02.497017 12419 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c4bcd68c2274429acb89f9efdd69649 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:43:02.498623 12411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:02.490446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.125:35517 (local address 127.0.0.1:40478)
0807 22:43:02.490486 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:02.490496 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 22:43:02.490529 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:43:02.490724 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:43:02.490726 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:43:02.490928 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:43:02.490992 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:02.490994 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.492142 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.492143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:02.492892 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:02.492895 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.493452 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.493453 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:02.493519 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:02.493924 (+ 405us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:43:02.493930 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:43:02.495301 (+ 1371us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:43:02.497261 (+ 1960us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:02.497262 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:02.497262 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:02.497634 (+ 372us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:02.497887 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:02.497887 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:02.497888 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:02.497948 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:02.498242 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:43:02.498243 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:43:02.498288 (+ 45us) client_negotiation.cc:769] Sending connection context
0807 22:43:02.498358 (+ 70us) client_negotiation.cc:240] Negotiation successful
0807 22:43:02.498460 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260807 22:43:02.499138 12288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:02.490539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40478 (local address 127.22.212.125:35517)
0807 22:43:02.490587 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:02.490589 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:02.490598 (+ 9us) server_negotiation.cc:407] Connection header received
0807 22:43:02.490627 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:02.490628 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:02.490638 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:02.490702 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:43:02.491075 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.492054 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.493014 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.493310 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.493383 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:02.495388 (+ 2005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:43:02.495389 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:43:02.495390 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:43:02.495398 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:43:02.497164 (+ 1766us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:02.497740 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:02.497742 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:02.497742 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:02.497810 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:02.498039 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:02.498040 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:02.498040 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:02.498167 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:43:02.498247 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:02.498955 (+ 708us) server_negotiation.cc:299] Negotiation successful
0807 22:43:02.499052 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260807 22:43:02.499470 12409 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.212.124" port: 42079 } has no permanent_uuid. Determining permanent_uuid...
W20260807 22:43:02.499653 12434 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9c4bcd68c2274429acb89f9efdd69649: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:43:02.499735 12434 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Aug 07 22:43:02 dist-test-slave-2d19 krb5kdc[12031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142581, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:43:02.500305 12049 master_runner.cc:186] Error getting master registration for 127.22.212.125:35517: OK, instance_id { permanent_uuid: "4d70996fe5334cdeb5d01264bd57cc1b" instance_seqno: 1786142582301028 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 22:43:02.502822 12049 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 07 22:43:02 dist-test-slave-2d19 krb5kdc[12031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142582, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.124@KRBTEST.COM for kudu/127.22.212.124@KRBTEST.COM
I20260807 22:43:02.506318 12169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:02.497216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60278 (local address 127.22.212.126:35197)
0807 22:43:02.497300 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:02.497301 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:02.497309 (+ 8us) server_negotiation.cc:407] Connection header received
0807 22:43:02.497331 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:02.497332 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:02.497341 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:02.497404 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:43:02.498048 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.498786 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.499809 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.500113 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.500181 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:02.503303 (+ 3122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:43:02.503305 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:43:02.503305 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:43:02.503312 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:43:02.504920 (+ 1608us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:02.505433 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:02.505434 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:02.505435 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:02.505497 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:02.505711 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:02.505712 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:02.505713 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:02.505834 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:43:02.506037 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:02.506074 (+ 37us) server_negotiation.cc:299] Negotiation successful
0807 22:43:02.506146 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":67}
I20260807 22:43:02.507506 12411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:02.499734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:42079 (local address 127.0.0.1:50512)
0807 22:43:02.499871 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:02.499882 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 22:43:02.499925 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:43:02.500234 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:43:02.500235 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:43:02.500438 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:43:02.500493 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:02.500495 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.501465 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.501466 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:02.502202 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:02.502205 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.502687 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.502688 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:02.502747 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:02.503167 (+ 420us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:43:02.503172 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:43:02.504667 (+ 1495us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:43:02.506524 (+ 1857us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:02.506525 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:02.506525 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:02.506721 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:02.506936 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:02.506937 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:02.506937 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:02.506988 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:02.507236 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:43:02.507236 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:43:02.507269 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 22:43:02.507310 (+ 41us) client_negotiation.cc:240] Negotiation successful
0807 22:43:02.507397 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122}
I20260807 22:43:02.507872 12415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:02.499811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50512 (local address 127.22.212.124:42079)
0807 22:43:02.500113 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:02.500116 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:02.500125 (+ 9us) server_negotiation.cc:407] Connection header received
0807 22:43:02.500145 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:02.500146 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:02.500158 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:02.500562 (+ 404us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:43:02.500586 (+ 24us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.501354 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.502294 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.502606 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.502887 (+ 281us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:02.504766 (+ 1879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:43:02.504767 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:43:02.504767 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:43:02.504774 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:43:02.506419 (+ 1645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:02.506822 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:02.506823 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:02.506823 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:02.506870 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:02.507048 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:02.507049 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:02.507049 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:02.507164 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:43:02.507677 (+ 513us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:02.507717 (+ 40us) server_negotiation.cc:299] Negotiation successful
0807 22:43:02.507789 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":282}
I20260807 22:43:02.509378 12409 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b57854657644f0da56eb6b81ccf69dd: Bootstrap starting.
I20260807 22:43:02.510040 12409 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7b57854657644f0da56eb6b81ccf69dd: Neither blocks nor log segments found. Creating new log.
I20260807 22:43:02.510329 12409 log.cc:824] T 00000000000000000000000000000000 P 7b57854657644f0da56eb6b81ccf69dd: Log is configured to *not* fsync() on all Append() calls
I20260807 22:43:02.511215 12409 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b57854657644f0da56eb6b81ccf69dd: No bootstrap required, opened a new log
Aug 07 22:43:02 dist-test-slave-2d19 krb5kdc[12031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142581, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.212.125@KRBTEST.COM
I20260807 22:43:02.513345 12409 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7b57854657644f0da56eb6b81ccf69dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4bcd68c2274429acb89f9efdd69649" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35197 } } peers { permanent_uuid: "4d70996fe5334cdeb5d01264bd57cc1b" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 35517 } } peers { permanent_uuid: "7b57854657644f0da56eb6b81ccf69dd" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 42079 } }
I20260807 22:43:02.513553 12409 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7b57854657644f0da56eb6b81ccf69dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:43:02.513629 12409 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7b57854657644f0da56eb6b81ccf69dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b57854657644f0da56eb6b81ccf69dd, State: Initialized, Role: FOLLOWER
I20260807 22:43:02.513845 12409 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7b57854657644f0da56eb6b81ccf69dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4bcd68c2274429acb89f9efdd69649" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35197 } } peers { permanent_uuid: "4d70996fe5334cdeb5d01264bd57cc1b" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 35517 } } peers { permanent_uuid: "7b57854657644f0da56eb6b81ccf69dd" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 42079 } }
I20260807 22:43:02.514149 12440 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b57854657644f0da56eb6b81ccf69dd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4bcd68c2274429acb89f9efdd69649" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35197 } } peers { permanent_uuid: "4d70996fe5334cdeb5d01264bd57cc1b" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 35517 } } peers { permanent_uuid: "7b57854657644f0da56eb6b81ccf69dd" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 42079 } } }
I20260807 22:43:02.514206 12409 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7b57854657644f0da56eb6b81ccf69dd [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:43:02.514815 12288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:02.506917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40484 (local address 127.22.212.125:35517)
0807 22:43:02.506955 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:02.506957 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:02.507006 (+ 49us) server_negotiation.cc:407] Connection header received
0807 22:43:02.507069 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:02.507070 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:02.507080 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:02.507125 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:43:02.507769 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.508512 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.509147 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.509348 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.509420 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:02.511834 (+ 2414us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:43:02.511835 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:43:02.511835 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:43:02.511843 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:43:02.513627 (+ 1784us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:02.514017 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:02.514018 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:02.514019 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:02.514079 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:02.514278 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:02.514278 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:02.514279 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:02.514399 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:43:02.514563 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:02.514643 (+ 80us) server_negotiation.cc:299] Negotiation successful
0807 22:43:02.514726 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260807 22:43:02.515843 12440 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b57854657644f0da56eb6b81ccf69dd [sys.catalog]: This master's current role is: FOLLOWER
W20260807 22:43:02.516671 12456 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7b57854657644f0da56eb6b81ccf69dd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260807 22:43:02.516762 23377 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260807 22:43:02.516783 12456 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:43:02.519548 12292 master_runner.cc:186] Error getting master registration for 127.22.212.125:35517: OK, instance_id { permanent_uuid: "4d70996fe5334cdeb5d01264bd57cc1b" instance_seqno: 1786142582301028 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 22:43:02.521883 12292 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 22:43:02.526991 12288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:02.518276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40500 (local address 127.22.212.125:35517)
0807 22:43:02.518605 (+ 329us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:02.518607 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:02.518853 (+ 246us) server_negotiation.cc:407] Connection header received
0807 22:43:02.518946 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:02.518947 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:02.518959 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:02.518986 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:43:02.519669 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.520381 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.521489 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.521767 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.521807 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:02.523661 (+ 1854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:43:02.523662 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:43:02.523662 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:43:02.523670 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:43:02.525604 (+ 1934us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:02.526133 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:02.526134 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:02.526135 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:02.526192 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:02.526408 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:02.526409 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:02.526410 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:02.526539 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:43:02.526611 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:02.526816 (+ 205us) server_negotiation.cc:299] Negotiation successful
0807 22:43:02.526894 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":309}
I20260807 22:43:02.527194 12169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:02.518554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60292 (local address 127.22.212.126:35197)
0807 22:43:02.518605 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:02.518606 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:02.518691 (+ 85us) server_negotiation.cc:407] Connection header received
0807 22:43:02.518767 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:02.518768 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:02.518779 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:02.518833 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:43:02.519598 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.520369 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.521502 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.521818 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.521857 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:02.523594 (+ 1737us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:43:02.523596 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:43:02.523596 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:43:02.523603 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:43:02.525642 (+ 2039us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:02.526239 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:02.526240 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:02.526241 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:02.526306 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:02.526542 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:02.526543 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:02.526543 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:02.526679 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:43:02.526758 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:02.526988 (+ 230us) server_negotiation.cc:299] Negotiation successful
0807 22:43:02.527080 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260807 22:43:02.529512 12415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:02.518453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50514 (local address 127.22.212.124:42079)
0807 22:43:02.518639 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:02.518640 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:02.520740 (+ 2100us) server_negotiation.cc:407] Connection header received
0807 22:43:02.522204 (+ 1464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:02.522205 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:02.522215 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:02.522264 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:43:02.522883 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.523627 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.524708 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.524986 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.525034 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:02.526636 (+ 1602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:43:02.526637 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:43:02.526637 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:43:02.526643 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:43:02.528444 (+ 1801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:02.528741 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:02.528742 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:02.528743 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:02.528805 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:02.529022 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:02.529023 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:02.529023 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:02.529155 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:43:02.529243 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:02.529338 (+ 95us) server_negotiation.cc:299] Negotiation successful
0807 22:43:02.529424 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167}
I20260807 22:43:02.539075 12283 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.212.124" port: 42079 } attempt: 3
Aug 07 22:43:02 dist-test-slave-2d19 krb5kdc[12031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142582, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.125@KRBTEST.COM for kudu/127.22.212.124@KRBTEST.COM
I20260807 22:43:02.547591 12286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:02.539357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:42079 (local address 127.0.0.1:50520)
0807 22:43:02.539409 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:02.539422 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:43:02.539462 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:43:02.539601 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:43:02.539602 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:43:02.539790 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:43:02.539839 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:02.539841 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.540813 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.540815 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:02.541666 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:02.541669 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.542254 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.542255 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:02.542317 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:02.542831 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:43:02.542836 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:43:02.544467 (+ 1631us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:43:02.546466 (+ 1999us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:02.546467 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:02.546467 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:02.546693 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:02.546910 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:02.546911 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:02.546912 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:02.546984 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:02.547256 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:43:02.547257 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:43:02.547305 (+ 48us) client_negotiation.cc:769] Sending connection context
0807 22:43:02.547378 (+ 73us) client_negotiation.cc:240] Negotiation successful
0807 22:43:02.547485 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260807 22:43:02.547608 12415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:02.539421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50520 (local address 127.22.212.124:42079)
0807 22:43:02.539474 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:02.539476 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:02.539484 (+ 8us) server_negotiation.cc:407] Connection header received
0807 22:43:02.539509 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:02.539510 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:02.539521 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:02.539585 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:43:02.539915 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.540720 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.541838 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:02.542175 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:02.542252 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:02.544558 (+ 2306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:43:02.544559 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:43:02.544560 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:43:02.544567 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:43:02.546363 (+ 1796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:02.546774 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:02.546775 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:02.546776 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:02.546838 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:02.547052 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:02.547053 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:02.547053 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:02.547186 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:43:02.547255 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:02.547432 (+ 177us) server_negotiation.cc:299] Negotiation successful
0807 22:43:02.547513 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260807 22:43:02.549858 12283 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d70996fe5334cdeb5d01264bd57cc1b: Bootstrap starting.
I20260807 22:43:02.550782 12283 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4d70996fe5334cdeb5d01264bd57cc1b: Neither blocks nor log segments found. Creating new log.
I20260807 22:43:02.551204 12283 log.cc:824] T 00000000000000000000000000000000 P 4d70996fe5334cdeb5d01264bd57cc1b: Log is configured to *not* fsync() on all Append() calls
I20260807 22:43:02.552376 12283 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d70996fe5334cdeb5d01264bd57cc1b: No bootstrap required, opened a new log
I20260807 22:43:02.554641 12283 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4d70996fe5334cdeb5d01264bd57cc1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4bcd68c2274429acb89f9efdd69649" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35197 } } peers { permanent_uuid: "4d70996fe5334cdeb5d01264bd57cc1b" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 35517 } } peers { permanent_uuid: "7b57854657644f0da56eb6b81ccf69dd" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 42079 } }
I20260807 22:43:02.554806 12283 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4d70996fe5334cdeb5d01264bd57cc1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:43:02.554843 12283 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4d70996fe5334cdeb5d01264bd57cc1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d70996fe5334cdeb5d01264bd57cc1b, State: Initialized, Role: FOLLOWER
I20260807 22:43:02.554996 12283 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4d70996fe5334cdeb5d01264bd57cc1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4bcd68c2274429acb89f9efdd69649" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35197 } } peers { permanent_uuid: "4d70996fe5334cdeb5d01264bd57cc1b" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 35517 } } peers { permanent_uuid: "7b57854657644f0da56eb6b81ccf69dd" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 42079 } }
I20260807 22:43:02.555351 12283 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4d70996fe5334cdeb5d01264bd57cc1b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:43:02.555327 12471 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d70996fe5334cdeb5d01264bd57cc1b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4bcd68c2274429acb89f9efdd69649" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35197 } } peers { permanent_uuid: "4d70996fe5334cdeb5d01264bd57cc1b" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 35517 } } peers { permanent_uuid: "7b57854657644f0da56eb6b81ccf69dd" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 42079 } } }
I20260807 22:43:02.555575 12471 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d70996fe5334cdeb5d01264bd57cc1b [sys.catalog]: This master's current role is: FOLLOWER
W20260807 22:43:02.557662 12489 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4d70996fe5334cdeb5d01264bd57cc1b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:43:02.557811 12489 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:43:02.560187 12173 master_runner.cc:263] No leader master found from master 4d70996fe5334cdeb5d01264bd57cc1b
I20260807 22:43:02.560237 12173 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 22:43:02.628177 12087 tablet.cc:2369] T 00000000000000000000000000000000 P 9c4bcd68c2274429acb89f9efdd69649: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 22:43:02.722568 12330 tablet.cc:2369] T 00000000000000000000000000000000 P 7b57854657644f0da56eb6b81ccf69dd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:43:02.725997 12471 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4d70996fe5334cdeb5d01264bd57cc1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:43:02.726099 12471 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4d70996fe5334cdeb5d01264bd57cc1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4bcd68c2274429acb89f9efdd69649" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35197 } } peers { permanent_uuid: "4d70996fe5334cdeb5d01264bd57cc1b" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 35517 } } peers { permanent_uuid: "7b57854657644f0da56eb6b81ccf69dd" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 42079 } }
I20260807 22:43:02.726343 12471 leader_election.cc:288] T 00000000000000000000000000000000 P 4d70996fe5334cdeb5d01264bd57cc1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c4bcd68c2274429acb89f9efdd69649 (127.22.212.126:35197), 7b57854657644f0da56eb6b81ccf69dd (127.22.212.124:42079)
I20260807 22:43:02.726686 12127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4d70996fe5334cdeb5d01264bd57cc1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c4bcd68c2274429acb89f9efdd69649" is_pre_election: true
I20260807 22:43:02.726684 12364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4d70996fe5334cdeb5d01264bd57cc1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b57854657644f0da56eb6b81ccf69dd" is_pre_election: true
I20260807 22:43:02.726859 12127 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9c4bcd68c2274429acb89f9efdd69649 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d70996fe5334cdeb5d01264bd57cc1b in term 0.
I20260807 22:43:02.726857 12364 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7b57854657644f0da56eb6b81ccf69dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d70996fe5334cdeb5d01264bd57cc1b in term 0.
I20260807 22:43:02.727073 12199 leader_election.cc:302] T 00000000000000000000000000000000 P 4d70996fe5334cdeb5d01264bd57cc1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d70996fe5334cdeb5d01264bd57cc1b, 7b57854657644f0da56eb6b81ccf69dd; no voters:
I20260807 22:43:02.727224 12471 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4d70996fe5334cdeb5d01264bd57cc1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:43:02.727303 12471 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4d70996fe5334cdeb5d01264bd57cc1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:43:02.727320 12471 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4d70996fe5334cdeb5d01264bd57cc1b [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:43:02.728088 12471 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4d70996fe5334cdeb5d01264bd57cc1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4bcd68c2274429acb89f9efdd69649" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35197 } } peers { permanent_uuid: "4d70996fe5334cdeb5d01264bd57cc1b" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 35517 } } peers { permanent_uuid: "7b57854657644f0da56eb6b81ccf69dd" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 42079 } }
I20260807 22:43:02.728215 12471 leader_election.cc:288] T 00000000000000000000000000000000 P 4d70996fe5334cdeb5d01264bd57cc1b [CANDIDATE]: Term 1 election: Requested vote from peers 9c4bcd68c2274429acb89f9efdd69649 (127.22.212.126:35197), 7b57854657644f0da56eb6b81ccf69dd (127.22.212.124:42079)
I20260807 22:43:02.728406 12127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4d70996fe5334cdeb5d01264bd57cc1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c4bcd68c2274429acb89f9efdd69649"
I20260807 22:43:02.728434 12364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4d70996fe5334cdeb5d01264bd57cc1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b57854657644f0da56eb6b81ccf69dd"
I20260807 22:43:02.728487 12127 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9c4bcd68c2274429acb89f9efdd69649 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:43:02.728515 12364 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7b57854657644f0da56eb6b81ccf69dd [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:43:02.729197 12127 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9c4bcd68c2274429acb89f9efdd69649 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d70996fe5334cdeb5d01264bd57cc1b in term 1.
I20260807 22:43:02.729367 12199 leader_election.cc:302] T 00000000000000000000000000000000 P 4d70996fe5334cdeb5d01264bd57cc1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d70996fe5334cdeb5d01264bd57cc1b, 9c4bcd68c2274429acb89f9efdd69649; no voters:
I20260807 22:43:02.729421 12364 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7b57854657644f0da56eb6b81ccf69dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d70996fe5334cdeb5d01264bd57cc1b in term 1.
I20260807 22:43:02.729453 12471 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4d70996fe5334cdeb5d01264bd57cc1b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:43:02.729628 12471 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4d70996fe5334cdeb5d01264bd57cc1b [term 1 LEADER]: Becoming Leader. State: Replica: 4d70996fe5334cdeb5d01264bd57cc1b, State: Running, Role: LEADER
I20260807 22:43:02.729722 12471 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4d70996fe5334cdeb5d01264bd57cc1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4bcd68c2274429acb89f9efdd69649" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35197 } } peers { permanent_uuid: "4d70996fe5334cdeb5d01264bd57cc1b" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 35517 } } peers { permanent_uuid: "7b57854657644f0da56eb6b81ccf69dd" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 42079 } }
I20260807 22:43:02.730268 12493 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d70996fe5334cdeb5d01264bd57cc1b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4d70996fe5334cdeb5d01264bd57cc1b. Latest consensus state: current_term: 1 leader_uuid: "4d70996fe5334cdeb5d01264bd57cc1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4bcd68c2274429acb89f9efdd69649" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35197 } } peers { permanent_uuid: "4d70996fe5334cdeb5d01264bd57cc1b" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 35517 } } peers { permanent_uuid: "7b57854657644f0da56eb6b81ccf69dd" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 42079 } } }
I20260807 22:43:02.730373 12493 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d70996fe5334cdeb5d01264bd57cc1b [sys.catalog]: This master's current role is: LEADER
I20260807 22:43:02.730573 12496 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:43:02.730772 12496 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:43:02.732105 12364 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7b57854657644f0da56eb6b81ccf69dd [term 1 FOLLOWER]: Refusing update from remote peer 4d70996fe5334cdeb5d01264bd57cc1b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:43:02.732123 12127 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9c4bcd68c2274429acb89f9efdd69649 [term 1 FOLLOWER]: Refusing update from remote peer 4d70996fe5334cdeb5d01264bd57cc1b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:43:02.732431 12471 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4d70996fe5334cdeb5d01264bd57cc1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c4bcd68c2274429acb89f9efdd69649" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:43:02.732553 12493 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4d70996fe5334cdeb5d01264bd57cc1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b57854657644f0da56eb6b81ccf69dd" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 42079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:43:02.733779 12419 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c4bcd68c2274429acb89f9efdd69649 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4d70996fe5334cdeb5d01264bd57cc1b. Latest consensus state: current_term: 1 leader_uuid: "4d70996fe5334cdeb5d01264bd57cc1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4bcd68c2274429acb89f9efdd69649" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35197 } } peers { permanent_uuid: "4d70996fe5334cdeb5d01264bd57cc1b" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 35517 } } peers { permanent_uuid: "7b57854657644f0da56eb6b81ccf69dd" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 42079 } } }
I20260807 22:43:02.733783 12440 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b57854657644f0da56eb6b81ccf69dd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4d70996fe5334cdeb5d01264bd57cc1b. Latest consensus state: current_term: 1 leader_uuid: "4d70996fe5334cdeb5d01264bd57cc1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4bcd68c2274429acb89f9efdd69649" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35197 } } peers { permanent_uuid: "4d70996fe5334cdeb5d01264bd57cc1b" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 35517 } } peers { permanent_uuid: "7b57854657644f0da56eb6b81ccf69dd" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 42079 } } }
I20260807 22:43:02.733866 12419 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c4bcd68c2274429acb89f9efdd69649 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:43:02.733866 12440 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b57854657644f0da56eb6b81ccf69dd [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:43:02.734586 12493 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d70996fe5334cdeb5d01264bd57cc1b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4d70996fe5334cdeb5d01264bd57cc1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4bcd68c2274429acb89f9efdd69649" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35197 } } peers { permanent_uuid: "4d70996fe5334cdeb5d01264bd57cc1b" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 35517 } } peers { permanent_uuid: "7b57854657644f0da56eb6b81ccf69dd" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 42079 } } }
I20260807 22:43:02.734668 12493 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d70996fe5334cdeb5d01264bd57cc1b [sys.catalog]: This master's current role is: LEADER
I20260807 22:43:02.734879 12493 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d70996fe5334cdeb5d01264bd57cc1b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4d70996fe5334cdeb5d01264bd57cc1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4bcd68c2274429acb89f9efdd69649" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35197 } } peers { permanent_uuid: "4d70996fe5334cdeb5d01264bd57cc1b" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 35517 } } peers { permanent_uuid: "7b57854657644f0da56eb6b81ccf69dd" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 42079 } } }
I20260807 22:43:02.734961 12493 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d70996fe5334cdeb5d01264bd57cc1b [sys.catalog]: This master's current role is: LEADER
I20260807 22:43:02.734943 12419 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c4bcd68c2274429acb89f9efdd69649 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4d70996fe5334cdeb5d01264bd57cc1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4bcd68c2274429acb89f9efdd69649" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35197 } } peers { permanent_uuid: "4d70996fe5334cdeb5d01264bd57cc1b" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 35517 } } peers { permanent_uuid: "7b57854657644f0da56eb6b81ccf69dd" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 42079 } } }
I20260807 22:43:02.735016 12419 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c4bcd68c2274429acb89f9efdd69649 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:43:02.735374 12440 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b57854657644f0da56eb6b81ccf69dd [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4d70996fe5334cdeb5d01264bd57cc1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4bcd68c2274429acb89f9efdd69649" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35197 } } peers { permanent_uuid: "4d70996fe5334cdeb5d01264bd57cc1b" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 35517 } } peers { permanent_uuid: "7b57854657644f0da56eb6b81ccf69dd" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 42079 } } }
I20260807 22:43:02.735466 12440 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b57854657644f0da56eb6b81ccf69dd [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:43:02.735917 12496 catalog_manager.cc:1347] Generated new cluster ID: 61c17071a6524a019a93095610ae19bb
I20260807 22:43:02.735967 12496 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:43:02.751299 12496 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:43:02.751857 12496 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:43:02.758021 12496 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4d70996fe5334cdeb5d01264bd57cc1b: Generated new TSK 0
I20260807 22:43:02.758231 12496 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:43:03.500209 12434 catalog_manager.cc:1259] Loaded cluster ID: 61c17071a6524a019a93095610ae19bb
I20260807 22:43:03.500344 12434 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9c4bcd68c2274429acb89f9efdd69649: loading cluster ID for follower catalog manager: success
I20260807 22:43:03.501150 12434 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9c4bcd68c2274429acb89f9efdd69649: acquiring CA information for follower catalog manager: success
I20260807 22:43:03.501410 12434 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9c4bcd68c2274429acb89f9efdd69649: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 22:43:03.517259 12456 catalog_manager.cc:1259] Loaded cluster ID: 61c17071a6524a019a93095610ae19bb
I20260807 22:43:03.517354 12456 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7b57854657644f0da56eb6b81ccf69dd: loading cluster ID for follower catalog manager: success
I20260807 22:43:03.518222 12456 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7b57854657644f0da56eb6b81ccf69dd: acquiring CA information for follower catalog manager: success
I20260807 22:43:03.518570 12456 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7b57854657644f0da56eb6b81ccf69dd: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 22:43:03.810715 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 12049
I20260807 22:43:03.821810 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 12173
I20260807 22:43:03.835933 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 12292
2026-08-07T22:43:03Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3275 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142418640232-23377-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:43:03 dist-test-slave-2d19 krb5kdc[12526](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:43:03 dist-test-slave-2d19 krb5kdc[12526](info): set up 2 sockets
Aug 07 22:43:03 dist-test-slave-2d19 krb5kdc[12526](info): commencing operation
krb5kdc: starting...
W20260807 22:43:05.121522 23377 mini_kdc.cc:121] Time spent starting KDC: real 1.262s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Aug 07 22:43:05 dist-test-slave-2d19 krb5kdc[12526](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142585, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:43:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:43:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.212.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
I20260807 22:43:05.263085 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:43943
--webserver_interface=127.22.212.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:41343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:43943
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:43:05.347436 12544 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:43:05.347690 12544 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:43:05.347728 12544 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:43:05.348917 12544 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:43:05.348997 12544 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:43:05.349025 12544 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:43:05.349052 12544 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:43:05.349082 12544 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:43:05.350585 12544 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:41343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:43943
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:43943
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12544
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:43:05.350875 12544 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:43:05.351125 12544 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:43:05.356397 12551 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:43:05.356392 12550 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:43:05.356392 12553 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:43:05.356410 12544 server_base.cc:1034] running on GCE node
I20260807 22:43:05.356907 12544 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:43:05.357218 12544 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:43:05.358373 12544 hybrid_clock.cc:648] HybridClock initialized: now 1786142585358359 us; error 29 us; skew 500 ppm
Aug 07 22:43:05 dist-test-slave-2d19 krb5kdc[12526](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142585, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:43:05.361135 12544 init.cc:377] Logged in from keytab as kudu/127.22.212.126@KRBTEST.COM (short username kudu)
I20260807 22:43:05.361513 12544 webserver.cc:460] Webserver started at http://127.22.212.126:37377/ using document root <none> and password file <none>
I20260807 22:43:05.361725 12544 fs_manager.cc:359] Metadata directory not provided
I20260807 22:43:05.361766 12544 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:43:05.361853 12544 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:43:05.362862 12544 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "6da03839790545099edecbeae7ed00db"
format_stamp: "Formatted at 2026-08-07 22:43:05 on dist-test-slave-2d19"
server_key: "c3d104ad779495641ca0a55076e9dd0e"
server_key_iv: "d55302fe98d6860616a116ef615eda33"
server_key_version: "encryptionkey@0"
I20260807 22:43:05.363157 12544 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "6da03839790545099edecbeae7ed00db"
format_stamp: "Formatted at 2026-08-07 22:43:05 on dist-test-slave-2d19"
server_key: "c3d104ad779495641ca0a55076e9dd0e"
server_key_iv: "d55302fe98d6860616a116ef615eda33"
server_key_version: "encryptionkey@0"
I20260807 22:43:05.364475 12544 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 22:43:05.365208 12561 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:43:05.365391 12544 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:43:05.365466 12544 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "6da03839790545099edecbeae7ed00db"
format_stamp: "Formatted at 2026-08-07 22:43:05 on dist-test-slave-2d19"
server_key: "c3d104ad779495641ca0a55076e9dd0e"
server_key_iv: "d55302fe98d6860616a116ef615eda33"
server_key_version: "encryptionkey@0"
I20260807 22:43:05.365532 12544 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:43:05.374089 12544 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:43:05.376423 12544 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:43:05.376534 12544 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:43:05.380447 12544 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:43943
I20260807 22:43:05.380507 12648 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:43943 every 8 connection(s)
I20260807 22:43:05.380913 12544 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:43:05.381824 12649 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:43:05.384099 12649 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6da03839790545099edecbeae7ed00db: Bootstrap starting.
I20260807 22:43:05.384743 12649 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6da03839790545099edecbeae7ed00db: Neither blocks nor log segments found. Creating new log.
I20260807 22:43:05.385036 12649 log.cc:824] T 00000000000000000000000000000000 P 6da03839790545099edecbeae7ed00db: Log is configured to *not* fsync() on all Append() calls
I20260807 22:43:05.385877 12649 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6da03839790545099edecbeae7ed00db: No bootstrap required, opened a new log
I20260807 22:43:05.387689 12649 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6da03839790545099edecbeae7ed00db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6da03839790545099edecbeae7ed00db" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43943 } }
I20260807 22:43:05.387861 12649 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6da03839790545099edecbeae7ed00db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:43:05.387912 12649 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6da03839790545099edecbeae7ed00db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6da03839790545099edecbeae7ed00db, State: Initialized, Role: FOLLOWER
I20260807 22:43:05.388108 12649 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6da03839790545099edecbeae7ed00db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6da03839790545099edecbeae7ed00db" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43943 } }
I20260807 22:43:05.388226 12649 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6da03839790545099edecbeae7ed00db [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:43:05.388309 12649 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6da03839790545099edecbeae7ed00db [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:43:05.388365 12649 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6da03839790545099edecbeae7ed00db [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:43:05.388808 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 12544
I20260807 22:43:05.388999 12649 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6da03839790545099edecbeae7ed00db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6da03839790545099edecbeae7ed00db" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43943 } }
I20260807 22:43:05.389046 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:43:05.389122 12649 leader_election.cc:302] T 00000000000000000000000000000000 P 6da03839790545099edecbeae7ed00db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6da03839790545099edecbeae7ed00db; no voters:
I20260807 22:43:05.389292 23377 external_mini_cluster.cc:1428] Setting key e9fb2e875dbebf4e368a8f7a5cc3f724
I20260807 22:43:05.389334 12649 leader_election.cc:288] T 00000000000000000000000000000000 P 6da03839790545099edecbeae7ed00db [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:43:05.389364 12654 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6da03839790545099edecbeae7ed00db [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:43:05.389530 12654 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6da03839790545099edecbeae7ed00db [term 1 LEADER]: Becoming Leader. State: Replica: 6da03839790545099edecbeae7ed00db, State: Running, Role: LEADER
I20260807 22:43:05.389626 12649 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6da03839790545099edecbeae7ed00db [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:43:05.389676 12654 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6da03839790545099edecbeae7ed00db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6da03839790545099edecbeae7ed00db" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43943 } }
I20260807 22:43:05.390373 12655 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6da03839790545099edecbeae7ed00db [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6da03839790545099edecbeae7ed00db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6da03839790545099edecbeae7ed00db" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43943 } } }
I20260807 22:43:05.390473 12655 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6da03839790545099edecbeae7ed00db [sys.catalog]: This master's current role is: LEADER
I20260807 22:43:05.391067 12657 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6da03839790545099edecbeae7ed00db [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6da03839790545099edecbeae7ed00db. Latest consensus state: current_term: 1 leader_uuid: "6da03839790545099edecbeae7ed00db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6da03839790545099edecbeae7ed00db" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43943 } } }
I20260807 22:43:05.391347 12657 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6da03839790545099edecbeae7ed00db [sys.catalog]: This master's current role is: LEADER
W20260807 22:43:05.391588 12681 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6da03839790545099edecbeae7ed00db: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:43:05.391654 12681 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:43:05.391700 12668 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:43:05.391913 12668 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:43:05.393622 12668 catalog_manager.cc:1347] Generated new cluster ID: d15d4d85bf174410a15609aed81fea99
I20260807 22:43:05.393676 12668 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 22:43:05 dist-test-slave-2d19 krb5kdc[12526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142585, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:43:05.402104 12660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:05.389882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33626 (local address 127.22.212.126:43943)
0807 22:43:05.390278 (+ 396us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:05.390288 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:05.390318 (+ 30us) server_negotiation.cc:407] Connection header received
0807 22:43:05.390453 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:05.390461 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:05.390521 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:05.391471 (+ 950us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:43:05.391802 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:05.393116 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:05.394186 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:05.394818 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:05.394977 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:05.397838 (+ 2861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:43:05.397842 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:43:05.397843 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:43:05.397855 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:43:05.400412 (+ 2557us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:05.400833 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:05.400836 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:05.400836 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:05.400950 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:05.401165 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:05.401166 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:05.401166 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:05.401463 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:43:05.401600 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:05.401734 (+ 134us) server_negotiation.cc:299] Negotiation successful
0807 22:43:05.401860 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":71,"threads_started":1}
I20260807 22:43:05.403144 23377 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:43:05.417147 12668 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:43:05.417907 12668 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:43:05.423466 12668 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6da03839790545099edecbeae7ed00db: Generated new TSK 0
I20260807 22:43:05.423671 12668 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:43:05.457325 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 12544
2026-08-07T22:43:05Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1623 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:43:05 dist-test-slave-2d19 krb5kdc[12691](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:43:05 dist-test-slave-2d19 krb5kdc[12691](info): set up 2 sockets
Aug 07 22:43:05 dist-test-slave-2d19 krb5kdc[12691](info): commencing operation
krb5kdc: starting...
W20260807 22:43:06.756088 23377 mini_kdc.cc:121] Time spent starting KDC: real 1.273s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Aug 07 22:43:06 dist-test-slave-2d19 krb5kdc[12691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142586, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:43:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:43:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.212.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
I20260807 22:43:06.888986 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:35997
--webserver_interface=127.22.212.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:41371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:35997
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:43:06.975188 12706 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:43:06.975407 12706 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:43:06.975430 12706 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:43:06.976536 12706 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:43:06.976572 12706 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:43:06.976588 12706 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:43:06.976600 12706 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:43:06.976612 12706 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:43:06.978063 12706 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:41371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:35997
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:35997
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12706
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:43:06.978267 12706 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:43:06.978447 12706 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:43:06.983506 12715 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:43:06.983683 12706 server_base.cc:1034] running on GCE node
W20260807 22:43:06.983547 12717 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:43:06.983507 12713 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:43:06.984093 12706 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:43:06.984462 12706 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:43:06.985625 12706 hybrid_clock.cc:648] HybridClock initialized: now 1786142586985589 us; error 39 us; skew 500 ppm
Aug 07 22:43:06 dist-test-slave-2d19 krb5kdc[12691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142586, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:43:06.988344 12706 init.cc:377] Logged in from keytab as kudu/127.22.212.126@KRBTEST.COM (short username kudu)
I20260807 22:43:06.988788 12706 webserver.cc:460] Webserver started at http://127.22.212.126:35265/ using document root <none> and password file <none>
I20260807 22:43:06.989006 12706 fs_manager.cc:359] Metadata directory not provided
I20260807 22:43:06.989050 12706 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:43:06.989161 12706 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:43:06.990303 12706 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "646949290ae4462abbdada3791cc4033"
format_stamp: "Formatted at 2026-08-07 22:43:06 on dist-test-slave-2d19"
server_key: "a64b0b5f55c0247edebf28e52b222fc0"
server_key_iv: "31969a486621b0b08155adfe91e39986"
server_key_version: "encryptionkey@0"
I20260807 22:43:06.990679 12706 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "646949290ae4462abbdada3791cc4033"
format_stamp: "Formatted at 2026-08-07 22:43:06 on dist-test-slave-2d19"
server_key: "a64b0b5f55c0247edebf28e52b222fc0"
server_key_iv: "31969a486621b0b08155adfe91e39986"
server_key_version: "encryptionkey@0"
I20260807 22:43:06.992022 12706 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260807 22:43:06.992930 12728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:43:06.993104 12706 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 22:43:06.993201 12706 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "646949290ae4462abbdada3791cc4033"
format_stamp: "Formatted at 2026-08-07 22:43:06 on dist-test-slave-2d19"
server_key: "a64b0b5f55c0247edebf28e52b222fc0"
server_key_iv: "31969a486621b0b08155adfe91e39986"
server_key_version: "encryptionkey@0"
I20260807 22:43:06.993257 12706 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:43:07.009572 12706 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:43:07.011777 12706 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:43:07.011931 12706 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:43:07.016081 12706 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:35997
I20260807 22:43:07.016165 12814 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:35997 every 8 connection(s)
I20260807 22:43:07.016513 12706 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:43:07.018067 12815 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:43:07.020689 12815 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033: Bootstrap starting.
I20260807 22:43:07.021304 12815 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033: Neither blocks nor log segments found. Creating new log.
I20260807 22:43:07.021589 12815 log.cc:824] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033: Log is configured to *not* fsync() on all Append() calls
I20260807 22:43:07.022375 12815 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033: No bootstrap required, opened a new log
I20260807 22:43:07.024168 12815 raft_consensus.cc:348] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "646949290ae4462abbdada3791cc4033" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35997 } }
I20260807 22:43:07.024354 12815 raft_consensus.cc:374] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:43:07.024381 12815 raft_consensus.cc:729] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 646949290ae4462abbdada3791cc4033, State: Initialized, Role: FOLLOWER
I20260807 22:43:07.024556 12815 consensus_queue.cc:260] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "646949290ae4462abbdada3791cc4033" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35997 } }
I20260807 22:43:07.024649 12815 raft_consensus.cc:388] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:43:07.024688 12815 raft_consensus.cc:482] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:43:07.024726 12815 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:43:07.025019 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 12706
I20260807 22:43:07.025122 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:43:07.025316 23377 external_mini_cluster.cc:1428] Setting key 8c6121757fea0e54f49502cf010805ea
I20260807 22:43:07.025923 12815 raft_consensus.cc:504] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "646949290ae4462abbdada3791cc4033" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35997 } }
I20260807 22:43:07.026144 12815 leader_election.cc:302] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 646949290ae4462abbdada3791cc4033; no voters:
I20260807 22:43:07.026376 12815 leader_election.cc:288] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:43:07.026405 12822 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:43:07.026619 12822 raft_consensus.cc:686] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [term 1 LEADER]: Becoming Leader. State: Replica: 646949290ae4462abbdada3791cc4033, State: Running, Role: LEADER
I20260807 22:43:07.026751 12815 sys_catalog.cc:564] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:43:07.026795 12822 consensus_queue.cc:237] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "646949290ae4462abbdada3791cc4033" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35997 } }
I20260807 22:43:07.027210 12822 sys_catalog.cc:455] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 646949290ae4462abbdada3791cc4033. Latest consensus state: current_term: 1 leader_uuid: "646949290ae4462abbdada3791cc4033" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "646949290ae4462abbdada3791cc4033" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35997 } } }
I20260807 22:43:07.027310 12822 sys_catalog.cc:458] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [sys.catalog]: This master's current role is: LEADER
I20260807 22:43:07.027422 12823 sys_catalog.cc:455] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "646949290ae4462abbdada3791cc4033" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "646949290ae4462abbdada3791cc4033" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35997 } } }
I20260807 22:43:07.027585 12823 sys_catalog.cc:458] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [sys.catalog]: This master's current role is: LEADER
I20260807 22:43:07.027632 12830 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:43:07.028219 12830 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 07 22:43:07 dist-test-slave-2d19 krb5kdc[12691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142586, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:43:07.033888 12830 catalog_manager.cc:1347] Generated new cluster ID: 54b4c856889540fdba51c16456db2982
I20260807 22:43:07.033962 12830 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:43:07.036803 12819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:07.025868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44704 (local address 127.22.212.126:35997)
0807 22:43:07.026058 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:07.026069 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:07.026106 (+ 37us) server_negotiation.cc:407] Connection header received
0807 22:43:07.026205 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:07.026211 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:07.026286 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:07.026442 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:43:07.027309 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:07.028993 (+ 1684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:07.029889 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:07.030561 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:07.030689 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:07.033298 (+ 2609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:43:07.033302 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:43:07.033302 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:43:07.033322 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:43:07.035135 (+ 1813us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:07.035538 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:07.035542 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:07.035542 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:07.035671 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:07.035905 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:07.035906 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:07.035906 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:07.036158 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:43:07.036370 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:07.036443 (+ 73us) server_negotiation.cc:299] Negotiation successful
0807 22:43:07.036593 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":103,"threads_started":1}
I20260807 22:43:07.079015 12830 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:43:07.079604 12830 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:43:07.090034 12830 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033: Generated new TSK 0
I20260807 22:43:07.090271 12830 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.212.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab.
Entry for principal kudu/127.22.212.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab.
I20260807 22:43:07.127345 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.65:0
--local_ip_for_outbound_sockets=127.22.212.65
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:35997
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:41371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:43:07.238613 12860 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:43:07.238812 12860 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:43:07.238837 12860 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:43:07.239990 12860 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:43:07.240032 12860 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:43:07.240063 12860 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.65
I20260807 22:43:07.241626 12860 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:41371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:35997
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12860
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.65
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:43:07.241888 12860 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:43:07.242152 12860 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:43:07.247794 12873 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:43:07.247802 12869 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:43:07.247808 12867 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:43:07.247819 12860 server_base.cc:1034] running on GCE node
I20260807 22:43:07.248334 12860 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:43:07.248603 12860 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:43:07.249765 12860 hybrid_clock.cc:648] HybridClock initialized: now 1786142587249754 us; error 32 us; skew 500 ppm
Aug 07 22:43:07 dist-test-slave-2d19 krb5kdc[12691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142587, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:43:07.252492 12860 init.cc:377] Logged in from keytab as kudu/127.22.212.65@KRBTEST.COM (short username kudu)
I20260807 22:43:07.252974 12860 webserver.cc:460] Webserver started at http://127.22.212.65:37609/ using document root <none> and password file <none>
I20260807 22:43:07.253214 12860 fs_manager.cc:359] Metadata directory not provided
I20260807 22:43:07.253259 12860 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:43:07.253350 12860 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:43:07.254406 12860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-0/data/instance:
uuid: "c426e7add5844349b527e7cc4d8b99d1"
format_stamp: "Formatted at 2026-08-07 22:43:07 on dist-test-slave-2d19"
server_key: "edfcf7d5ca5fc0e0dae323a18adebd0a"
server_key_iv: "c8c228ce1d1c97b343e12777c88afd7f"
server_key_version: "encryptionkey@0"
I20260807 22:43:07.254769 12860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance:
uuid: "c426e7add5844349b527e7cc4d8b99d1"
format_stamp: "Formatted at 2026-08-07 22:43:07 on dist-test-slave-2d19"
server_key: "edfcf7d5ca5fc0e0dae323a18adebd0a"
server_key_iv: "c8c228ce1d1c97b343e12777c88afd7f"
server_key_version: "encryptionkey@0"
I20260807 22:43:07.256172 12860 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260807 22:43:07.257015 12886 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:43:07.257206 12860 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 22:43:07.257303 12860 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-0/wal
uuid: "c426e7add5844349b527e7cc4d8b99d1"
format_stamp: "Formatted at 2026-08-07 22:43:07 on dist-test-slave-2d19"
server_key: "edfcf7d5ca5fc0e0dae323a18adebd0a"
server_key_iv: "c8c228ce1d1c97b343e12777c88afd7f"
server_key_version: "encryptionkey@0"
I20260807 22:43:07.257362 12860 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:43:07.273872 12860 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:43:07.276124 12860 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:43:07.276237 12860 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:43:07.276549 12860 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:43:07.276871 12860 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:43:07.276912 12860 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:43:07.276966 12860 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:43:07.276991 12860 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:43:07.282702 12860 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.65:45089
I20260807 22:43:07.282778 13063 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.65:45089 every 8 connection(s)
I20260807 22:43:07.283106 12860 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
I20260807 22:43:07.283934 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 12860
I20260807 22:43:07.284065 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance
I20260807 22:43:07.284307 23377 external_mini_cluster.cc:1428] Setting key c7d6ddffe075eacaf0c9098ba0f49720
Aug 07 22:43:07 dist-test-slave-2d19 krb5kdc[12691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142587, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.212.66@KRBTEST.COM; defaulting to no policy
I20260807 22:43:07.293249 12819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:07.283871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:48751 (local address 127.22.212.126:35997)
0807 22:43:07.283946 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:07.283949 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:07.284185 (+ 236us) server_negotiation.cc:407] Connection header received
0807 22:43:07.284838 (+ 653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:07.284839 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:07.284850 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:07.284889 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:43:07.286217 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:07.286723 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:07.287822 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:07.288039 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:07.288116 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:07.290350 (+ 2234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:43:07.290352 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:43:07.290352 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:43:07.290360 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:43:07.291779 (+ 1419us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:07.292209 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:07.292211 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:07.292211 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:07.292335 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:07.292594 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:07.292595 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:07.292595 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:07.292713 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:43:07.292787 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:07.293067 (+ 280us) server_negotiation.cc:299] Negotiation successful
0807 22:43:07.293157 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 22:43:07.293481 13067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:07.283821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.65:48751)
0807 22:43:07.284047 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:07.284099 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 22:43:07.284750 (+ 651us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:43:07.284976 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:43:07.284980 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:43:07.285826 (+ 846us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:43:07.286102 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:07.286110 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:07.286844 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:07.286845 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:07.287716 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:07.287718 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:07.288125 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:07.288126 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:07.288307 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:07.288845 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:43:07.288859 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:43:07.290249 (+ 1390us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:43:07.291893 (+ 1644us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:07.291901 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:07.291903 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:07.292129 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:07.292406 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:07.292407 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:07.292407 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:07.292517 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:07.292777 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:43:07.292784 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:43:07.292926 (+ 142us) client_negotiation.cc:769] Sending connection context
0807 22:43:07.293030 (+ 104us) client_negotiation.cc:240] Negotiation successful
0807 22:43:07.293184 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":104,"threads_started":1}
I20260807 22:43:07.293985 13065 heartbeater.cc:347] Connected to a master server at 127.22.212.126:35997
I20260807 22:43:07.294070 13065 heartbeater.cc:464] Registering TS with master...
I20260807 22:43:07.294260 13065 heartbeater.cc:511] Master 127.22.212.126:35997 requested a full tablet report, sending...
I20260807 22:43:07.294800 12756 ts_manager.cc:194] Registered new tserver with Master: c426e7add5844349b527e7cc4d8b99d1 (127.22.212.65:45089)
I20260807 22:43:07.295486 12756 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.65@KRBTEST.COM'} at 127.22.212.65:48751
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab.
Entry for principal kudu/127.22.212.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab.
I20260807 22:43:07.312196 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.66:0
--local_ip_for_outbound_sockets=127.22.212.66
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:35997
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:41371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:43:07.397318 13071 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:43:07.397526 13071 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:43:07.397549 13071 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:43:07.398696 13071 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:43:07.398741 13071 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:43:07.398767 13071 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.66
I20260807 22:43:07.400209 13071 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:41371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:35997
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13071
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.66
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:43:07.400475 13071 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:43:07.400727 13071 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:43:07.406244 13079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:43:07.406323 13071 server_base.cc:1034] running on GCE node
W20260807 22:43:07.406232 13081 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:43:07.406255 13078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:43:07.406643 13071 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:43:07.406905 13071 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:43:07.408051 13071 hybrid_clock.cc:648] HybridClock initialized: now 1786142587408032 us; error 43 us; skew 500 ppm
Aug 07 22:43:07 dist-test-slave-2d19 krb5kdc[12691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142587, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:43:07.410728 13071 init.cc:377] Logged in from keytab as kudu/127.22.212.66@KRBTEST.COM (short username kudu)
I20260807 22:43:07.411216 13071 webserver.cc:460] Webserver started at http://127.22.212.66:33085/ using document root <none> and password file <none>
I20260807 22:43:07.411449 13071 fs_manager.cc:359] Metadata directory not provided
I20260807 22:43:07.411520 13071 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:43:07.411686 13071 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:43:07.412846 13071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/data/instance:
uuid: "8942be1719f2463aa6703529f245d5bf"
format_stamp: "Formatted at 2026-08-07 22:43:07 on dist-test-slave-2d19"
server_key: "3be2d23c5e9d84b20256af052d48d3d6"
server_key_iv: "22396da00ceb8ac6c340afa77b9dfad3"
server_key_version: "encryptionkey@0"
I20260807 22:43:07.413223 13071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance:
uuid: "8942be1719f2463aa6703529f245d5bf"
format_stamp: "Formatted at 2026-08-07 22:43:07 on dist-test-slave-2d19"
server_key: "3be2d23c5e9d84b20256af052d48d3d6"
server_key_iv: "22396da00ceb8ac6c340afa77b9dfad3"
server_key_version: "encryptionkey@0"
I20260807 22:43:07.414616 13071 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 22:43:07.415416 13091 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:43:07.415618 13071 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:43:07.415722 13071 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/wal
uuid: "8942be1719f2463aa6703529f245d5bf"
format_stamp: "Formatted at 2026-08-07 22:43:07 on dist-test-slave-2d19"
server_key: "3be2d23c5e9d84b20256af052d48d3d6"
server_key_iv: "22396da00ceb8ac6c340afa77b9dfad3"
server_key_version: "encryptionkey@0"
I20260807 22:43:07.415803 13071 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:43:07.432694 13071 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:43:07.434736 13071 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:43:07.434899 13071 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:43:07.435153 13071 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:43:07.435473 13071 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:43:07.435528 13071 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:43:07.435582 13071 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:43:07.435607 13071 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:43:07.441547 13071 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.66:37679
I20260807 22:43:07.441591 13276 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.66:37679 every 8 connection(s)
I20260807 22:43:07.441915 13071 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
I20260807 22:43:07.448143 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 13071
Aug 07 22:43:07 dist-test-slave-2d19 krb5kdc[12691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142587, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:43:07.448262 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance
I20260807 22:43:07.448494 23377 external_mini_cluster.cc:1428] Setting key 11c8f81674b7ae98287c852f0762f9fc
I20260807 22:43:07.451932 12819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:07.442669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:43535 (local address 127.22.212.126:35997)
0807 22:43:07.442747 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:07.442749 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:07.442973 (+ 224us) server_negotiation.cc:407] Connection header received
0807 22:43:07.443507 (+ 534us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:07.443509 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:07.443522 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:07.443572 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:43:07.444552 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:07.445073 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:07.446095 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:07.446302 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:07.446377 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:07.448868 (+ 2491us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:43:07.448869 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:43:07.448869 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:43:07.448875 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:43:07.450351 (+ 1476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:07.450896 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:07.450897 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:07.450897 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:07.450949 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:07.451255 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:07.451255 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:07.451256 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:07.451369 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:43:07.451450 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:07.451746 (+ 296us) server_negotiation.cc:299] Negotiation successful
0807 22:43:07.451828 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 22:43:07.452143 13280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:07.442652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.66:43535)
0807 22:43:07.442848 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:07.442885 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 22:43:07.443396 (+ 511us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:43:07.443654 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:43:07.443658 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:43:07.444225 (+ 567us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:43:07.444447 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:07.444452 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:07.445192 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:07.445193 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:07.445982 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:07.445984 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:07.446396 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:07.446397 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:07.446517 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:07.447085 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:43:07.447094 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:43:07.448743 (+ 1649us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:43:07.450440 (+ 1697us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:07.450448 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:07.450450 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:07.450816 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:07.451019 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:07.451020 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:07.451021 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:07.451181 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:07.451453 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:43:07.451460 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:43:07.451605 (+ 145us) client_negotiation.cc:769] Sending connection context
0807 22:43:07.451712 (+ 107us) client_negotiation.cc:240] Negotiation successful
0807 22:43:07.451883 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":111,"threads_started":1}
I20260807 22:43:07.452708 13277 heartbeater.cc:347] Connected to a master server at 127.22.212.126:35997
I20260807 22:43:07.452824 13277 heartbeater.cc:464] Registering TS with master...
I20260807 22:43:07.453037 13277 heartbeater.cc:511] Master 127.22.212.126:35997 requested a full tablet report, sending...
I20260807 22:43:07.453426 12756 ts_manager.cc:194] Registered new tserver with Master: 8942be1719f2463aa6703529f245d5bf (127.22.212.66:37679)
I20260807 22:43:07.453807 12756 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.66@KRBTEST.COM'} at 127.22.212.66:43535
WARNING: no policy specified for kudu/127.22.212.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab.
Entry for principal kudu/127.22.212.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab.
I20260807 22:43:07.478962 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.67:0
--local_ip_for_outbound_sockets=127.22.212.67
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:35997
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:41371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:43:07.564173 13285 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:43:07.564416 13285 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:43:07.564440 13285 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:43:07.565532 13285 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:43:07.565568 13285 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:43:07.565593 13285 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.67
I20260807 22:43:07.566990 13285 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:41371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:35997
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13285
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.67
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:43:07.567180 13285 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:43:07.567363 13285 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:43:07.572556 13301 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:43:07.572556 13299 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:43:07.572690 13285 server_base.cc:1034] running on GCE node
W20260807 22:43:07.572559 13296 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:43:07.572969 13285 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:43:07.573227 13285 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:43:07.574398 13285 hybrid_clock.cc:648] HybridClock initialized: now 1786142587574371 us; error 39 us; skew 500 ppm
Aug 07 22:43:07 dist-test-slave-2d19 krb5kdc[12691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142587, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:43:07.577203 13285 init.cc:377] Logged in from keytab as kudu/127.22.212.67@KRBTEST.COM (short username kudu)
I20260807 22:43:07.577711 13285 webserver.cc:460] Webserver started at http://127.22.212.67:33015/ using document root <none> and password file <none>
I20260807 22:43:07.577983 13285 fs_manager.cc:359] Metadata directory not provided
I20260807 22:43:07.578055 13285 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:43:07.578210 13285 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:43:07.579268 13285 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/data/instance:
uuid: "546f9f2eb2c24454a5fa849b1fd61906"
format_stamp: "Formatted at 2026-08-07 22:43:07 on dist-test-slave-2d19"
server_key: "19a2b5bf03536fae7426acb864fbad69"
server_key_iv: "4120e7fa6613bb3bdc91adb4781fd266"
server_key_version: "encryptionkey@0"
I20260807 22:43:07.579633 13285 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance:
uuid: "546f9f2eb2c24454a5fa849b1fd61906"
format_stamp: "Formatted at 2026-08-07 22:43:07 on dist-test-slave-2d19"
server_key: "19a2b5bf03536fae7426acb864fbad69"
server_key_iv: "4120e7fa6613bb3bdc91adb4781fd266"
server_key_version: "encryptionkey@0"
I20260807 22:43:07.581112 13285 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 22:43:07.581909 13312 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:43:07.582091 13285 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 22:43:07.582211 13285 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/wal
uuid: "546f9f2eb2c24454a5fa849b1fd61906"
format_stamp: "Formatted at 2026-08-07 22:43:07 on dist-test-slave-2d19"
server_key: "19a2b5bf03536fae7426acb864fbad69"
server_key_iv: "4120e7fa6613bb3bdc91adb4781fd266"
server_key_version: "encryptionkey@0"
I20260807 22:43:07.582290 13285 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:43:07.598034 13285 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:43:07.600582 13285 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:43:07.600751 13285 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:43:07.601004 13285 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:43:07.601332 13285 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:43:07.601388 13285 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:43:07.601432 13285 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:43:07.601462 13285 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:43:07.607630 13285 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.67:39995
I20260807 22:43:07.607674 13494 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.67:39995 every 8 connection(s)
I20260807 22:43:07.608017 13285 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
Aug 07 22:43:07 dist-test-slave-2d19 krb5kdc[12691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142587, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:43:07.614270 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 13285
I20260807 22:43:07.614362 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance
I20260807 22:43:07.614530 23377 external_mini_cluster.cc:1428] Setting key 33889f95297945845e0c86924ed18743
I20260807 22:43:07.617532 12819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:07.608756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:44205 (local address 127.22.212.126:35997)
0807 22:43:07.608830 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:07.608832 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:07.609047 (+ 215us) server_negotiation.cc:407] Connection header received
0807 22:43:07.609564 (+ 517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:07.609566 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:07.609577 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:07.609645 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:43:07.610634 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:07.611170 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:07.612156 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:07.612454 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:07.612515 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:07.614815 (+ 2300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:43:07.614817 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:43:07.614817 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:43:07.614826 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:43:07.616361 (+ 1535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:07.616744 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:07.616744 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:07.616745 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:07.616796 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:07.617017 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:07.617018 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:07.617018 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:07.617122 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:43:07.617174 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:07.617404 (+ 230us) server_negotiation.cc:299] Negotiation successful
0807 22:43:07.617467 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 22:43:07.617743 13499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:07.608737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.67:44205)
0807 22:43:07.608920 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:07.608961 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 22:43:07.609449 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:43:07.609729 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:43:07.609733 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:43:07.610321 (+ 588us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:43:07.610516 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:07.610520 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:07.611257 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:07.611258 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:07.612071 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:07.612073 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:07.612533 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:07.612534 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:07.612650 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:07.613116 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:43:07.613124 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:43:07.614693 (+ 1569us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:43:07.616436 (+ 1743us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:07.616442 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:07.616444 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:07.616678 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:07.616854 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:07.616855 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:07.616855 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:07.616955 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:07.617178 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:43:07.617182 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:43:07.617295 (+ 113us) client_negotiation.cc:769] Sending connection context
0807 22:43:07.617378 (+ 83us) client_negotiation.cc:240] Negotiation successful
0807 22:43:07.617514 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":106,"threads_started":1}
I20260807 22:43:07.618216 13496 heartbeater.cc:347] Connected to a master server at 127.22.212.126:35997
I20260807 22:43:07.618327 13496 heartbeater.cc:464] Registering TS with master...
I20260807 22:43:07.618507 13496 heartbeater.cc:511] Master 127.22.212.126:35997 requested a full tablet report, sending...
I20260807 22:43:07.618916 12756 ts_manager.cc:194] Registered new tserver with Master: 546f9f2eb2c24454a5fa849b1fd61906 (127.22.212.67:39995)
I20260807 22:43:07.619259 12756 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.67@KRBTEST.COM'} at 127.22.212.67:44205
I20260807 22:43:07.626327 23377 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:43:07.633966 12819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:07.627831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44706 (local address 127.22.212.126:35997)
0807 22:43:07.627899 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:07.627902 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:07.628023 (+ 121us) server_negotiation.cc:407] Connection header received
0807 22:43:07.628092 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:07.628094 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:07.628104 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:07.628172 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:43:07.628819 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:07.629305 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:07.630023 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:07.630292 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:07.630415 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:07.631595 (+ 1180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:43:07.631597 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:43:07.631597 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:43:07.631604 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:43:07.632805 (+ 1201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:07.633160 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:07.633162 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:07.633162 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:07.633221 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:07.633423 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:07.633424 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:07.633424 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:07.633573 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:43:07.633676 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:07.633777 (+ 101us) server_negotiation.cc:299] Negotiation successful
0807 22:43:07.633855 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 22:43:07.635599 12756 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44706:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:43:07.637272 12756 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:43:07.643996 13521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:07.640135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41994 (local address 127.22.212.67:39995)
0807 22:43:07.640364 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:07.640368 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:07.640379 (+ 11us) server_negotiation.cc:407] Connection header received
0807 22:43:07.640414 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:07.640416 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:07.640431 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:07.640668 (+ 237us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:43:07.640737 (+ 69us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:07.641764 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:07.642944 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:07.643628 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:07.643705 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:07.643761 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:07.643858 (+ 97us) server_negotiation.cc:299] Negotiation successful
0807 22:43:07.643905 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":105,"threads_started":1}
I20260807 22:43:07.644030 13520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:07.639854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.67:39995 (local address 127.0.0.1:41994)
0807 22:43:07.640048 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:07.640059 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 22:43:07.640100 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:43:07.640554 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:43:07.640556 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:43:07.640558 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:43:07.640594 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:07.640595 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:07.641849 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:07.641850 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:07.642857 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:07.642860 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:07.643716 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:07.643717 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:07.643775 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:07.643787 (+ 12us) client_negotiation.cc:769] Sending connection context
0807 22:43:07.643844 (+ 57us) client_negotiation.cc:240] Negotiation successful
0807 22:43:07.643883 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":143,"threads_started":1}
I20260807 22:43:07.644341 13513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:07.639654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:45089 (local address 127.0.0.1:36608)
0807 22:43:07.639957 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:07.639967 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 22:43:07.640066 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:43:07.640344 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:43:07.640348 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:43:07.640350 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:43:07.640421 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:07.640423 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:07.641761 (+ 1338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:07.641762 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:07.643082 (+ 1320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:07.643085 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:07.644070 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:07.644071 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:07.644147 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:07.644152 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 22:43:07.644203 (+ 51us) client_negotiation.cc:240] Negotiation successful
0807 22:43:07.644269 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"mutex_wait_us":69,"thread_start_us":57,"threads_started":1}
I20260807 22:43:07.644433 13519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:07.639779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36608 (local address 127.22.212.65:45089)
0807 22:43:07.640129 (+ 350us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:07.640135 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:07.640146 (+ 11us) server_negotiation.cc:407] Connection header received
0807 22:43:07.640190 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:07.640192 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:07.640211 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:07.640330 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:43:07.640517 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:07.641659 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:07.643170 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:07.643850 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:07.643917 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:07.643965 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:07.644312 (+ 347us) server_negotiation.cc:299] Negotiation successful
0807 22:43:07.644354 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":307,"thread_start_us":95,"threads_started":1}
I20260807 22:43:07.644878 13385 tablet_service.cc:1467] Processing CreateTablet for tablet ccdfa2aa918b41a9b1ba8cbb2d7bba26 (DEFAULT_TABLE table=test-table [id=9e736568939e498cb51f34d8891399b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:43:07.645296 13385 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ccdfa2aa918b41a9b1ba8cbb2d7bba26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:43:07.645364 13514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:07.639654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.66:37679 (local address 127.0.0.1:54478)
0807 22:43:07.639842 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:07.639887 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 22:43:07.639951 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:43:07.640713 (+ 762us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:43:07.640714 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:43:07.640717 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:43:07.640765 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:07.640766 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:07.641643 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:07.641644 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:07.643082 (+ 1438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:07.643085 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:07.645127 (+ 2042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:07.645128 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:07.645193 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:07.645196 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:43:07.645255 (+ 59us) client_negotiation.cc:240] Negotiation successful
0807 22:43:07.645294 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"mutex_wait_us":36,"thread_start_us":93,"threads_started":1}
I20260807 22:43:07.645381 13518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:07.639767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54478 (local address 127.22.212.66:37679)
0807 22:43:07.640532 (+ 765us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:07.640537 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:07.640549 (+ 12us) server_negotiation.cc:407] Connection header received
0807 22:43:07.640591 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:07.640593 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:07.640609 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:07.640842 (+ 233us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:43:07.640903 (+ 61us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:07.641536 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:07.644007 (+ 2471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:07.645028 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:07.645107 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:07.645162 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:07.645268 (+ 106us) server_negotiation.cc:299] Negotiation successful
0807 22:43:07.645306 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":722,"thread_start_us":112,"threads_started":1}
I20260807 22:43:07.645295 12963 tablet_service.cc:1467] Processing CreateTablet for tablet ccdfa2aa918b41a9b1ba8cbb2d7bba26 (DEFAULT_TABLE table=test-table [id=9e736568939e498cb51f34d8891399b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:43:07.645661 12963 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ccdfa2aa918b41a9b1ba8cbb2d7bba26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:43:07.645982 13169 tablet_service.cc:1467] Processing CreateTablet for tablet ccdfa2aa918b41a9b1ba8cbb2d7bba26 (DEFAULT_TABLE table=test-table [id=9e736568939e498cb51f34d8891399b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:43:07.646229 13169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ccdfa2aa918b41a9b1ba8cbb2d7bba26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:43:07.648967 13524 tablet_bootstrap.cc:492] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 546f9f2eb2c24454a5fa849b1fd61906: Bootstrap starting.
I20260807 22:43:07.649534 13524 tablet_bootstrap.cc:654] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 546f9f2eb2c24454a5fa849b1fd61906: Neither blocks nor log segments found. Creating new log.
I20260807 22:43:07.650059 13524 log.cc:824] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 546f9f2eb2c24454a5fa849b1fd61906: Log is configured to *not* fsync() on all Append() calls
I20260807 22:43:07.650372 13523 tablet_bootstrap.cc:492] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P c426e7add5844349b527e7cc4d8b99d1: Bootstrap starting.
I20260807 22:43:07.650781 13524 tablet_bootstrap.cc:492] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 546f9f2eb2c24454a5fa849b1fd61906: No bootstrap required, opened a new log
I20260807 22:43:07.650840 13524 ts_tablet_manager.cc:1397] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 546f9f2eb2c24454a5fa849b1fd61906: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 22:43:07.650951 13523 tablet_bootstrap.cc:654] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P c426e7add5844349b527e7cc4d8b99d1: Neither blocks nor log segments found. Creating new log.
I20260807 22:43:07.651250 13525 tablet_bootstrap.cc:492] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 8942be1719f2463aa6703529f245d5bf: Bootstrap starting.
I20260807 22:43:07.651790 13525 tablet_bootstrap.cc:654] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 8942be1719f2463aa6703529f245d5bf: Neither blocks nor log segments found. Creating new log.
I20260807 22:43:07.652333 13525 log.cc:824] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 8942be1719f2463aa6703529f245d5bf: Log is configured to *not* fsync() on all Append() calls
I20260807 22:43:07.652611 13524 raft_consensus.cc:348] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 546f9f2eb2c24454a5fa849b1fd61906 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c426e7add5844349b527e7cc4d8b99d1" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 45089 } } peers { permanent_uuid: "8942be1719f2463aa6703529f245d5bf" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 37679 } } peers { permanent_uuid: "546f9f2eb2c24454a5fa849b1fd61906" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39995 } }
I20260807 22:43:07.652771 13524 raft_consensus.cc:374] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 546f9f2eb2c24454a5fa849b1fd61906 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:43:07.652822 13524 raft_consensus.cc:729] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 546f9f2eb2c24454a5fa849b1fd61906 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546f9f2eb2c24454a5fa849b1fd61906, State: Initialized, Role: FOLLOWER
I20260807 22:43:07.652946 13524 consensus_queue.cc:260] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 546f9f2eb2c24454a5fa849b1fd61906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c426e7add5844349b527e7cc4d8b99d1" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 45089 } } peers { permanent_uuid: "8942be1719f2463aa6703529f245d5bf" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 37679 } } peers { permanent_uuid: "546f9f2eb2c24454a5fa849b1fd61906" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39995 } }
I20260807 22:43:07.653185 13523 log.cc:824] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P c426e7add5844349b527e7cc4d8b99d1: Log is configured to *not* fsync() on all Append() calls
I20260807 22:43:07.653255 13524 ts_tablet_manager.cc:1428] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 546f9f2eb2c24454a5fa849b1fd61906: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260807 22:43:07.653294 13496 heartbeater.cc:503] Master 127.22.212.126:35997 was elected leader, sending a full tablet report...
I20260807 22:43:07.653793 13525 tablet_bootstrap.cc:492] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 8942be1719f2463aa6703529f245d5bf: No bootstrap required, opened a new log
I20260807 22:43:07.653869 13525 ts_tablet_manager.cc:1397] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 8942be1719f2463aa6703529f245d5bf: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260807 22:43:07.653924 13523 tablet_bootstrap.cc:492] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P c426e7add5844349b527e7cc4d8b99d1: No bootstrap required, opened a new log
I20260807 22:43:07.654026 13523 ts_tablet_manager.cc:1397] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P c426e7add5844349b527e7cc4d8b99d1: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260807 22:43:07.655875 13525 raft_consensus.cc:348] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 8942be1719f2463aa6703529f245d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c426e7add5844349b527e7cc4d8b99d1" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 45089 } } peers { permanent_uuid: "8942be1719f2463aa6703529f245d5bf" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 37679 } } peers { permanent_uuid: "546f9f2eb2c24454a5fa849b1fd61906" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39995 } }
I20260807 22:43:07.655961 13523 raft_consensus.cc:348] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P c426e7add5844349b527e7cc4d8b99d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c426e7add5844349b527e7cc4d8b99d1" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 45089 } } peers { permanent_uuid: "8942be1719f2463aa6703529f245d5bf" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 37679 } } peers { permanent_uuid: "546f9f2eb2c24454a5fa849b1fd61906" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39995 } }
I20260807 22:43:07.656059 13525 raft_consensus.cc:374] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 8942be1719f2463aa6703529f245d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:43:07.656091 13523 raft_consensus.cc:374] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P c426e7add5844349b527e7cc4d8b99d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:43:07.656098 13525 raft_consensus.cc:729] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 8942be1719f2463aa6703529f245d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8942be1719f2463aa6703529f245d5bf, State: Initialized, Role: FOLLOWER
I20260807 22:43:07.656138 13523 raft_consensus.cc:729] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P c426e7add5844349b527e7cc4d8b99d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c426e7add5844349b527e7cc4d8b99d1, State: Initialized, Role: FOLLOWER
I20260807 22:43:07.656219 13525 consensus_queue.cc:260] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 8942be1719f2463aa6703529f245d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c426e7add5844349b527e7cc4d8b99d1" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 45089 } } peers { permanent_uuid: "8942be1719f2463aa6703529f245d5bf" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 37679 } } peers { permanent_uuid: "546f9f2eb2c24454a5fa849b1fd61906" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39995 } }
I20260807 22:43:07.656239 13523 consensus_queue.cc:260] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P c426e7add5844349b527e7cc4d8b99d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c426e7add5844349b527e7cc4d8b99d1" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 45089 } } peers { permanent_uuid: "8942be1719f2463aa6703529f245d5bf" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 37679 } } peers { permanent_uuid: "546f9f2eb2c24454a5fa849b1fd61906" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39995 } }
I20260807 22:43:07.656545 13525 ts_tablet_manager.cc:1428] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 8942be1719f2463aa6703529f245d5bf: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 22:43:07.656554 13523 ts_tablet_manager.cc:1428] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P c426e7add5844349b527e7cc4d8b99d1: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260807 22:43:07.656595 13065 heartbeater.cc:503] Master 127.22.212.126:35997 was elected leader, sending a full tablet report...
I20260807 22:43:07.656833 13277 heartbeater.cc:503] Master 127.22.212.126:35997 was elected leader, sending a full tablet report...
I20260807 22:43:07.670549 13532 raft_consensus.cc:482] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 8942be1719f2463aa6703529f245d5bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:43:07.670650 13532 raft_consensus.cc:504] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 8942be1719f2463aa6703529f245d5bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c426e7add5844349b527e7cc4d8b99d1" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 45089 } } peers { permanent_uuid: "8942be1719f2463aa6703529f245d5bf" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 37679 } } peers { permanent_uuid: "546f9f2eb2c24454a5fa849b1fd61906" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39995 } }
I20260807 22:43:07.671062 13532 leader_election.cc:288] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 8942be1719f2463aa6703529f245d5bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c426e7add5844349b527e7cc4d8b99d1 (127.22.212.65:45089), 546f9f2eb2c24454a5fa849b1fd61906 (127.22.212.67:39995)
I20260807 22:43:07.674027 13519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:07.671311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:39379 (local address 127.22.212.65:45089)
0807 22:43:07.671358 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:07.671361 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:07.671370 (+ 9us) server_negotiation.cc:407] Connection header received
0807 22:43:07.671441 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:07.671442 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:07.671472 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:07.671531 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:43:07.671726 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:07.672326 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:07.673256 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:07.673671 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:07.673729 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:07.673737 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:07.673915 (+ 178us) server_negotiation.cc:299] Negotiation successful
0807 22:43:07.673957 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260807 22:43:07.674026 13280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:07.671217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:45089 (local address 127.22.212.66:39379)
0807 22:43:07.671284 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:07.671301 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 22:43:07.671358 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:43:07.671549 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:43:07.671550 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:43:07.671551 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:43:07.671634 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:07.671636 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:07.672399 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:07.672400 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:07.673164 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:07.673166 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:07.673751 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:07.673752 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:07.673839 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:07.673842 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:43:07.673898 (+ 56us) client_negotiation.cc:240] Negotiation successful
0807 22:43:07.673933 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260807 22:43:07.674108 13521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:07.671429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:46265 (local address 127.22.212.67:39995)
0807 22:43:07.671491 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:07.671493 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:07.671602 (+ 109us) server_negotiation.cc:407] Connection header received
0807 22:43:07.671635 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:07.671636 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:07.671646 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:07.671704 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:43:07.671866 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:07.672406 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:07.673348 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:07.673727 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:07.673803 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:07.673811 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:07.673994 (+ 183us) server_negotiation.cc:299] Negotiation successful
0807 22:43:07.674033 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260807 22:43:07.674167 13540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:07.671338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.67:39995 (local address 127.22.212.66:46265)
0807 22:43:07.671527 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:07.671539 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:43:07.671600 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:43:07.671721 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:43:07.671722 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:43:07.671724 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:43:07.671792 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:07.671793 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:07.672490 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:07.672491 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:07.673262 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:07.673265 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:07.673811 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:07.673812 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:07.673901 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:07.673906 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 22:43:07.673974 (+ 68us) client_negotiation.cc:240] Negotiation successful
0807 22:43:07.674013 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":112,"threads_started":1}
I20260807 22:43:07.674456 12988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ccdfa2aa918b41a9b1ba8cbb2d7bba26" candidate_uuid: "8942be1719f2463aa6703529f245d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c426e7add5844349b527e7cc4d8b99d1" is_pre_election: true
I20260807 22:43:07.674628 12988 raft_consensus.cc:2454] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P c426e7add5844349b527e7cc4d8b99d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8942be1719f2463aa6703529f245d5bf in term 0.
I20260807 22:43:07.674674 13421 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ccdfa2aa918b41a9b1ba8cbb2d7bba26" candidate_uuid: "8942be1719f2463aa6703529f245d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546f9f2eb2c24454a5fa849b1fd61906" is_pre_election: true
I20260807 22:43:07.674857 13421 raft_consensus.cc:2454] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 546f9f2eb2c24454a5fa849b1fd61906 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8942be1719f2463aa6703529f245d5bf in term 0.
I20260807 22:43:07.674885 13094 leader_election.cc:302] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 8942be1719f2463aa6703529f245d5bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8942be1719f2463aa6703529f245d5bf, c426e7add5844349b527e7cc4d8b99d1; no voters:
I20260807 22:43:07.675061 13532 raft_consensus.cc:2781] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 8942be1719f2463aa6703529f245d5bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:43:07.675137 13532 raft_consensus.cc:482] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 8942be1719f2463aa6703529f245d5bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:43:07.675155 13532 raft_consensus.cc:3037] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 8942be1719f2463aa6703529f245d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:43:07.675828 13532 raft_consensus.cc:504] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 8942be1719f2463aa6703529f245d5bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c426e7add5844349b527e7cc4d8b99d1" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 45089 } } peers { permanent_uuid: "8942be1719f2463aa6703529f245d5bf" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 37679 } } peers { permanent_uuid: "546f9f2eb2c24454a5fa849b1fd61906" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39995 } }
I20260807 22:43:07.675959 13532 leader_election.cc:288] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 8942be1719f2463aa6703529f245d5bf [CANDIDATE]: Term 1 election: Requested vote from peers c426e7add5844349b527e7cc4d8b99d1 (127.22.212.65:45089), 546f9f2eb2c24454a5fa849b1fd61906 (127.22.212.67:39995)
I20260807 22:43:07.676115 12988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ccdfa2aa918b41a9b1ba8cbb2d7bba26" candidate_uuid: "8942be1719f2463aa6703529f245d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c426e7add5844349b527e7cc4d8b99d1"
I20260807 22:43:07.676133 13421 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ccdfa2aa918b41a9b1ba8cbb2d7bba26" candidate_uuid: "8942be1719f2463aa6703529f245d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546f9f2eb2c24454a5fa849b1fd61906"
I20260807 22:43:07.676204 12988 raft_consensus.cc:3037] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P c426e7add5844349b527e7cc4d8b99d1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:43:07.676205 13421 raft_consensus.cc:3037] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 546f9f2eb2c24454a5fa849b1fd61906 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:43:07.676910 13421 raft_consensus.cc:2454] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 546f9f2eb2c24454a5fa849b1fd61906 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8942be1719f2463aa6703529f245d5bf in term 1.
I20260807 22:43:07.677079 12988 raft_consensus.cc:2454] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P c426e7add5844349b527e7cc4d8b99d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8942be1719f2463aa6703529f245d5bf in term 1.
I20260807 22:43:07.677088 13094 leader_election.cc:302] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 8942be1719f2463aa6703529f245d5bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546f9f2eb2c24454a5fa849b1fd61906, 8942be1719f2463aa6703529f245d5bf; no voters:
I20260807 22:43:07.677188 13532 raft_consensus.cc:2781] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 8942be1719f2463aa6703529f245d5bf [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:43:07.677366 13532 raft_consensus.cc:686] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 8942be1719f2463aa6703529f245d5bf [term 1 LEADER]: Becoming Leader. State: Replica: 8942be1719f2463aa6703529f245d5bf, State: Running, Role: LEADER
I20260807 22:43:07.677470 13532 consensus_queue.cc:237] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 8942be1719f2463aa6703529f245d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c426e7add5844349b527e7cc4d8b99d1" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 45089 } } peers { permanent_uuid: "8942be1719f2463aa6703529f245d5bf" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 37679 } } peers { permanent_uuid: "546f9f2eb2c24454a5fa849b1fd61906" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39995 } }
I20260807 22:43:07.678349 12756 catalog_manager.cc:5495] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 8942be1719f2463aa6703529f245d5bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 8942be1719f2463aa6703529f245d5bf (127.22.212.66). New cstate: current_term: 1 leader_uuid: "8942be1719f2463aa6703529f245d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c426e7add5844349b527e7cc4d8b99d1" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8942be1719f2463aa6703529f245d5bf" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 37679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "546f9f2eb2c24454a5fa849b1fd61906" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39995 } health_report { overall_health: UNKNOWN } } }
I20260807 22:43:07.689083 13518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:07.686647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54494 (local address 127.22.212.66:37679)
0807 22:43:07.686694 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:07.686696 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:07.686705 (+ 9us) server_negotiation.cc:407] Connection header received
0807 22:43:07.686776 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:07.686777 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:07.686800 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:07.686873 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:43:07.686993 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:07.687462 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:07.688218 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:07.688465 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:07.688545 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:07.688724 (+ 179us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:43:07.688833 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:43:07.688931 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:07.688955 (+ 24us) server_negotiation.cc:299] Negotiation successful
0807 22:43:07.688977 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 22:43:07.690853 13421 raft_consensus.cc:1261] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 546f9f2eb2c24454a5fa849b1fd61906 [term 1 FOLLOWER]: Refusing update from remote peer 8942be1719f2463aa6703529f245d5bf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:43:07.690979 12988 raft_consensus.cc:1261] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P c426e7add5844349b527e7cc4d8b99d1 [term 1 FOLLOWER]: Refusing update from remote peer 8942be1719f2463aa6703529f245d5bf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:43:07.691280 13532 consensus_queue.cc:1035] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 8942be1719f2463aa6703529f245d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "546f9f2eb2c24454a5fa849b1fd61906" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:43:07.691442 13541 consensus_queue.cc:1035] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 8942be1719f2463aa6703529f245d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "c426e7add5844349b527e7cc4d8b99d1" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 45089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 22:43:07.692354 13278 tablet.cc:2369] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 8942be1719f2463aa6703529f245d5bf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:43:07.693935 13547 mvcc.cc:205] Tried to move back new op lower bound from 7316040039179132928 to 7316040039127601152. Current Snapshot: MvccSnapshot[applied={T|T < 7316040039179132928}]
I20260807 22:43:07.694978 13548 mvcc.cc:205] Tried to move back new op lower bound from 7316040039179132928 to 7316040039127601152. Current Snapshot: MvccSnapshot[applied={T|T < 7316040039179132928}]
I20260807 22:43:07.696833 12756 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44706:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:43:07.696926 12756 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44706:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:43:07.697624 12756 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033: Sending DeleteTablet for 3 replicas of tablet ccdfa2aa918b41a9b1ba8cbb2d7bba26
I20260807 22:43:07.697947 12963 tablet_service.cc:1514] Processing DeleteTablet for tablet ccdfa2aa918b41a9b1ba8cbb2d7bba26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:43:07 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:36608
I20260807 22:43:07.697983 13385 tablet_service.cc:1514] Processing DeleteTablet for tablet ccdfa2aa918b41a9b1ba8cbb2d7bba26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:43:07 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:41994
I20260807 22:43:07.698031 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 12860
I20260807 22:43:07.698531 13169 tablet_service.cc:1514] Processing DeleteTablet for tablet ccdfa2aa918b41a9b1ba8cbb2d7bba26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:43:07 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:54478
I20260807 22:43:07.712425 13566 tablet_replica.cc:330] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 8942be1719f2463aa6703529f245d5bf: stopping tablet replica
I20260807 22:43:07.712424 13565 tablet_replica.cc:330] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 546f9f2eb2c24454a5fa849b1fd61906: stopping tablet replica
I20260807 22:43:07.712590 13565 raft_consensus.cc:2229] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 546f9f2eb2c24454a5fa849b1fd61906 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:43:07.712721 13565 raft_consensus.cc:2258] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 546f9f2eb2c24454a5fa849b1fd61906 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260807 22:43:07.714133 12729 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.212.65:45089 (error 108)
I20260807 22:43:07.714200 13566 raft_consensus.cc:2229] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 8942be1719f2463aa6703529f245d5bf [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:43:07.714344 13566 raft_consensus.cc:2258] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 8942be1719f2463aa6703529f245d5bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:43:07.714445 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 13071
I20260807 22:43:07.716526 13565 ts_tablet_manager.cc:1905] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 546f9f2eb2c24454a5fa849b1fd61906: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:43:07.716805 13514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:07.716656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:45089 (local address 127.0.0.1:36614)
0807 22:43:07.716711 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:07.716762 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.65:45089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260807 22:43:07.716962 12729 catalog_manager.cc:4584] TS c426e7add5844349b527e7cc4d8b99d1 (127.22.212.65:45089): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ccdfa2aa918b41a9b1ba8cbb2d7bba26: Network error: Client connection negotiation failed: client connection to 127.22.212.65:45089: connect: Connection refused (error 111)
I20260807 22:43:07.718920 13565 ts_tablet_manager.cc:1918] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 546f9f2eb2c24454a5fa849b1fd61906: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:43:07.719028 13565 log.cc:1196] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 546f9f2eb2c24454a5fa849b1fd61906: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/wal/wals/ccdfa2aa918b41a9b1ba8cbb2d7bba26
I20260807 22:43:07.719309 13565 ts_tablet_manager.cc:1939] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 546f9f2eb2c24454a5fa849b1fd61906: Deleting consensus metadata
I20260807 22:43:07.719789 12729 catalog_manager.cc:4841] TS 546f9f2eb2c24454a5fa849b1fd61906 (127.22.212.67:39995): tablet ccdfa2aa918b41a9b1ba8cbb2d7bba26 (table test-table [id=9e736568939e498cb51f34d8891399b3]) successfully deleted
I20260807 22:43:07.723485 13514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:07.723350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.66:37679 (local address 127.0.0.1:54500)
0807 22:43:07.723417 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:07.723452 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.66:37679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260807 22:43:07.723475 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 13285
I20260807 22:43:07.731092 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 12706
I20260807 22:43:07.739643 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:35997
--webserver_interface=127.22.212.126
--webserver_port=35265
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:41371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:35997
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:43:07.824496 13570 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:43:07.824731 13570 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:43:07.824771 13570 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:43:07.825894 13570 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:43:07.825974 13570 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:43:07.826001 13570 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:43:07.826033 13570 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:43:07.826066 13570 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:43:07.827612 13570 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:41371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:35997
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:35997
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=35265
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13570
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:43:07.827894 13570 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:43:07.828142 13570 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:43:07.837841 13582 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:43:07.837865 13584 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:43:07.837998 13578 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:43:07.838208 13570 server_base.cc:1034] running on GCE node
I20260807 22:43:07.838495 13570 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:43:07.838826 13570 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:43:07.839991 13570 hybrid_clock.cc:648] HybridClock initialized: now 1786142587839982 us; error 52 us; skew 500 ppm
Aug 07 22:43:07 dist-test-slave-2d19 krb5kdc[12691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142587, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:43:07.842622 13570 init.cc:377] Logged in from keytab as kudu/127.22.212.126@KRBTEST.COM (short username kudu)
I20260807 22:43:07.843080 13570 webserver.cc:460] Webserver started at http://127.22.212.126:35265/ using document root <none> and password file <none>
I20260807 22:43:07.843330 13570 fs_manager.cc:359] Metadata directory not provided
I20260807 22:43:07.843417 13570 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:43:07.844952 13570 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260807 22:43:07.845679 13593 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:43:07.845847 13570 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 22:43:07.845963 13570 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "646949290ae4462abbdada3791cc4033"
format_stamp: "Formatted at 2026-08-07 22:43:06 on dist-test-slave-2d19"
server_key: "a64b0b5f55c0247edebf28e52b222fc0"
server_key_iv: "31969a486621b0b08155adfe91e39986"
server_key_version: "encryptionkey@0"
I20260807 22:43:07.846376 13570 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:43:07.880335 13570 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:43:07.882514 13570 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:43:07.882712 13570 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:43:07.886936 13570 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:35997
I20260807 22:43:07.886986 13672 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:35997 every 8 connection(s)
I20260807 22:43:07.887408 13570 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:43:07.889231 13673 sys_catalog.cc:263] Verifying existing consensus state
I20260807 22:43:07.889977 13673 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033: Bootstrap starting.
I20260807 22:43:07.895424 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 13570
I20260807 22:43:07.895740 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.65:45089
--local_ip_for_outbound_sockets=127.22.212.65
--tserver_master_addrs=127.22.212.126:35997
--webserver_port=37609
--webserver_interface=127.22.212.65
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:41371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:43:07.899339 13673 log.cc:824] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033: Log is configured to *not* fsync() on all Append() calls
I20260807 22:43:07.901686 13673 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 22:43:07.902055 13673 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033: Bootstrap complete.
I20260807 22:43:07.904570 13673 raft_consensus.cc:348] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "646949290ae4462abbdada3791cc4033" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35997 } }
I20260807 22:43:07.904846 13673 raft_consensus.cc:729] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 646949290ae4462abbdada3791cc4033, State: Initialized, Role: FOLLOWER
I20260807 22:43:07.905037 13673 consensus_queue.cc:260] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "646949290ae4462abbdada3791cc4033" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35997 } }
I20260807 22:43:07.905117 13673 raft_consensus.cc:388] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:43:07.905176 13673 raft_consensus.cc:482] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:43:07.905244 13673 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [term 1 FOLLOWER]: Advancing to term 2
I20260807 22:43:07.906276 13673 raft_consensus.cc:504] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "646949290ae4462abbdada3791cc4033" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35997 } }
I20260807 22:43:07.906400 13673 leader_election.cc:302] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 646949290ae4462abbdada3791cc4033; no voters:
I20260807 22:43:07.906601 13673 leader_election.cc:288] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 22:43:07.906644 13680 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 22:43:07.906804 13680 raft_consensus.cc:686] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [term 2 LEADER]: Becoming Leader. State: Replica: 646949290ae4462abbdada3791cc4033, State: Running, Role: LEADER
I20260807 22:43:07.906904 13673 sys_catalog.cc:564] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:43:07.906971 13680 consensus_queue.cc:237] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "646949290ae4462abbdada3791cc4033" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35997 } }
I20260807 22:43:07.907351 13683 sys_catalog.cc:455] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "646949290ae4462abbdada3791cc4033" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "646949290ae4462abbdada3791cc4033" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35997 } } }
I20260807 22:43:07.907445 13683 sys_catalog.cc:458] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [sys.catalog]: This master's current role is: LEADER
I20260807 22:43:07.907692 13684 sys_catalog.cc:455] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 646949290ae4462abbdada3791cc4033. Latest consensus state: current_term: 2 leader_uuid: "646949290ae4462abbdada3791cc4033" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "646949290ae4462abbdada3791cc4033" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35997 } } }
I20260807 22:43:07.907786 13684 sys_catalog.cc:458] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [sys.catalog]: This master's current role is: LEADER
I20260807 22:43:07.907917 13692 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:43:07.908722 13692 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:43:07.908862 13692 catalog_manager.cc:1259] Loaded cluster ID: 54b4c856889540fdba51c16456db2982
I20260807 22:43:07.909176 13692 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:43:07.909485 13692 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260807 22:43:07.914587 13692 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260807 22:43:07.917811 13692 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:43:07.918020 13692 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033: Loaded TSK: 0
I20260807 22:43:07.918237 13692 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 22:43:07.986552 13677 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:43:07.986763 13677 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:43:07.986788 13677 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:43:07.987962 13677 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:43:07.988009 13677 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:43:07.988037 13677 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.65
I20260807 22:43:07.989591 13677 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:41371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.65:45089
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.212.65
--webserver_port=37609
--tserver_master_addrs=127.22.212.126:35997
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13677
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.65
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:43:07.989857 13677 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:43:07.990121 13677 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:43:07.995522 13722 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:43:07.995493 13726 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:43:07.995705 13677 server_base.cc:1034] running on GCE node
W20260807 22:43:07.995812 13730 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:43:07.996021 13677 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:43:07.996346 13677 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:43:07.997646 13677 hybrid_clock.cc:648] HybridClock initialized: now 1786142587997602 us; error 58 us; skew 500 ppm
Aug 07 22:43:07 dist-test-slave-2d19 krb5kdc[12691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142587, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:43:08.000379 13677 init.cc:377] Logged in from keytab as kudu/127.22.212.65@KRBTEST.COM (short username kudu)
I20260807 22:43:08.000913 13677 webserver.cc:460] Webserver started at http://127.22.212.65:37609/ using document root <none> and password file <none>
I20260807 22:43:08.001166 13677 fs_manager.cc:359] Metadata directory not provided
I20260807 22:43:08.001252 13677 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:43:08.002748 13677 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 22:43:08.003545 13740 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:43:08.003715 13677 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:43:08.003805 13677 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-0/wal
uuid: "c426e7add5844349b527e7cc4d8b99d1"
format_stamp: "Formatted at 2026-08-07 22:43:07 on dist-test-slave-2d19"
server_key: "edfcf7d5ca5fc0e0dae323a18adebd0a"
server_key_iv: "c8c228ce1d1c97b343e12777c88afd7f"
server_key_version: "encryptionkey@0"
I20260807 22:43:08.004163 13677 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:43:08.014513 13677 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:43:08.016824 13677 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:43:08.016996 13677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:43:08.017273 13677 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:43:08.017815 13755 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 22:43:08.019404 13677 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 22:43:08.019459 13677 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260807 22:43:08.019495 13677 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 22:43:08.020216 13677 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 22:43:08.020282 13677 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.001s
I20260807 22:43:08.020371 13755 tablet_bootstrap.cc:492] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P c426e7add5844349b527e7cc4d8b99d1: Bootstrap starting.
I20260807 22:43:08.028331 13677 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.65:45089
I20260807 22:43:08.028904 13677 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
I20260807 22:43:08.029505 13936 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.65:45089 every 8 connection(s)
I20260807 22:43:08.031764 13755 log.cc:824] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P c426e7add5844349b527e7cc4d8b99d1: Log is configured to *not* fsync() on all Append() calls
I20260807 22:43:08.032361 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 13677
I20260807 22:43:08.032665 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.66:37679
--local_ip_for_outbound_sockets=127.22.212.66
--tserver_master_addrs=127.22.212.126:35997
--webserver_port=33085
--webserver_interface=127.22.212.66
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:41371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:43:08.035029 13755 tablet_bootstrap.cc:492] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P c426e7add5844349b527e7cc4d8b99d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 22:43:08.035344 13755 tablet_bootstrap.cc:492] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P c426e7add5844349b527e7cc4d8b99d1: Bootstrap complete.
I20260807 22:43:08.036599 13755 ts_tablet_manager.cc:1397] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P c426e7add5844349b527e7cc4d8b99d1: Time spent bootstrapping tablet: real 0.016s user 0.008s sys 0.007s
I20260807 22:43:08.038043 13755 raft_consensus.cc:348] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P c426e7add5844349b527e7cc4d8b99d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c426e7add5844349b527e7cc4d8b99d1" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 45089 } } peers { permanent_uuid: "8942be1719f2463aa6703529f245d5bf" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 37679 } } peers { permanent_uuid: "546f9f2eb2c24454a5fa849b1fd61906" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39995 } }
I20260807 22:43:08.038539 13755 raft_consensus.cc:729] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P c426e7add5844349b527e7cc4d8b99d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c426e7add5844349b527e7cc4d8b99d1, State: Initialized, Role: FOLLOWER
I20260807 22:43:08.038780 13755 consensus_queue.cc:260] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P c426e7add5844349b527e7cc4d8b99d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c426e7add5844349b527e7cc4d8b99d1" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 45089 } } peers { permanent_uuid: "8942be1719f2463aa6703529f245d5bf" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 37679 } } peers { permanent_uuid: "546f9f2eb2c24454a5fa849b1fd61906" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39995 } }
I20260807 22:43:08.039187 13755 ts_tablet_manager.cc:1428] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P c426e7add5844349b527e7cc4d8b99d1: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
Aug 07 22:43:08 dist-test-slave-2d19 krb5kdc[12691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142587, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:43:08.046271 13943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:08.029699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:47979 (local address 127.22.212.126:35997)
0807 22:43:08.032073 (+ 2374us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:08.032083 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:08.034059 (+ 1976us) server_negotiation.cc:407] Connection header received
0807 22:43:08.034387 (+ 328us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:08.034396 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:08.034465 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:08.034631 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:43:08.035590 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:08.036924 (+ 1334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:08.038485 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:08.039188 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:08.039307 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:08.042471 (+ 3164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:43:08.042475 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:43:08.042476 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:43:08.042507 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:43:08.044373 (+ 1866us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:08.044909 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:08.044912 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:08.044912 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:08.045007 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:08.045323 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:08.045324 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:08.045324 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:08.045562 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:43:08.045626 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:08.046014 (+ 388us) server_negotiation.cc:299] Negotiation successful
0807 22:43:08.046124 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2315,"thread_start_us":85,"threads_started":1}
I20260807 22:43:08.046449 13941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:08.029650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.65:47979)
0807 22:43:08.033014 (+ 3364us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:08.033067 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 22:43:08.033883 (+ 816us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:43:08.034691 (+ 808us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:43:08.034695 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:43:08.035125 (+ 430us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:43:08.035430 (+ 305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:08.035438 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:08.037057 (+ 1619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:08.037058 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:08.038366 (+ 1308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:08.038370 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:08.039419 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:08.039421 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:08.039575 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:08.040235 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:43:08.040290 (+ 55us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:43:08.042351 (+ 2061us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:43:08.044458 (+ 2107us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:08.044467 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:08.044470 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:08.044820 (+ 350us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:08.045086 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:08.045087 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:08.045087 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:08.045249 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:08.045640 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:43:08.045649 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:43:08.045830 (+ 181us) client_negotiation.cc:769] Sending connection context
0807 22:43:08.045968 (+ 138us) client_negotiation.cc:240] Negotiation successful
0807 22:43:08.046185 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3307,"thread_start_us":100,"threads_started":1}
I20260807 22:43:08.047135 13937 heartbeater.cc:347] Connected to a master server at 127.22.212.126:35997
I20260807 22:43:08.047262 13937 heartbeater.cc:464] Registering TS with master...
I20260807 22:43:08.047466 13937 heartbeater.cc:511] Master 127.22.212.126:35997 requested a full tablet report, sending...
I20260807 22:43:08.048309 13618 ts_manager.cc:194] Registered new tserver with Master: c426e7add5844349b527e7cc4d8b99d1 (127.22.212.65:45089)
I20260807 22:43:08.049450 13618 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.65@KRBTEST.COM'} at 127.22.212.65:47979
I20260807 22:43:08.050439 13937 heartbeater.cc:503] Master 127.22.212.126:35997 was elected leader, sending a full tablet report...
Aug 07 22:43:08 dist-test-slave-2d19 krb5kdc[12691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142587, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for kudu/127.22.212.65@KRBTEST.COM
I20260807 22:43:08.057844 13950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:08.048904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:45089 (local address 127.0.0.1:36618)
0807 22:43:08.049236 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:08.049278 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 22:43:08.049359 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:43:08.049560 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:43:08.049565 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:43:08.049892 (+ 327us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:43:08.049950 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:08.049951 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:08.051105 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:08.051106 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:08.052032 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:08.052035 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:08.052549 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:08.052550 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:08.052636 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:08.053108 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:43:08.053115 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:43:08.054711 (+ 1596us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:43:08.056561 (+ 1850us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:08.056568 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:08.056570 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:08.056779 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:08.057071 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:08.057072 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:08.057073 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:08.057142 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:08.057438 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:43:08.057445 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:43:08.057507 (+ 62us) client_negotiation.cc:769] Sending connection context
0807 22:43:08.057605 (+ 98us) client_negotiation.cc:240] Negotiation successful
0807 22:43:08.057737 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":107,"threads_started":1}
I20260807 22:43:08.057844 13951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:08.048982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36618 (local address 127.22.212.65:45089)
0807 22:43:08.049163 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:08.049168 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:08.049366 (+ 198us) server_negotiation.cc:407] Connection header received
0807 22:43:08.049439 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:08.049441 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:08.049456 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:08.049547 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:43:08.050031 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:08.051032 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:08.052120 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:08.052469 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:08.052535 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:08.054802 (+ 2267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:43:08.054811 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:43:08.054812 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:43:08.054820 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:43:08.056461 (+ 1641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:08.056869 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:08.056873 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:08.056873 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:08.056936 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:08.057209 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:08.057210 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:08.057210 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:08.057361 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:43:08.057461 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:08.057657 (+ 196us) server_negotiation.cc:299] Negotiation successful
0807 22:43:08.057754 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":99,"threads_started":1}
I20260807 22:43:08.058261 13821 tablet_service.cc:1514] Processing DeleteTablet for tablet ccdfa2aa918b41a9b1ba8cbb2d7bba26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:43:07 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:36618
I20260807 22:43:08.058818 13952 tablet_replica.cc:330] stopping tablet replica
I20260807 22:43:08.058933 13952 raft_consensus.cc:2229] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P c426e7add5844349b527e7cc4d8b99d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:43:08.059002 13952 raft_consensus.cc:2258] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P c426e7add5844349b527e7cc4d8b99d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:43:08.059343 13952 ts_tablet_manager.cc:1905] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P c426e7add5844349b527e7cc4d8b99d1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:43:08.061800 13952 ts_tablet_manager.cc:1918] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P c426e7add5844349b527e7cc4d8b99d1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:43:08.061882 13952 log.cc:1196] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P c426e7add5844349b527e7cc4d8b99d1: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-0/wal/wals/ccdfa2aa918b41a9b1ba8cbb2d7bba26
I20260807 22:43:08.062124 13952 ts_tablet_manager.cc:1939] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P c426e7add5844349b527e7cc4d8b99d1: Deleting consensus metadata
I20260807 22:43:08.062692 13595 catalog_manager.cc:4841] TS c426e7add5844349b527e7cc4d8b99d1 (127.22.212.65:45089): tablet ccdfa2aa918b41a9b1ba8cbb2d7bba26 (table test-table [id=9e736568939e498cb51f34d8891399b3]) successfully deleted
W20260807 22:43:08.125411 13945 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:43:08.125625 13945 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:43:08.125650 13945 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:43:08.126883 13945 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:43:08.126927 13945 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:43:08.126955 13945 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.66
I20260807 22:43:08.128563 13945 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:41371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.66:37679
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.212.66
--webserver_port=33085
--tserver_master_addrs=127.22.212.126:35997
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13945
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.66
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:43:08.128810 13945 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:43:08.129056 13945 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:43:08.134315 13962 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:43:08.134310 13963 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:43:08.134361 13966 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:43:08.134752 13945 server_base.cc:1034] running on GCE node
I20260807 22:43:08.135030 13945 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:43:08.135239 13945 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:43:08.136348 13945 hybrid_clock.cc:648] HybridClock initialized: now 1786142588136330 us; error 29 us; skew 500 ppm
Aug 07 22:43:08 dist-test-slave-2d19 krb5kdc[12691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142588, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:43:08.139006 13945 init.cc:377] Logged in from keytab as kudu/127.22.212.66@KRBTEST.COM (short username kudu)
I20260807 22:43:08.139467 13945 webserver.cc:460] Webserver started at http://127.22.212.66:33085/ using document root <none> and password file <none>
I20260807 22:43:08.139706 13945 fs_manager.cc:359] Metadata directory not provided
I20260807 22:43:08.139796 13945 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:43:08.141250 13945 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:43:08.141930 13976 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:43:08.142113 13945 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 22:43:08.142225 13945 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/wal
uuid: "8942be1719f2463aa6703529f245d5bf"
format_stamp: "Formatted at 2026-08-07 22:43:07 on dist-test-slave-2d19"
server_key: "3be2d23c5e9d84b20256af052d48d3d6"
server_key_iv: "22396da00ceb8ac6c340afa77b9dfad3"
server_key_version: "encryptionkey@0"
I20260807 22:43:08.142658 13945 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:43:08.161545 13945 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:43:08.163422 13945 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:43:08.163534 13945 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:43:08.163743 13945 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:43:08.164141 13989 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 22:43:08.165634 13945 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 22:43:08.165706 13945 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260807 22:43:08.165751 13945 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 22:43:08.166433 13945 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 22:43:08.166494 13945 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260807 22:43:08.166553 13989 tablet_bootstrap.cc:492] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 8942be1719f2463aa6703529f245d5bf: Bootstrap starting.
I20260807 22:43:08.173069 13945 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.66:37679
I20260807 22:43:08.173171 14170 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.66:37679 every 8 connection(s)
I20260807 22:43:08.173491 13945 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
I20260807 22:43:08.177083 13989 log.cc:824] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 8942be1719f2463aa6703529f245d5bf: Log is configured to *not* fsync() on all Append() calls
I20260807 22:43:08.179838 13989 tablet_bootstrap.cc:492] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 8942be1719f2463aa6703529f245d5bf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 22:43:08.180181 13989 tablet_bootstrap.cc:492] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 8942be1719f2463aa6703529f245d5bf: Bootstrap complete.
Aug 07 22:43:08 dist-test-slave-2d19 krb5kdc[12691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142588, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:43:08.181093 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 13945
I20260807 22:43:08.181195 13989 ts_tablet_manager.cc:1397] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 8942be1719f2463aa6703529f245d5bf: Time spent bootstrapping tablet: real 0.015s user 0.007s sys 0.006s
I20260807 22:43:08.181407 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.67:39995
--local_ip_for_outbound_sockets=127.22.212.67
--tserver_master_addrs=127.22.212.126:35997
--webserver_port=33015
--webserver_interface=127.22.212.67
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:41371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:43:08.182511 13989 raft_consensus.cc:348] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 8942be1719f2463aa6703529f245d5bf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c426e7add5844349b527e7cc4d8b99d1" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 45089 } } peers { permanent_uuid: "8942be1719f2463aa6703529f245d5bf" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 37679 } } peers { permanent_uuid: "546f9f2eb2c24454a5fa849b1fd61906" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39995 } }
I20260807 22:43:08.182935 13989 raft_consensus.cc:729] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 8942be1719f2463aa6703529f245d5bf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8942be1719f2463aa6703529f245d5bf, State: Initialized, Role: FOLLOWER
I20260807 22:43:08.183094 13989 consensus_queue.cc:260] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 8942be1719f2463aa6703529f245d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c426e7add5844349b527e7cc4d8b99d1" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 45089 } } peers { permanent_uuid: "8942be1719f2463aa6703529f245d5bf" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 37679 } } peers { permanent_uuid: "546f9f2eb2c24454a5fa849b1fd61906" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39995 } }
I20260807 22:43:08.183418 13989 ts_tablet_manager.cc:1428] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 8942be1719f2463aa6703529f245d5bf: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260807 22:43:08.184942 13943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:08.174289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:40661 (local address 127.22.212.126:35997)
0807 22:43:08.174375 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:08.174378 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:08.174650 (+ 272us) server_negotiation.cc:407] Connection header received
0807 22:43:08.175428 (+ 778us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:08.175429 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:08.175440 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:08.175508 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:43:08.176561 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:08.177075 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:08.178487 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:08.178694 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:08.178760 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:08.181558 (+ 2798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:43:08.181560 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:43:08.181561 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:43:08.181570 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:43:08.183453 (+ 1883us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:08.183885 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:08.183886 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:08.183887 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:08.183953 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:08.184217 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:08.184218 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:08.184218 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:08.184386 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:43:08.184468 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:08.184752 (+ 284us) server_negotiation.cc:299] Negotiation successful
0807 22:43:08.184848 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 22:43:08.185119 14174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:08.174228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.66:40661)
0807 22:43:08.174462 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:08.174524 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0807 22:43:08.175302 (+ 778us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:43:08.175601 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:43:08.175605 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:43:08.176032 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:43:08.176439 (+ 407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:08.176450 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:08.177203 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:08.177205 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:08.178377 (+ 1172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:08.178380 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:08.178804 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:08.178805 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:08.178962 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:08.179582 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:43:08.179593 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:43:08.181430 (+ 1837us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:43:08.183547 (+ 2117us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:08.183554 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:08.183556 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:08.183801 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:08.184026 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:08.184027 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:08.184027 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:08.184144 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:08.184474 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:43:08.184481 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:43:08.184620 (+ 139us) client_negotiation.cc:769] Sending connection context
0807 22:43:08.184730 (+ 110us) client_negotiation.cc:240] Negotiation successful
0807 22:43:08.184911 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":121,"threads_started":1}
I20260807 22:43:08.185585 14171 heartbeater.cc:347] Connected to a master server at 127.22.212.126:35997
I20260807 22:43:08.185695 14171 heartbeater.cc:464] Registering TS with master...
I20260807 22:43:08.185884 14171 heartbeater.cc:511] Master 127.22.212.126:35997 requested a full tablet report, sending...
I20260807 22:43:08.186501 13618 ts_manager.cc:194] Registered new tserver with Master: 8942be1719f2463aa6703529f245d5bf (127.22.212.66:37679)
I20260807 22:43:08.187124 13618 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.66@KRBTEST.COM'} at 127.22.212.66:40661
I20260807 22:43:08.188124 14171 heartbeater.cc:503] Master 127.22.212.126:35997 was elected leader, sending a full tablet report...
Aug 07 22:43:08 dist-test-slave-2d19 krb5kdc[12691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142587, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for kudu/127.22.212.66@KRBTEST.COM
I20260807 22:43:08.196303 13950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:08.186826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.66:37679 (local address 127.0.0.1:54508)
0807 22:43:08.187250 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:08.187261 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 22:43:08.187316 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:43:08.187491 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:43:08.187492 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:43:08.187645 (+ 153us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:43:08.187682 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:08.187684 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:08.189642 (+ 1958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:08.189642 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:08.190132 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:08.190133 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:08.190808 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:08.190809 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:08.190870 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:08.191381 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:43:08.191387 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:43:08.193062 (+ 1675us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:43:08.195201 (+ 2139us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:08.195202 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:08.195203 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:08.195366 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:08.195587 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:08.195588 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:08.195588 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:08.195643 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:08.195974 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:43:08.195975 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:43:08.196016 (+ 41us) client_negotiation.cc:769] Sending connection context
0807 22:43:08.196094 (+ 78us) client_negotiation.cc:240] Negotiation successful
0807 22:43:08.196181 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":409}
I20260807 22:43:08.196370 14180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:08.186978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54508 (local address 127.22.212.66:37679)
0807 22:43:08.187156 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:08.187162 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:08.187311 (+ 149us) server_negotiation.cc:407] Connection header received
0807 22:43:08.187373 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:08.187376 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:08.187397 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:08.187490 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:43:08.188359 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:08.189556 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:08.190214 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:08.190715 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:08.190793 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:08.193162 (+ 2369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:43:08.193172 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:43:08.193173 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:43:08.193179 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:43:08.195106 (+ 1927us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:08.195453 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:08.195456 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:08.195457 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:08.195520 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:08.195707 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:08.195708 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:08.195708 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:08.195877 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:43:08.195959 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:08.196148 (+ 189us) server_negotiation.cc:299] Negotiation successful
0807 22:43:08.196250 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":95,"threads_started":1}
I20260807 22:43:08.196746 14052 tablet_service.cc:1514] Processing DeleteTablet for tablet ccdfa2aa918b41a9b1ba8cbb2d7bba26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:43:07 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:54508
I20260807 22:43:08.197494 14181 tablet_replica.cc:330] stopping tablet replica
I20260807 22:43:08.197625 14181 raft_consensus.cc:2229] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 8942be1719f2463aa6703529f245d5bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:43:08.197724 14181 raft_consensus.cc:2258] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 8942be1719f2463aa6703529f245d5bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:43:08.198040 14181 ts_tablet_manager.cc:1905] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 8942be1719f2463aa6703529f245d5bf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:43:08.200556 14181 ts_tablet_manager.cc:1918] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 8942be1719f2463aa6703529f245d5bf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:43:08.200665 14181 log.cc:1196] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 8942be1719f2463aa6703529f245d5bf: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/wal/wals/ccdfa2aa918b41a9b1ba8cbb2d7bba26
I20260807 22:43:08.200898 14181 ts_tablet_manager.cc:1939] T ccdfa2aa918b41a9b1ba8cbb2d7bba26 P 8942be1719f2463aa6703529f245d5bf: Deleting consensus metadata
I20260807 22:43:08.201442 13598 catalog_manager.cc:4841] TS 8942be1719f2463aa6703529f245d5bf (127.22.212.66:37679): tablet ccdfa2aa918b41a9b1ba8cbb2d7bba26 (table test-table [id=9e736568939e498cb51f34d8891399b3]) successfully deleted
W20260807 22:43:08.270244 14177 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:43:08.270462 14177 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:43:08.270485 14177 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:43:08.271637 14177 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:43:08.271682 14177 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:43:08.271708 14177 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.67
I20260807 22:43:08.273196 14177 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:41371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.67:39995
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.212.67
--webserver_port=33015
--tserver_master_addrs=127.22.212.126:35997
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14177
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.67
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:43:08.273442 14177 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:43:08.273676 14177 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:43:08.278878 14191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:43:08.278875 14192 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:43:08.278998 14196 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:43:08.279260 14177 server_base.cc:1034] running on GCE node
I20260807 22:43:08.279482 14177 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:43:08.279742 14177 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:43:08.280897 14177 hybrid_clock.cc:648] HybridClock initialized: now 1786142588280883 us; error 31 us; skew 500 ppm
Aug 07 22:43:08 dist-test-slave-2d19 krb5kdc[12691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142588, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:43:08.283510 14177 init.cc:377] Logged in from keytab as kudu/127.22.212.67@KRBTEST.COM (short username kudu)
I20260807 22:43:08.283973 14177 webserver.cc:460] Webserver started at http://127.22.212.67:33015/ using document root <none> and password file <none>
I20260807 22:43:08.284170 14177 fs_manager.cc:359] Metadata directory not provided
I20260807 22:43:08.284221 14177 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:43:08.285609 14177 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 22:43:08.286154 14204 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:43:08.286348 14177 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 22:43:08.286427 14177 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/wal
uuid: "546f9f2eb2c24454a5fa849b1fd61906"
format_stamp: "Formatted at 2026-08-07 22:43:07 on dist-test-slave-2d19"
server_key: "19a2b5bf03536fae7426acb864fbad69"
server_key_iv: "4120e7fa6613bb3bdc91adb4781fd266"
server_key_version: "encryptionkey@0"
I20260807 22:43:08.286741 14177 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:43:08.295404 14177 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:43:08.297363 14177 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:43:08.297484 14177 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:43:08.297657 14177 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:43:08.297971 14177 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:43:08.298014 14177 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:43:08.298035 14177 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:43:08.298048 14177 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:43:08.303954 14177 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.67:39995
I20260807 22:43:08.304001 14381 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.67:39995 every 8 connection(s)
I20260807 22:43:08.304406 14177 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
I20260807 22:43:08.308439 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 14177
Aug 07 22:43:08 dist-test-slave-2d19 krb5kdc[12691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142588, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:43:08.315140 13943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:08.305231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:58579 (local address 127.22.212.126:35997)
0807 22:43:08.305330 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:08.305333 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:08.305607 (+ 274us) server_negotiation.cc:407] Connection header received
0807 22:43:08.306159 (+ 552us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:08.306160 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:08.306171 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:08.306243 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:43:08.307348 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:08.307852 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:08.309083 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:08.309353 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:08.309405 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:08.311926 (+ 2521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:43:08.311927 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:43:08.311928 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:43:08.311934 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:43:08.313525 (+ 1591us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:08.314026 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:08.314027 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:08.314028 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:08.314112 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:08.314406 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:08.314407 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:08.314407 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:08.314512 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:43:08.314607 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:08.314925 (+ 318us) server_negotiation.cc:299] Negotiation successful
0807 22:43:08.315008 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 22:43:08.315229 14389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:08.305233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.67:58579)
0807 22:43:08.305466 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:08.305515 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 22:43:08.306069 (+ 554us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:43:08.306337 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:43:08.306342 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:43:08.307003 (+ 661us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:43:08.307196 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:08.307266 (+ 70us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:08.308008 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:08.308009 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:08.308989 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:08.308993 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:08.309438 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:08.309439 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:08.309601 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:08.310231 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:43:08.310240 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:43:08.311832 (+ 1592us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:43:08.313605 (+ 1773us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:08.313612 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:08.313615 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:08.313929 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:08.314186 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:08.314187 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:08.314187 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:08.314330 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:08.314583 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:43:08.314590 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:43:08.314761 (+ 171us) client_negotiation.cc:769] Sending connection context
0807 22:43:08.314884 (+ 123us) client_negotiation.cc:240] Negotiation successful
0807 22:43:08.315033 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":91,"threads_started":1}
I20260807 22:43:08.315789 14384 heartbeater.cc:347] Connected to a master server at 127.22.212.126:35997
I20260807 22:43:08.315909 14384 heartbeater.cc:464] Registering TS with master...
I20260807 22:43:08.316119 14384 heartbeater.cc:511] Master 127.22.212.126:35997 requested a full tablet report, sending...
I20260807 22:43:08.316293 14394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:08.308846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44708 (local address 127.22.212.126:35997)
0807 22:43:08.308965 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:08.308967 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:08.309063 (+ 96us) server_negotiation.cc:407] Connection header received
0807 22:43:08.309128 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:08.309129 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:08.309140 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:08.309207 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:43:08.309948 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:08.310530 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:08.311429 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:08.311731 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:08.311818 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:08.313018 (+ 1200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:43:08.313019 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:43:08.313020 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:43:08.313027 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:43:08.314813 (+ 1786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:08.315414 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:08.315415 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:08.315416 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:08.315497 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:08.315746 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:08.315747 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:08.315747 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:08.315841 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:43:08.316020 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:08.316083 (+ 63us) server_negotiation.cc:299] Negotiation successful
0807 22:43:08.316146 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":51,"threads_started":1}
I20260807 22:43:08.316545 13617 ts_manager.cc:194] Registered new tserver with Master: 546f9f2eb2c24454a5fa849b1fd61906 (127.22.212.67:39995)
I20260807 22:43:08.316917 13617 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.67@KRBTEST.COM'} at 127.22.212.67:58579
I20260807 22:43:08.317566 23377 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:43:08.320012 14394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:08.317931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44716 (local address 127.22.212.126:35997)
0807 22:43:08.317974 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:08.317976 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:08.318100 (+ 124us) server_negotiation.cc:407] Connection header received
0807 22:43:08.318151 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:08.318152 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:08.318176 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:08.318235 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:43:08.318302 (+ 67us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:08.318725 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:08.319396 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:08.319577 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:08.319627 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:08.319747 (+ 120us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:43:08.319829 (+ 82us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:43:08.319882 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:08.319914 (+ 32us) server_negotiation.cc:299] Negotiation successful
0807 22:43:08.319931 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260807 22:43:08.320339 13617 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:44716:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:43:08.321933 13617 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:43:08.323979 14052 tablet_service.cc:1467] Processing CreateTablet for tablet e8d8382c0f7d4ba582b56044add1130e (DEFAULT_TABLE table=test-table [id=2cce036d2de646609ec98331db29ab28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:43:08.324020 13821 tablet_service.cc:1467] Processing CreateTablet for tablet e8d8382c0f7d4ba582b56044add1130e (DEFAULT_TABLE table=test-table [id=2cce036d2de646609ec98331db29ab28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:43:08.324182 13821 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8d8382c0f7d4ba582b56044add1130e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:43:08.324182 14052 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8d8382c0f7d4ba582b56044add1130e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:43:08.325798 13989 tablet_bootstrap.cc:492] T e8d8382c0f7d4ba582b56044add1130e P 8942be1719f2463aa6703529f245d5bf: Bootstrap starting.
I20260807 22:43:08.326205 13989 tablet_bootstrap.cc:654] T e8d8382c0f7d4ba582b56044add1130e P 8942be1719f2463aa6703529f245d5bf: Neither blocks nor log segments found. Creating new log.
I20260807 22:43:08.326435 13755 tablet_bootstrap.cc:492] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1: Bootstrap starting.
I20260807 22:43:08.326736 13989 tablet_bootstrap.cc:492] T e8d8382c0f7d4ba582b56044add1130e P 8942be1719f2463aa6703529f245d5bf: No bootstrap required, opened a new log
I20260807 22:43:08.326776 13755 tablet_bootstrap.cc:654] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1: Neither blocks nor log segments found. Creating new log.
I20260807 22:43:08.326782 13989 ts_tablet_manager.cc:1397] T e8d8382c0f7d4ba582b56044add1130e P 8942be1719f2463aa6703529f245d5bf: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260807 22:43:08.327199 13989 raft_consensus.cc:348] T e8d8382c0f7d4ba582b56044add1130e P 8942be1719f2463aa6703529f245d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546f9f2eb2c24454a5fa849b1fd61906" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39995 } } peers { permanent_uuid: "c426e7add5844349b527e7cc4d8b99d1" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 45089 } } peers { permanent_uuid: "8942be1719f2463aa6703529f245d5bf" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 37679 } }
I20260807 22:43:08.327291 13989 raft_consensus.cc:374] T e8d8382c0f7d4ba582b56044add1130e P 8942be1719f2463aa6703529f245d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:43:08.327342 13989 raft_consensus.cc:729] T e8d8382c0f7d4ba582b56044add1130e P 8942be1719f2463aa6703529f245d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8942be1719f2463aa6703529f245d5bf, State: Initialized, Role: FOLLOWER
I20260807 22:43:08.327407 13755 tablet_bootstrap.cc:492] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1: No bootstrap required, opened a new log
I20260807 22:43:08.327397 13989 consensus_queue.cc:260] T e8d8382c0f7d4ba582b56044add1130e P 8942be1719f2463aa6703529f245d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546f9f2eb2c24454a5fa849b1fd61906" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39995 } } peers { permanent_uuid: "c426e7add5844349b527e7cc4d8b99d1" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 45089 } } peers { permanent_uuid: "8942be1719f2463aa6703529f245d5bf" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 37679 } }
I20260807 22:43:08.327447 13755 ts_tablet_manager.cc:1397] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260807 22:43:08.327498 13989 ts_tablet_manager.cc:1428] T e8d8382c0f7d4ba582b56044add1130e P 8942be1719f2463aa6703529f245d5bf: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 22:43:08.327803 13755 raft_consensus.cc:348] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546f9f2eb2c24454a5fa849b1fd61906" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39995 } } peers { permanent_uuid: "c426e7add5844349b527e7cc4d8b99d1" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 45089 } } peers { permanent_uuid: "8942be1719f2463aa6703529f245d5bf" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 37679 } }
I20260807 22:43:08.327876 13755 raft_consensus.cc:374] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:43:08.327919 13755 raft_consensus.cc:729] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c426e7add5844349b527e7cc4d8b99d1, State: Initialized, Role: FOLLOWER
I20260807 22:43:08.327976 13755 consensus_queue.cc:260] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546f9f2eb2c24454a5fa849b1fd61906" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39995 } } peers { permanent_uuid: "c426e7add5844349b527e7cc4d8b99d1" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 45089 } } peers { permanent_uuid: "8942be1719f2463aa6703529f245d5bf" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 37679 } }
I20260807 22:43:08.328092 13755 ts_tablet_manager.cc:1428] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 22:43:08.329317 13950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:08.323710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.67:39995 (local address 127.0.0.1:42002)
0807 22:43:08.323800 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:08.323810 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 22:43:08.323843 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:43:08.326017 (+ 2174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:43:08.326018 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:43:08.326020 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:43:08.326059 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:08.326060 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:08.326906 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:08.326907 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:08.328078 (+ 1171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:08.328081 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:08.329067 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:08.329068 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:08.329130 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:08.329150 (+ 20us) client_negotiation.cc:769] Sending connection context
0807 22:43:08.329209 (+ 59us) client_negotiation.cc:240] Negotiation successful
0807 22:43:08.329248 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":75}
I20260807 22:43:08.329339 14396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:08.323778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42002 (local address 127.22.212.67:39995)
0807 22:43:08.325839 (+ 2061us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:08.325845 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:08.325855 (+ 10us) server_negotiation.cc:407] Connection header received
0807 22:43:08.325891 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:08.325893 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:08.325910 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:08.325995 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:43:08.326115 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:08.326789 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:08.328212 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:08.328971 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:08.329065 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:08.329124 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:08.329223 (+ 99us) server_negotiation.cc:299] Negotiation successful
0807 22:43:08.329261 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2026,"thread_start_us":106,"threads_started":1}
I20260807 22:43:08.330081 14292 tablet_service.cc:1467] Processing CreateTablet for tablet e8d8382c0f7d4ba582b56044add1130e (DEFAULT_TABLE table=test-table [id=2cce036d2de646609ec98331db29ab28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:43:08.330451 14292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8d8382c0f7d4ba582b56044add1130e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:43:08.333240 14401 tablet_bootstrap.cc:492] T e8d8382c0f7d4ba582b56044add1130e P 546f9f2eb2c24454a5fa849b1fd61906: Bootstrap starting.
I20260807 22:43:08.333811 14401 tablet_bootstrap.cc:654] T e8d8382c0f7d4ba582b56044add1130e P 546f9f2eb2c24454a5fa849b1fd61906: Neither blocks nor log segments found. Creating new log.
I20260807 22:43:08.334259 14401 log.cc:824] T e8d8382c0f7d4ba582b56044add1130e P 546f9f2eb2c24454a5fa849b1fd61906: Log is configured to *not* fsync() on all Append() calls
I20260807 22:43:08.334898 14401 tablet_bootstrap.cc:492] T e8d8382c0f7d4ba582b56044add1130e P 546f9f2eb2c24454a5fa849b1fd61906: No bootstrap required, opened a new log
I20260807 22:43:08.334952 14401 ts_tablet_manager.cc:1397] T e8d8382c0f7d4ba582b56044add1130e P 546f9f2eb2c24454a5fa849b1fd61906: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 22:43:08.336244 14401 raft_consensus.cc:348] T e8d8382c0f7d4ba582b56044add1130e P 546f9f2eb2c24454a5fa849b1fd61906 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546f9f2eb2c24454a5fa849b1fd61906" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39995 } } peers { permanent_uuid: "c426e7add5844349b527e7cc4d8b99d1" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 45089 } } peers { permanent_uuid: "8942be1719f2463aa6703529f245d5bf" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 37679 } }
I20260807 22:43:08.336508 14401 raft_consensus.cc:374] T e8d8382c0f7d4ba582b56044add1130e P 546f9f2eb2c24454a5fa849b1fd61906 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:43:08.336560 14401 raft_consensus.cc:729] T e8d8382c0f7d4ba582b56044add1130e P 546f9f2eb2c24454a5fa849b1fd61906 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546f9f2eb2c24454a5fa849b1fd61906, State: Initialized, Role: FOLLOWER
I20260807 22:43:08.336683 14401 consensus_queue.cc:260] T e8d8382c0f7d4ba582b56044add1130e P 546f9f2eb2c24454a5fa849b1fd61906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546f9f2eb2c24454a5fa849b1fd61906" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39995 } } peers { permanent_uuid: "c426e7add5844349b527e7cc4d8b99d1" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 45089 } } peers { permanent_uuid: "8942be1719f2463aa6703529f245d5bf" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 37679 } }
I20260807 22:43:08.336979 14401 ts_tablet_manager.cc:1428] T e8d8382c0f7d4ba582b56044add1130e P 546f9f2eb2c24454a5fa849b1fd61906: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 22:43:08.336984 14384 heartbeater.cc:503] Master 127.22.212.126:35997 was elected leader, sending a full tablet report...
W20260807 22:43:08.424124 14172 tablet.cc:2369] T e8d8382c0f7d4ba582b56044add1130e P 8942be1719f2463aa6703529f245d5bf: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 22:43:08.529794 13938 tablet.cc:2369] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 22:43:08.555094 14385 tablet.cc:2369] T e8d8382c0f7d4ba582b56044add1130e P 546f9f2eb2c24454a5fa849b1fd61906: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:43:08.628126 13949 raft_consensus.cc:482] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:43:08.628316 13949 raft_consensus.cc:504] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546f9f2eb2c24454a5fa849b1fd61906" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39995 } } peers { permanent_uuid: "c426e7add5844349b527e7cc4d8b99d1" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 45089 } } peers { permanent_uuid: "8942be1719f2463aa6703529f245d5bf" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 37679 } }
I20260807 22:43:08.628898 13949 leader_election.cc:288] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 546f9f2eb2c24454a5fa849b1fd61906 (127.22.212.67:39995), 8942be1719f2463aa6703529f245d5bf (127.22.212.66:37679)
I20260807 22:43:08.632103 14407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:08.629099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.67:39995 (local address 127.22.212.65:45103)
0807 22:43:08.629269 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:08.629281 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:43:08.629357 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:43:08.629555 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:43:08.629556 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:43:08.629558 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:43:08.629621 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:08.629623 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:08.630331 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:08.630332 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:08.631223 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:08.631226 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:08.631804 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:08.631805 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:08.631883 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:08.631907 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 22:43:08.631966 (+ 59us) client_negotiation.cc:240] Negotiation successful
0807 22:43:08.632012 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"mutex_wait_us":26,"thread_start_us":78,"threads_started":1}
I20260807 22:43:08.632225 14396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:08.629250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:45103 (local address 127.22.212.67:39995)
0807 22:43:08.629337 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:08.629340 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:08.629353 (+ 13us) server_negotiation.cc:407] Connection header received
0807 22:43:08.629464 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:08.629465 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:08.629475 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:08.629533 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:43:08.629701 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:08.630239 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:08.631323 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:08.631714 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:08.631772 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:08.631778 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:08.632098 (+ 320us) server_negotiation.cc:299] Negotiation successful
0807 22:43:08.632153 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 22:43:08.632324 14180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:08.629192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:33081 (local address 127.22.212.66:37679)
0807 22:43:08.629242 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:08.629244 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:08.629427 (+ 183us) server_negotiation.cc:407] Connection header received
0807 22:43:08.629488 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:08.629488 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:08.629537 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:08.629605 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:43:08.629798 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:08.630384 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:08.631321 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:08.631776 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:08.631858 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:08.631960 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:08.632172 (+ 212us) server_negotiation.cc:299] Negotiation successful
0807 22:43:08.632222 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260807 22:43:08.632510 14406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:08.629112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.66:37679 (local address 127.22.212.65:33081)
0807 22:43:08.629329 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:08.629342 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:43:08.629422 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:43:08.629630 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:43:08.629631 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:43:08.629633 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:43:08.629710 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:08.629711 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:08.630472 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:08.630473 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:08.631224 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:08.631226 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:08.631894 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:08.631894 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:08.632078 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:08.632084 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 22:43:08.632150 (+ 66us) client_negotiation.cc:240] Negotiation successful
0807 22:43:08.632433 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"mutex_wait_us":4,"thread_start_us":72,"threads_started":1}
I20260807 22:43:08.632562 14322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8d8382c0f7d4ba582b56044add1130e" candidate_uuid: "c426e7add5844349b527e7cc4d8b99d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546f9f2eb2c24454a5fa849b1fd61906" is_pre_election: true
I20260807 22:43:08.632738 14322 raft_consensus.cc:2454] T e8d8382c0f7d4ba582b56044add1130e P 546f9f2eb2c24454a5fa849b1fd61906 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c426e7add5844349b527e7cc4d8b99d1 in term 0.
I20260807 22:43:08.632844 14102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8d8382c0f7d4ba582b56044add1130e" candidate_uuid: "c426e7add5844349b527e7cc4d8b99d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8942be1719f2463aa6703529f245d5bf" is_pre_election: true
I20260807 22:43:08.632969 13742 leader_election.cc:302] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546f9f2eb2c24454a5fa849b1fd61906, c426e7add5844349b527e7cc4d8b99d1; no voters:
I20260807 22:43:08.633020 14102 raft_consensus.cc:2454] T e8d8382c0f7d4ba582b56044add1130e P 8942be1719f2463aa6703529f245d5bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c426e7add5844349b527e7cc4d8b99d1 in term 0.
I20260807 22:43:08.633145 13949 raft_consensus.cc:2781] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:43:08.633216 13949 raft_consensus.cc:482] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:43:08.633250 13949 raft_consensus.cc:3037] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:43:08.633977 13949 raft_consensus.cc:504] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546f9f2eb2c24454a5fa849b1fd61906" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39995 } } peers { permanent_uuid: "c426e7add5844349b527e7cc4d8b99d1" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 45089 } } peers { permanent_uuid: "8942be1719f2463aa6703529f245d5bf" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 37679 } }
I20260807 22:43:08.634132 13949 leader_election.cc:288] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [CANDIDATE]: Term 1 election: Requested vote from peers 546f9f2eb2c24454a5fa849b1fd61906 (127.22.212.67:39995), 8942be1719f2463aa6703529f245d5bf (127.22.212.66:37679)
I20260807 22:43:08.634268 14322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8d8382c0f7d4ba582b56044add1130e" candidate_uuid: "c426e7add5844349b527e7cc4d8b99d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546f9f2eb2c24454a5fa849b1fd61906"
I20260807 22:43:08.634266 14102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8d8382c0f7d4ba582b56044add1130e" candidate_uuid: "c426e7add5844349b527e7cc4d8b99d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8942be1719f2463aa6703529f245d5bf"
I20260807 22:43:08.634346 14322 raft_consensus.cc:3037] T e8d8382c0f7d4ba582b56044add1130e P 546f9f2eb2c24454a5fa849b1fd61906 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:43:08.634367 14102 raft_consensus.cc:3037] T e8d8382c0f7d4ba582b56044add1130e P 8942be1719f2463aa6703529f245d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:43:08.635033 14102 raft_consensus.cc:2454] T e8d8382c0f7d4ba582b56044add1130e P 8942be1719f2463aa6703529f245d5bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c426e7add5844349b527e7cc4d8b99d1 in term 1.
I20260807 22:43:08.635205 13745 leader_election.cc:302] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8942be1719f2463aa6703529f245d5bf, c426e7add5844349b527e7cc4d8b99d1; no voters:
I20260807 22:43:08.635214 14322 raft_consensus.cc:2454] T e8d8382c0f7d4ba582b56044add1130e P 546f9f2eb2c24454a5fa849b1fd61906 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c426e7add5844349b527e7cc4d8b99d1 in term 1.
I20260807 22:43:08.635310 13949 raft_consensus.cc:2781] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:43:08.635445 13949 raft_consensus.cc:686] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [term 1 LEADER]: Becoming Leader. State: Replica: c426e7add5844349b527e7cc4d8b99d1, State: Running, Role: LEADER
I20260807 22:43:08.635520 13949 consensus_queue.cc:237] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546f9f2eb2c24454a5fa849b1fd61906" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39995 } } peers { permanent_uuid: "c426e7add5844349b527e7cc4d8b99d1" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 45089 } } peers { permanent_uuid: "8942be1719f2463aa6703529f245d5bf" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 37679 } }
I20260807 22:43:08.636348 13617 catalog_manager.cc:5495] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to c426e7add5844349b527e7cc4d8b99d1 (127.22.212.65). New cstate: current_term: 1 leader_uuid: "c426e7add5844349b527e7cc4d8b99d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546f9f2eb2c24454a5fa849b1fd61906" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c426e7add5844349b527e7cc4d8b99d1" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 45089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8942be1719f2463aa6703529f245d5bf" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 37679 } health_report { overall_health: UNKNOWN } } }
I20260807 22:43:08.682246 14412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:08.679680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36630 (local address 127.22.212.65:45089)
0807 22:43:08.679864 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:08.679866 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:08.679873 (+ 7us) server_negotiation.cc:407] Connection header received
0807 22:43:08.679914 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:08.679915 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:08.679936 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:08.680031 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:43:08.680146 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:08.680680 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:08.681429 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:08.681639 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:08.681716 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:08.681879 (+ 163us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:43:08.681983 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:43:08.682085 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:08.682128 (+ 43us) server_negotiation.cc:299] Negotiation successful
0807 22:43:08.682149 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":102,"threads_started":1}
I20260807 22:43:08.683933 14322 raft_consensus.cc:1261] T e8d8382c0f7d4ba582b56044add1130e P 546f9f2eb2c24454a5fa849b1fd61906 [term 1 FOLLOWER]: Refusing update from remote peer c426e7add5844349b527e7cc4d8b99d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:43:08.684037 14102 raft_consensus.cc:1261] T e8d8382c0f7d4ba582b56044add1130e P 8942be1719f2463aa6703529f245d5bf [term 1 FOLLOWER]: Refusing update from remote peer c426e7add5844349b527e7cc4d8b99d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:43:08.684342 14408 consensus_queue.cc:1035] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "546f9f2eb2c24454a5fa849b1fd61906" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:43:08.684474 13949 consensus_queue.cc:1035] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8942be1719f2463aa6703529f245d5bf" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 37679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:43:08.686852 14414 mvcc.cc:205] Tried to move back new op lower bound from 7316040043246522368 to 7316040043051823104. Current Snapshot: MvccSnapshot[applied={T|T < 7316040043246522368}]
I20260807 22:43:08.687398 14417 mvcc.cc:205] Tried to move back new op lower bound from 7316040043246522368 to 7316040043051823104. Current Snapshot: MvccSnapshot[applied={T|T < 7316040043246522368 or (T in {7316040043246522368})}]
I20260807 22:43:08.689404 13617 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:44716:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:43:08.689483 13617 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:44716:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:43:08.690167 13617 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033: Sending DeleteTablet for 3 replicas of tablet e8d8382c0f7d4ba582b56044add1130e
I20260807 22:43:08.690450 14052 tablet_service.cc:1514] Processing DeleteTablet for tablet e8d8382c0f7d4ba582b56044add1130e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:43:08 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:54508
I20260807 22:43:08.690483 13821 tablet_service.cc:1514] Processing DeleteTablet for tablet e8d8382c0f7d4ba582b56044add1130e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:43:08 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:36618
I20260807 22:43:08.690461 14292 tablet_service.cc:1514] Processing DeleteTablet for tablet e8d8382c0f7d4ba582b56044add1130e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:43:08 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:42002
I20260807 22:43:08.690543 14181 tablet_replica.cc:330] T e8d8382c0f7d4ba582b56044add1130e P 8942be1719f2463aa6703529f245d5bf: stopping tablet replica
I20260807 22:43:08.690593 14181 raft_consensus.cc:2229] T e8d8382c0f7d4ba582b56044add1130e P 8942be1719f2463aa6703529f245d5bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:43:08.690642 14181 raft_consensus.cc:2258] T e8d8382c0f7d4ba582b56044add1130e P 8942be1719f2463aa6703529f245d5bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:43:08.690845 14432 tablet_replica.cc:330] T e8d8382c0f7d4ba582b56044add1130e P 546f9f2eb2c24454a5fa849b1fd61906: stopping tablet replica
I20260807 22:43:08.690843 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 13677
I20260807 22:43:08.690941 14432 raft_consensus.cc:2229] T e8d8382c0f7d4ba582b56044add1130e P 546f9f2eb2c24454a5fa849b1fd61906 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:43:08.690996 14181 ts_tablet_manager.cc:1905] T e8d8382c0f7d4ba582b56044add1130e P 8942be1719f2463aa6703529f245d5bf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:43:08.691051 14432 raft_consensus.cc:2258] T e8d8382c0f7d4ba582b56044add1130e P 546f9f2eb2c24454a5fa849b1fd61906 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:43:08.691470 14432 ts_tablet_manager.cc:1905] T e8d8382c0f7d4ba582b56044add1130e P 546f9f2eb2c24454a5fa849b1fd61906: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:43:08.693223 14432 ts_tablet_manager.cc:1918] T e8d8382c0f7d4ba582b56044add1130e P 546f9f2eb2c24454a5fa849b1fd61906: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:43:08.693285 14432 log.cc:1196] T e8d8382c0f7d4ba582b56044add1130e P 546f9f2eb2c24454a5fa849b1fd61906: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/wal/wals/e8d8382c0f7d4ba582b56044add1130e
I20260807 22:43:08.693529 14432 ts_tablet_manager.cc:1939] T e8d8382c0f7d4ba582b56044add1130e P 546f9f2eb2c24454a5fa849b1fd61906: Deleting consensus metadata
I20260807 22:43:08.693621 14181 ts_tablet_manager.cc:1918] T e8d8382c0f7d4ba582b56044add1130e P 8942be1719f2463aa6703529f245d5bf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:43:08.693665 14181 log.cc:1196] T e8d8382c0f7d4ba582b56044add1130e P 8942be1719f2463aa6703529f245d5bf: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/wal/wals/e8d8382c0f7d4ba582b56044add1130e
I20260807 22:43:08.693866 14181 ts_tablet_manager.cc:1939] T e8d8382c0f7d4ba582b56044add1130e P 8942be1719f2463aa6703529f245d5bf: Deleting consensus metadata
I20260807 22:43:08.694005 13595 catalog_manager.cc:4841] TS 546f9f2eb2c24454a5fa849b1fd61906 (127.22.212.67:39995): tablet e8d8382c0f7d4ba582b56044add1130e (table test-table [id=2cce036d2de646609ec98331db29ab28]) successfully deleted
I20260807 22:43:08.694162 13598 catalog_manager.cc:4841] TS 8942be1719f2463aa6703529f245d5bf (127.22.212.66:37679): tablet e8d8382c0f7d4ba582b56044add1130e (table test-table [id=2cce036d2de646609ec98331db29ab28]) successfully deleted
W20260807 22:43:08.705914 13595 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.212.65:45089 (error 108)
I20260807 22:43:08.706447 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 13945
I20260807 22:43:08.706485 13950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:08.706350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:45089 (local address 127.0.0.1:36646)
0807 22:43:08.706406 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:08.706451 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.65:45089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260807 22:43:08.722729 13595 catalog_manager.cc:4584] TS c426e7add5844349b527e7cc4d8b99d1 (127.22.212.65:45089): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e8d8382c0f7d4ba582b56044add1130e: Network error: Client connection negotiation failed: client connection to 127.22.212.65:45089: connect: Connection refused (error 111)
I20260807 22:43:08.728154 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 14177
I20260807 22:43:08.737583 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 13570
I20260807 22:43:08.749379 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:35997
--webserver_interface=127.22.212.126
--webserver_port=35265
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:41371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:35997
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:43:08.834225 14435 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:43:08.834514 14435 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:43:08.834585 14435 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:43:08.835738 14435 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:43:08.835806 14435 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:43:08.835830 14435 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:43:08.835861 14435 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:43:08.835908 14435 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:43:08.837486 14435 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:41371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:35997
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:35997
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=35265
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14435
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:43:08.837771 14435 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:43:08.838001 14435 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:43:08.843007 14443 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:43:08.843206 14445 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:43:08.843080 14454 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:43:08.843135 14435 server_base.cc:1034] running on GCE node
I20260807 22:43:08.843487 14435 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:43:08.843798 14435 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:43:08.844959 14435 hybrid_clock.cc:648] HybridClock initialized: now 1786142588844946 us; error 32 us; skew 500 ppm
Aug 07 22:43:08 dist-test-slave-2d19 krb5kdc[12691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142588, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:43:08.847467 14435 init.cc:377] Logged in from keytab as kudu/127.22.212.126@KRBTEST.COM (short username kudu)
I20260807 22:43:08.847981 14435 webserver.cc:460] Webserver started at http://127.22.212.126:35265/ using document root <none> and password file <none>
I20260807 22:43:08.848213 14435 fs_manager.cc:359] Metadata directory not provided
I20260807 22:43:08.848312 14435 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:43:08.849718 14435 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:43:08.850418 14461 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:43:08.850600 14435 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 22:43:08.850711 14435 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "646949290ae4462abbdada3791cc4033"
format_stamp: "Formatted at 2026-08-07 22:43:06 on dist-test-slave-2d19"
server_key: "a64b0b5f55c0247edebf28e52b222fc0"
server_key_iv: "31969a486621b0b08155adfe91e39986"
server_key_version: "encryptionkey@0"
I20260807 22:43:08.851075 14435 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:43:08.859753 14435 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:43:08.861727 14435 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:43:08.861898 14435 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:43:08.866220 14435 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:35997
I20260807 22:43:08.866261 14543 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:35997 every 8 connection(s)
I20260807 22:43:08.866680 14435 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:43:08.868244 14546 sys_catalog.cc:263] Verifying existing consensus state
I20260807 22:43:08.868961 14546 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033: Bootstrap starting.
I20260807 22:43:08.874930 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 14435
I20260807 22:43:08.875260 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.65:45089
--local_ip_for_outbound_sockets=127.22.212.65
--tserver_master_addrs=127.22.212.126:35997
--webserver_port=37609
--webserver_interface=127.22.212.65
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:41371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:43:08.878049 14546 log.cc:824] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033: Log is configured to *not* fsync() on all Append() calls
I20260807 22:43:08.880616 14546 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 22:43:08.880931 14546 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033: Bootstrap complete.
I20260807 22:43:08.883227 14546 raft_consensus.cc:348] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "646949290ae4462abbdada3791cc4033" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35997 } }
I20260807 22:43:08.883450 14546 raft_consensus.cc:729] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 646949290ae4462abbdada3791cc4033, State: Initialized, Role: FOLLOWER
I20260807 22:43:08.883646 14546 consensus_queue.cc:260] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "646949290ae4462abbdada3791cc4033" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35997 } }
I20260807 22:43:08.883725 14546 raft_consensus.cc:388] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:43:08.883772 14546 raft_consensus.cc:482] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:43:08.883822 14546 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [term 2 FOLLOWER]: Advancing to term 3
I20260807 22:43:08.884881 14546 raft_consensus.cc:504] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "646949290ae4462abbdada3791cc4033" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35997 } }
I20260807 22:43:08.884967 14546 leader_election.cc:302] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 646949290ae4462abbdada3791cc4033; no voters:
I20260807 22:43:08.885170 14546 leader_election.cc:288] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260807 22:43:08.885210 14550 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 22:43:08.885339 14550 raft_consensus.cc:686] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [term 3 LEADER]: Becoming Leader. State: Replica: 646949290ae4462abbdada3791cc4033, State: Running, Role: LEADER
I20260807 22:43:08.885454 14546 sys_catalog.cc:564] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:43:08.885440 14550 consensus_queue.cc:237] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "646949290ae4462abbdada3791cc4033" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35997 } }
I20260807 22:43:08.885712 14550 sys_catalog.cc:455] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 646949290ae4462abbdada3791cc4033. Latest consensus state: current_term: 3 leader_uuid: "646949290ae4462abbdada3791cc4033" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "646949290ae4462abbdada3791cc4033" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35997 } } }
I20260807 22:43:08.885792 14550 sys_catalog.cc:458] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [sys.catalog]: This master's current role is: LEADER
I20260807 22:43:08.885717 14551 sys_catalog.cc:455] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "646949290ae4462abbdada3791cc4033" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "646949290ae4462abbdada3791cc4033" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 35997 } } }
I20260807 22:43:08.885847 14551 sys_catalog.cc:458] T 00000000000000000000000000000000 P 646949290ae4462abbdada3791cc4033 [sys.catalog]: This master's current role is: LEADER
I20260807 22:43:08.886122 14557 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:43:08.887104 14557 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:43:08.887283 14557 catalog_manager.cc:1259] Loaded cluster ID: 54b4c856889540fdba51c16456db2982
I20260807 22:43:08.887509 14557 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260807 22:43:08.887776 14557 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f9c0a5329ad google::LogMessage::Fail() at ??:0
@ 0x7f9c0a53588a google::LogMessage::SendToLog() at ??:0
@ 0x7f9c0a5324de google::LogMessage::Flush() at ??:0
@ 0x7f9c0a533a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f9c124530f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f9c1245c8b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f9c0c4000d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f9c0c3f5954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f9c0d2596db start_thread at ??:0
@ 0x7f9c0903061f clone at ??:0
W20260807 22:43:08.976708 14548 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:43:08.976928 14548 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:43:08.976953 14548 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:43:08.978135 14548 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:43:08.978178 14548 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:43:08.978207 14548 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.65
I20260807 22:43:08.979686 14548 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:41371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.65:45089
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.212.65
--webserver_port=37609
--tserver_master_addrs=127.22.212.126:35997
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14548
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.65
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:43:08.979939 14548 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:43:08.980199 14548 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:43:08.985416 14597 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:43:08.985616 14548 server_base.cc:1034] running on GCE node
W20260807 22:43:08.985404 14599 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:43:08.985417 14603 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:43:08.985872 14548 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:43:08.986159 14548 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:43:08.987329 14548 hybrid_clock.cc:648] HybridClock initialized: now 1786142588987315 us; error 27 us; skew 500 ppm
Aug 07 22:43:08 dist-test-slave-2d19 krb5kdc[12691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142588, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:43:08.990392 14548 init.cc:377] Logged in from keytab as kudu/127.22.212.65@KRBTEST.COM (short username kudu)
I20260807 22:43:08.990906 14548 webserver.cc:460] Webserver started at http://127.22.212.65:37609/ using document root <none> and password file <none>
I20260807 22:43:08.991158 14548 fs_manager.cc:359] Metadata directory not provided
I20260807 22:43:08.991231 14548 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:43:08.992735 14548 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 22:43:08.993534 14617 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:43:08.993736 14548 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:43:08.993855 14548 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-0/wal
uuid: "c426e7add5844349b527e7cc4d8b99d1"
format_stamp: "Formatted at 2026-08-07 22:43:07 on dist-test-slave-2d19"
server_key: "edfcf7d5ca5fc0e0dae323a18adebd0a"
server_key_iv: "c8c228ce1d1c97b343e12777c88afd7f"
server_key_version: "encryptionkey@0"
I20260807 22:43:08.994225 14548 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:43:09.026594 14548 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:43:09.029270 14548 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:43:09.029467 14548 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:43:09.029749 14548 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:43:09.030242 14626 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 22:43:09.032298 14548 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 22:43:09.032370 14548 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260807 22:43:09.032415 14548 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 22:43:09.033102 14548 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 22:43:09.033159 14548 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260807 22:43:09.033236 14626 tablet_bootstrap.cc:492] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1: Bootstrap starting.
I20260807 22:43:09.040477 14548 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.65:45089
I20260807 22:43:09.040637 14789 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.65:45089 every 8 connection(s)
I20260807 22:43:09.040925 14548 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
I20260807 22:43:09.042517 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 14548
I20260807 22:43:09.042846 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.66:37679
--local_ip_for_outbound_sockets=127.22.212.66
--tserver_master_addrs=127.22.212.126:35997
--webserver_port=33085
--webserver_interface=127.22.212.66
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:41371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:43:09.044723 14626 log.cc:824] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1: Log is configured to *not* fsync() on all Append() calls
I20260807 22:43:09.047709 14626 tablet_bootstrap.cc:492] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 22:43:09.048054 14626 tablet_bootstrap.cc:492] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1: Bootstrap complete.
I20260807 22:43:09.049288 14626 ts_tablet_manager.cc:1397] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1: Time spent bootstrapping tablet: real 0.016s user 0.007s sys 0.007s
I20260807 22:43:09.050829 14626 raft_consensus.cc:348] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546f9f2eb2c24454a5fa849b1fd61906" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39995 } } peers { permanent_uuid: "c426e7add5844349b527e7cc4d8b99d1" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 45089 } } peers { permanent_uuid: "8942be1719f2463aa6703529f245d5bf" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 37679 } }
I20260807 22:43:09.051220 14626 raft_consensus.cc:729] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c426e7add5844349b527e7cc4d8b99d1, State: Initialized, Role: FOLLOWER
I20260807 22:43:09.051409 14626 consensus_queue.cc:260] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546f9f2eb2c24454a5fa849b1fd61906" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39995 } } peers { permanent_uuid: "c426e7add5844349b527e7cc4d8b99d1" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 45089 } } peers { permanent_uuid: "8942be1719f2463aa6703529f245d5bf" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 37679 } }
I20260807 22:43:09.051730 14626 ts_tablet_manager.cc:1428] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
W20260807 22:43:09.079802 14794 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:43:09.041708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.65:43111)
0807 22:43:09.041908 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:09.041961 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 22:43:09.042580 (+ 619us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:43:09.079594 (+ 37014us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":104,"threads_started":1}
W20260807 22:43:09.080104 14791 heartbeater.cc:644] Failed to heartbeat to 127.22.212.126:35997 (0 consecutive failures): Network error: Failed to ping master at 127.22.212.126:35997: Client connection negotiation failed: client connection to 127.22.212.126:35997: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 22:43:09.080546 14794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:09.080408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.65:49141)
0807 22:43:09.080466 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:09.080515 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260807 22:43:09.080909 14794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:09.080815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.65:49865)
0807 22:43:09.080863 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:09.080891 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260807 22:43:09.081061 14791 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 22:43:09.134677 14795 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:43:09.134887 14795 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:43:09.134920 14795 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:43:09.136082 14795 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:43:09.136124 14795 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:43:09.136185 14795 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.66
I20260807 22:43:09.137710 14795 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:41371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.66:37679
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.212.66
--webserver_port=33085
--tserver_master_addrs=127.22.212.126:35997
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14795
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.66
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:43:09.137904 14795 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:43:09.138082 14795 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:43:09.143275 14806 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:43:09.143321 14795 server_base.cc:1034] running on GCE node
W20260807 22:43:09.143286 14810 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:43:09.143316 14807 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:43:09.143724 14795 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:43:09.143976 14795 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:43:09.145175 14795 hybrid_clock.cc:648] HybridClock initialized: now 1786142589145159 us; error 26 us; skew 500 ppm
Aug 07 22:43:09 dist-test-slave-2d19 krb5kdc[12691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142589, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:43:09.147840 14795 init.cc:377] Logged in from keytab as kudu/127.22.212.66@KRBTEST.COM (short username kudu)
I20260807 22:43:09.148437 14795 webserver.cc:460] Webserver started at http://127.22.212.66:33085/ using document root <none> and password file <none>
I20260807 22:43:09.148676 14795 fs_manager.cc:359] Metadata directory not provided
I20260807 22:43:09.148747 14795 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:43:09.150089 14795 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:43:09.150751 14818 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:43:09.150959 14795 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:43:09.151070 14795 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/wal
uuid: "8942be1719f2463aa6703529f245d5bf"
format_stamp: "Formatted at 2026-08-07 22:43:07 on dist-test-slave-2d19"
server_key: "3be2d23c5e9d84b20256af052d48d3d6"
server_key_iv: "22396da00ceb8ac6c340afa77b9dfad3"
server_key_version: "encryptionkey@0"
I20260807 22:43:09.151417 14795 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:43:09.172791 14795 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:43:09.175143 14795 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:43:09.175258 14795 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:43:09.175552 14795 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:43:09.175887 14795 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:43:09.175943 14795 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:43:09.175987 14795 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:43:09.176012 14795 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:43:09.182408 14795 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.66:37679
I20260807 22:43:09.182469 15010 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.66:37679 every 8 connection(s)
I20260807 22:43:09.182839 14795 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
I20260807 22:43:09.183979 15013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:09.183539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.66:40339)
0807 22:43:09.183701 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:09.183788 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":69,"threads_started":1}
W20260807 22:43:09.184538 15011 heartbeater.cc:644] Failed to heartbeat to 127.22.212.126:35997 (0 consecutive failures): Network error: Failed to ping master at 127.22.212.126:35997: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
I20260807 22:43:09.184849 15013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:09.184752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.66:60279)
0807 22:43:09.184797 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:09.184828 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260807 22:43:09.185228 15013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:09.185140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.66:50179)
0807 22:43:09.185188 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:09.185212 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260807 22:43:09.185341 15011 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 22:43:09.192142 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 14795
I20260807 22:43:09.192484 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.67:39995
--local_ip_for_outbound_sockets=127.22.212.67
--tserver_master_addrs=127.22.212.126:35997
--webserver_port=33015
--webserver_interface=127.22.212.67
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:41371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:43:09.278827 15014 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:43:09.279023 15014 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:43:09.279047 15014 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:43:09.280196 15014 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:43:09.280239 15014 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:43:09.280331 15014 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.67
I20260807 22:43:09.281821 15014 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:41371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.67:39995
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.212.67
--webserver_port=33015
--tserver_master_addrs=127.22.212.126:35997
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15014
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.67
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:43:09.282065 15014 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:43:09.282299 15014 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:43:09.287729 15020 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:43:09.287729 15022 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:43:09.287791 15025 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:43:09.287864 15014 server_base.cc:1034] running on GCE node
I20260807 22:43:09.288156 15014 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:43:09.288417 15014 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:43:09.289582 15014 hybrid_clock.cc:648] HybridClock initialized: now 1786142589289559 us; error 38 us; skew 500 ppm
Aug 07 22:43:09 dist-test-slave-2d19 krb5kdc[12691](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142589, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:43:09.292095 15014 init.cc:377] Logged in from keytab as kudu/127.22.212.67@KRBTEST.COM (short username kudu)
I20260807 22:43:09.292573 15014 webserver.cc:460] Webserver started at http://127.22.212.67:33015/ using document root <none> and password file <none>
I20260807 22:43:09.292760 15014 fs_manager.cc:359] Metadata directory not provided
I20260807 22:43:09.292804 15014 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:43:09.294138 15014 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 22:43:09.294749 15041 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:43:09.295007 15014 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 22:43:09.295095 15014 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/wal
uuid: "546f9f2eb2c24454a5fa849b1fd61906"
format_stamp: "Formatted at 2026-08-07 22:43:07 on dist-test-slave-2d19"
server_key: "19a2b5bf03536fae7426acb864fbad69"
server_key_iv: "4120e7fa6613bb3bdc91adb4781fd266"
server_key_version: "encryptionkey@0"
I20260807 22:43:09.295414 15014 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:43:09.306943 15014 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:43:09.309409 15014 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:43:09.309522 15014 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:43:09.309712 15014 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:43:09.310093 15014 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:43:09.310130 15014 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:43:09.310176 15014 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:43:09.310204 15014 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:43:09.315845 15014 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.67:39995
I20260807 22:43:09.315944 15225 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.67:39995 every 8 connection(s)
I20260807 22:43:09.316315 15014 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
I20260807 22:43:09.317422 15235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:09.317014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.67:33669)
0807 22:43:09.317191 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:09.317275 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":78,"threads_started":1}
W20260807 22:43:09.317857 15232 heartbeater.cc:644] Failed to heartbeat to 127.22.212.126:35997 (0 consecutive failures): Network error: Failed to ping master at 127.22.212.126:35997: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
I20260807 22:43:09.318194 15235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:09.318086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.67:38077)
0807 22:43:09.318136 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:09.318162 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260807 22:43:09.318418 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 15014
I20260807 22:43:09.318511 15235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:09.318412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.67:37845)
0807 22:43:09.318457 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:09.318481 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260807 22:43:09.318604 15232 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 22:43:10.081705 15238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:10.081447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.65:49789)
0807 22:43:10.081588 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:10.081634 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":70,"threads_started":1}
I20260807 22:43:10.185918 15241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:10.185673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.66:55237)
0807 22:43:10.185827 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:10.185865 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":65,"threads_started":1}
I20260807 22:43:10.247550 15242 raft_consensus.cc:482] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:43:10.247689 15242 raft_consensus.cc:504] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546f9f2eb2c24454a5fa849b1fd61906" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39995 } } peers { permanent_uuid: "c426e7add5844349b527e7cc4d8b99d1" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 45089 } } peers { permanent_uuid: "8942be1719f2463aa6703529f245d5bf" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 37679 } }
I20260807 22:43:10.248059 15242 leader_election.cc:288] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 546f9f2eb2c24454a5fa849b1fd61906 (127.22.212.67:39995), 8942be1719f2463aa6703529f245d5bf (127.22.212.66:37679)
Aug 07 22:43:10 dist-test-slave-2d19 krb5kdc[12691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142588, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for kudu/127.22.212.67@KRBTEST.COM
Aug 07 22:43:10 dist-test-slave-2d19 krb5kdc[12691](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142588, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for kudu/127.22.212.66@KRBTEST.COM
I20260807 22:43:10.259621 15245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:10.248342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:60503 (local address 127.22.212.67:39995)
0807 22:43:10.248520 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:10.248534 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:10.248569 (+ 35us) server_negotiation.cc:407] Connection header received
0807 22:43:10.249007 (+ 438us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:10.249009 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:10.249070 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:10.249218 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:43:10.250027 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:10.250982 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:10.252059 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:10.252610 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:10.252758 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:10.255404 (+ 2646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:43:10.255408 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:43:10.255409 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:43:10.255420 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:43:10.257613 (+ 2193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:10.258150 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:10.258154 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:10.258154 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:10.258262 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:10.258576 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:10.258577 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:10.258577 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:10.258913 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:43:10.259009 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:10.259369 (+ 360us) server_negotiation.cc:299] Negotiation successful
0807 22:43:10.259511 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":80,"threads_started":1}
I20260807 22:43:10.259624 15243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:10.248241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.66:37679 (local address 127.22.212.65:47089)
0807 22:43:10.248396 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:10.248406 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 22:43:10.248470 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:43:10.249283 (+ 813us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:43:10.249284 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:43:10.249689 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:43:10.249868 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:10.249875 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:10.251089 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:10.251091 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:10.251967 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:10.251970 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:10.252694 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:10.252695 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:10.252826 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:10.253483 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:43:10.253492 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:43:10.255700 (+ 2208us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:43:10.258127 (+ 2427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:10.258129 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:10.258129 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:10.258366 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:10.258679 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:10.258680 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:10.258680 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:10.258743 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:10.259199 (+ 456us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:43:10.259200 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:43:10.259236 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 22:43:10.259321 (+ 85us) client_negotiation.cc:240] Negotiation successful
0807 22:43:10.259530 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"mutex_wait_us":82,"thread_start_us":98,"threads_started":1}
I20260807 22:43:10.259718 15247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:10.248405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:47089 (local address 127.22.212.66:37679)
0807 22:43:10.248557 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:10.248567 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:10.248598 (+ 31us) server_negotiation.cc:407] Connection header received
0807 22:43:10.249048 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:10.249050 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:10.249088 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:10.249261 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:43:10.250019 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:10.250964 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:10.252104 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:10.252595 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:10.252714 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:10.255821 (+ 3107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:43:10.255825 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:43:10.255826 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:43:10.255839 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:43:10.258007 (+ 2168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:10.258455 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:10.258459 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:10.258459 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:10.258604 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:10.258812 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:10.258813 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:10.258813 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:10.259119 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:43:10.259214 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:10.259400 (+ 186us) server_negotiation.cc:299] Negotiation successful
0807 22:43:10.259588 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":53,"threads_started":1}
I20260807 22:43:10.259910 15238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:10.248183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.67:39995 (local address 127.22.212.65:60503)
0807 22:43:10.248243 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:10.248294 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 22:43:10.248360 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:43:10.249275 (+ 915us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:43:10.249278 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:43:10.249674 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:43:10.249868 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:10.249875 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:10.251117 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:10.251118 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:10.251964 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:10.251966 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:10.252731 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:10.252732 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:10.252828 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:10.253554 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:43:10.253559 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:43:10.255259 (+ 1700us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:43:10.257703 (+ 2444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:10.257711 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:10.257714 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:10.258062 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:10.258341 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:10.258342 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:10.258342 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:10.258499 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:10.258987 (+ 488us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:43:10.258994 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:43:10.259174 (+ 180us) client_negotiation.cc:769] Sending connection context
0807 22:43:10.259294 (+ 120us) client_negotiation.cc:240] Negotiation successful
0807 22:43:10.259623 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":123}
W20260807 22:43:10.260838 14621 leader_election.cc:341] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8942be1719f2463aa6703529f245d5bf (127.22.212.66:37679): Not found: Tablet not found: e8d8382c0f7d4ba582b56044add1130e
W20260807 22:43:10.260919 14618 leader_election.cc:341] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 546f9f2eb2c24454a5fa849b1fd61906 (127.22.212.67:39995): Not found: Tablet not found: e8d8382c0f7d4ba582b56044add1130e
I20260807 22:43:10.260993 14618 leader_election.cc:302] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c426e7add5844349b527e7cc4d8b99d1; no voters: 546f9f2eb2c24454a5fa849b1fd61906, 8942be1719f2463aa6703529f245d5bf
I20260807 22:43:10.261135 15242 raft_consensus.cc:2726] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 22:43:10.319180 15250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:10.318934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.67:41279)
0807 22:43:10.319076 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:10.319143 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":62,"threads_started":1}
I20260807 22:43:11.082430 15252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:11.082191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.65:54365)
0807 22:43:11.082344 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:11.082384 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":73,"threads_started":1}
I20260807 22:43:11.186582 15253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:11.186373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.66:50205)
0807 22:43:11.186500 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:11.186540 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":64,"threads_started":1}
I20260807 22:43:11.319857 15254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:11.319656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.67:36605)
0807 22:43:11.319788 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:11.319820 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":70,"threads_started":1}
I20260807 22:43:12.083266 15256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:12.083015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.65:34725)
0807 22:43:12.083175 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:12.083218 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":66,"threads_started":1}
I20260807 22:43:12.187269 15260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:12.187052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.66:57499)
0807 22:43:12.187188 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:12.187228 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":65,"threads_started":1}
I20260807 22:43:12.320597 15261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:12.320382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.67:41405)
0807 22:43:12.320516 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:12.320554 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":61,"threads_started":1}
I20260807 22:43:12.499927 15262 raft_consensus.cc:482] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:43:12.500023 15262 raft_consensus.cc:504] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546f9f2eb2c24454a5fa849b1fd61906" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39995 } } peers { permanent_uuid: "c426e7add5844349b527e7cc4d8b99d1" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 45089 } } peers { permanent_uuid: "8942be1719f2463aa6703529f245d5bf" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 37679 } }
I20260807 22:43:12.500185 15262 leader_election.cc:288] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 546f9f2eb2c24454a5fa849b1fd61906 (127.22.212.67:39995), 8942be1719f2463aa6703529f245d5bf (127.22.212.66:37679)
W20260807 22:43:12.500674 14618 leader_election.cc:341] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 546f9f2eb2c24454a5fa849b1fd61906 (127.22.212.67:39995): Not found: Tablet not found: e8d8382c0f7d4ba582b56044add1130e
W20260807 22:43:12.500761 14621 leader_election.cc:341] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8942be1719f2463aa6703529f245d5bf (127.22.212.66:37679): Not found: Tablet not found: e8d8382c0f7d4ba582b56044add1130e
I20260807 22:43:12.500797 14621 leader_election.cc:302] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c426e7add5844349b527e7cc4d8b99d1; no voters: 546f9f2eb2c24454a5fa849b1fd61906, 8942be1719f2463aa6703529f245d5bf
I20260807 22:43:12.500888 15262 raft_consensus.cc:2726] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 22:43:13.084044 15263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:13.083793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.65:42409)
0807 22:43:13.083955 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:13.083996 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":93,"threads_started":1}
I20260807 22:43:13.188017 15264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:13.187782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.66:53239)
0807 22:43:13.187920 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:13.187967 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":66,"threads_started":1}
I20260807 22:43:13.321374 15265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:13.321127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.67:36335)
0807 22:43:13.321282 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:13.321323 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":68,"threads_started":1}
I20260807 22:43:14.084882 15266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:14.084647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.65:60463)
0807 22:43:14.084792 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:14.084836 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":80,"threads_started":1}
I20260807 22:43:14.189059 15267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:14.188839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.66:48137)
0807 22:43:14.188971 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:14.189011 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":66,"threads_started":1}
I20260807 22:43:14.322134 15268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:14.321901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.67:34319)
0807 22:43:14.322049 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:14.322090 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":65,"threads_started":1}
I20260807 22:43:15.085644 15269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:15.085394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.65:53581)
0807 22:43:15.085554 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:15.085596 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":85,"threads_started":1}
I20260807 22:43:15.189838 15270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:15.189621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.66:41681)
0807 22:43:15.189750 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:15.189790 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":61,"threads_started":1}
I20260807 22:43:15.322844 15271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:15.322632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.67:59959)
0807 22:43:15.322758 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:15.322798 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":64,"threads_started":1}
I20260807 22:43:15.531677 15272 raft_consensus.cc:482] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:43:15.531776 15272 raft_consensus.cc:504] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546f9f2eb2c24454a5fa849b1fd61906" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39995 } } peers { permanent_uuid: "c426e7add5844349b527e7cc4d8b99d1" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 45089 } } peers { permanent_uuid: "8942be1719f2463aa6703529f245d5bf" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 37679 } }
I20260807 22:43:15.531992 15272 leader_election.cc:288] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 546f9f2eb2c24454a5fa849b1fd61906 (127.22.212.67:39995), 8942be1719f2463aa6703529f245d5bf (127.22.212.66:37679)
W20260807 22:43:15.532491 14621 leader_election.cc:341] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8942be1719f2463aa6703529f245d5bf (127.22.212.66:37679): Not found: Tablet not found: e8d8382c0f7d4ba582b56044add1130e
W20260807 22:43:15.532588 14618 leader_election.cc:341] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 546f9f2eb2c24454a5fa849b1fd61906 (127.22.212.67:39995): Not found: Tablet not found: e8d8382c0f7d4ba582b56044add1130e
I20260807 22:43:15.532637 14618 leader_election.cc:302] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c426e7add5844349b527e7cc4d8b99d1; no voters: 546f9f2eb2c24454a5fa849b1fd61906, 8942be1719f2463aa6703529f245d5bf
I20260807 22:43:15.532744 15272 raft_consensus.cc:2726] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 22:43:16.086401 15273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:16.086171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.65:45593)
0807 22:43:16.086314 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:16.086353 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":89,"threads_started":1}
I20260807 22:43:16.190584 15276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:16.190363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.66:49075)
0807 22:43:16.190498 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:16.190539 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":64,"threads_started":1}
I20260807 22:43:16.323640 15278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:16.323386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.67:43621)
0807 22:43:16.323550 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:16.323590 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":95,"threads_started":1}
I20260807 22:43:17.087142 15281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:17.086899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.65:53805)
0807 22:43:17.087051 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:17.087093 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":67,"threads_started":1}
I20260807 22:43:17.191322 15282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:17.191059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.66:48029)
0807 22:43:17.191204 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:17.191247 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":69,"threads_started":1}
I20260807 22:43:17.324461 15284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:17.324174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.67:47403)
0807 22:43:17.324376 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:17.324418 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":69,"threads_started":1}
I20260807 22:43:17.639181 15286 raft_consensus.cc:482] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:43:17.639314 15286 raft_consensus.cc:504] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546f9f2eb2c24454a5fa849b1fd61906" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39995 } } peers { permanent_uuid: "c426e7add5844349b527e7cc4d8b99d1" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 45089 } } peers { permanent_uuid: "8942be1719f2463aa6703529f245d5bf" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 37679 } }
I20260807 22:43:17.639528 15286 leader_election.cc:288] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 546f9f2eb2c24454a5fa849b1fd61906 (127.22.212.67:39995), 8942be1719f2463aa6703529f245d5bf (127.22.212.66:37679)
W20260807 22:43:17.639957 14618 leader_election.cc:341] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 546f9f2eb2c24454a5fa849b1fd61906 (127.22.212.67:39995): Not found: Tablet not found: e8d8382c0f7d4ba582b56044add1130e
W20260807 22:43:17.640046 14621 leader_election.cc:341] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8942be1719f2463aa6703529f245d5bf (127.22.212.66:37679): Not found: Tablet not found: e8d8382c0f7d4ba582b56044add1130e
I20260807 22:43:17.640115 14621 leader_election.cc:302] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c426e7add5844349b527e7cc4d8b99d1; no voters: 546f9f2eb2c24454a5fa849b1fd61906, 8942be1719f2463aa6703529f245d5bf
I20260807 22:43:17.640192 15286 raft_consensus.cc:2726] T e8d8382c0f7d4ba582b56044add1130e P c426e7add5844349b527e7cc4d8b99d1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 22:43:18.087989 15289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:18.087666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.65:60179)
0807 22:43:18.087847 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:18.087895 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":87,"threads_started":1}
I20260807 22:43:18.192162 15291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:18.191844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.66:34495)
0807 22:43:18.192073 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:18.192116 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":148,"threads_started":1}
I20260807 22:43:18.325172 15292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:18.324927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.67:38023)
0807 22:43:18.325085 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:18.325128 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":67,"threads_started":1}
I20260807 22:43:19.088771 15293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:19.088510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.65:56037)
0807 22:43:19.088682 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:19.088725 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":97,"threads_started":1}
I20260807 22:43:19.192858 15295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:19.192640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.66:52119)
0807 22:43:19.192771 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:19.192811 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":61,"threads_started":1}
I20260807 22:43:19.325891 15296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:19.325678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.67:34925)
0807 22:43:19.325818 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:19.325850 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":82,"threads_started":1}
I20260807 22:43:20.089488 15297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:20.089262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.65:59943)
0807 22:43:20.089401 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:20.089440 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":83,"threads_started":1}
I20260807 22:43:20.193616 15298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:20.193347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.66:52959)
0807 22:43:20.193512 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:20.193570 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":85,"threads_started":1}
I20260807 22:43:20.326669 15299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:20.326359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.67:48475)
0807 22:43:20.326568 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:20.326608 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":91,"threads_started":1}
I20260807 22:43:21.090207 15300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:21.089990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.65:45279)
0807 22:43:21.090125 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:21.090159 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":66,"threads_started":1}
I20260807 22:43:21.194445 15301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:21.194206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.66:35075)
0807 22:43:21.194368 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:21.194403 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":106,"threads_started":1}
I20260807 22:43:21.327415 15302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:21.327188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.67:34269)
0807 22:43:21.327327 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:21.327370 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":64,"threads_started":1}
I20260807 22:43:22.091003 15303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:22.090749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.65:37857)
0807 22:43:22.090915 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:22.090955 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":111,"threads_started":1}
I20260807 22:43:22.195225 15304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:22.194965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.66:45213)
0807 22:43:22.195129 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:22.195178 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":69,"threads_started":1}
I20260807 22:43:22.328228 15306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:22.328000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.67:33489)
0807 22:43:22.328141 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:22.328182 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":78,"threads_started":1}
I20260807 22:43:23.091797 15307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:23.091549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.65:57385)
0807 22:43:23.091714 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:23.091751 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":101,"threads_started":1}
I20260807 22:43:23.195989 15309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:23.195759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.66:45161)
0807 22:43:23.195895 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:23.195944 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":65,"threads_started":1}
I20260807 22:43:23.328981 15311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:23.328744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.67:47339)
0807 22:43:23.328888 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:23.328932 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":81,"threads_started":1}
I20260807 22:43:24.092633 15314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:24.092410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.65:45333)
0807 22:43:24.092552 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:24.092588 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":66,"threads_started":1}
I20260807 22:43:24.196743 15315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:24.196491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.66:35531)
0807 22:43:24.196665 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:24.196699 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":88,"threads_started":1}
I20260807 22:43:24.321079 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 14548
I20260807 22:43:24.337549 15319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:24.334501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:35997 (local address 127.22.212.67:41403)
0807 22:43:24.337439 (+ 2938us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:24.337491 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:35997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2914,"thread_start_us":485,"threads_started":1}
I20260807 22:43:24.351842 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 14795
I20260807 22:43:24.362465 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 15014
2026-08-07T22:43:24Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18905 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:43:24 dist-test-slave-2d19 krb5kdc[15325](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:43:24 dist-test-slave-2d19 krb5kdc[15325](info): set up 2 sockets
Aug 07 22:43:24 dist-test-slave-2d19 krb5kdc[15325](info): commencing operation
krb5kdc: starting...
W20260807 22:43:25.673795 23377 mini_kdc.cc:121] Time spent starting KDC: real 1.285s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Aug 07 22:43:25 dist-test-slave-2d19 krb5kdc[15325](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142605, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:43:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:43:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.212.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
I20260807 22:43:25.807333 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:45651
--webserver_interface=127.22.212.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:35629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:45651
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:43:25.891937 15348 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:43:25.892149 15348 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:43:25.892172 15348 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:43:25.893380 15348 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 22:43:25.893424 15348 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 22:43:25.893437 15348 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 22:43:25.893448 15348 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:43:25.893461 15348 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:43:25.893510 15348 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:43:25.893539 15348 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:43:25.893556 15348 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:43:25.895079 15348 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:35629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:45651
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:45651
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15348
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:43:25.895350 15348 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:43:25.895622 15348 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:43:25.901008 15354 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:43:25.901077 15353 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:43:25.901175 15348 server_base.cc:1034] running on GCE node
W20260807 22:43:25.901008 15356 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:43:25.901576 15348 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:43:25.901841 15348 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:43:25.902982 15348 hybrid_clock.cc:648] HybridClock initialized: now 1786142605902971 us; error 33 us; skew 500 ppm
Aug 07 22:43:25 dist-test-slave-2d19 krb5kdc[15325](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142605, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:43:25.905601 15348 init.cc:377] Logged in from keytab as kudu/127.22.212.126@KRBTEST.COM (short username kudu)
I20260807 22:43:25.906013 15348 webserver.cc:460] Webserver started at http://127.22.212.126:40795/ using document root <none> and password file <none>
I20260807 22:43:25.906229 15348 fs_manager.cc:359] Metadata directory not provided
I20260807 22:43:25.906272 15348 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:43:25.906360 15348 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:43:25.907385 15348 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "475450f7eff24c1d868f703ebd215245"
format_stamp: "Formatted at 2026-08-07 22:43:25 on dist-test-slave-2d19"
server_key: "bc45ebe01c18bb6ad4d65b74a26233fd"
server_key_iv: "998afd6d91564d2049bc7670fd16719a"
server_key_version: "encryptionkey@0"
I20260807 22:43:25.907683 15348 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "475450f7eff24c1d868f703ebd215245"
format_stamp: "Formatted at 2026-08-07 22:43:25 on dist-test-slave-2d19"
server_key: "bc45ebe01c18bb6ad4d65b74a26233fd"
server_key_iv: "998afd6d91564d2049bc7670fd16719a"
server_key_version: "encryptionkey@0"
I20260807 22:43:25.909137 15348 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 22:43:25.909854 15365 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:43:25.910033 15348 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 22:43:25.910147 15348 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "475450f7eff24c1d868f703ebd215245"
format_stamp: "Formatted at 2026-08-07 22:43:25 on dist-test-slave-2d19"
server_key: "bc45ebe01c18bb6ad4d65b74a26233fd"
server_key_iv: "998afd6d91564d2049bc7670fd16719a"
server_key_version: "encryptionkey@0"
I20260807 22:43:25.910228 15348 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:43:25.931156 15348 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:43:25.933482 15348 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:43:25.933657 15348 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:43:25.937820 15348 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:45651
I20260807 22:43:25.937876 15449 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:45651 every 8 connection(s)
I20260807 22:43:25.938268 15348 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:43:25.939302 15450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:43:25.941718 15450 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245: Bootstrap starting.
I20260807 22:43:25.942359 15450 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245: Neither blocks nor log segments found. Creating new log.
I20260807 22:43:25.942678 15450 log.cc:824] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245: Log is configured to *not* fsync() on all Append() calls
I20260807 22:43:25.943216 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 15348
I20260807 22:43:25.943310 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:43:25.943459 23377 external_mini_cluster.cc:1428] Setting key 966fc1ca36329140fefc715e884819d7
I20260807 22:43:25.943513 15450 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245: No bootstrap required, opened a new log
I20260807 22:43:25.945986 15450 raft_consensus.cc:348] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "475450f7eff24c1d868f703ebd215245" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 45651 } }
I20260807 22:43:25.946188 15450 raft_consensus.cc:374] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:43:25.946239 15450 raft_consensus.cc:729] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 475450f7eff24c1d868f703ebd215245, State: Initialized, Role: FOLLOWER
I20260807 22:43:25.946367 15450 consensus_queue.cc:260] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "475450f7eff24c1d868f703ebd215245" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 45651 } }
I20260807 22:43:25.946465 15450 raft_consensus.cc:388] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:43:25.946506 15450 raft_consensus.cc:482] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:43:25.946555 15450 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:43:25.947121 15450 raft_consensus.cc:504] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "475450f7eff24c1d868f703ebd215245" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 45651 } }
I20260807 22:43:25.947247 15450 leader_election.cc:302] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 475450f7eff24c1d868f703ebd215245; no voters:
I20260807 22:43:25.947413 15450 leader_election.cc:288] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:43:25.947444 15459 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:43:25.947575 15459 raft_consensus.cc:686] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [term 1 LEADER]: Becoming Leader. State: Replica: 475450f7eff24c1d868f703ebd215245, State: Running, Role: LEADER
I20260807 22:43:25.947701 15450 sys_catalog.cc:564] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:43:25.947732 15459 consensus_queue.cc:237] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "475450f7eff24c1d868f703ebd215245" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 45651 } }
I20260807 22:43:25.948350 15461 sys_catalog.cc:455] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "475450f7eff24c1d868f703ebd215245" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "475450f7eff24c1d868f703ebd215245" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 45651 } } }
I20260807 22:43:25.948459 15461 sys_catalog.cc:458] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [sys.catalog]: This master's current role is: LEADER
I20260807 22:43:25.948721 15463 sys_catalog.cc:455] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 475450f7eff24c1d868f703ebd215245. Latest consensus state: current_term: 1 leader_uuid: "475450f7eff24c1d868f703ebd215245" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "475450f7eff24c1d868f703ebd215245" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 45651 } } }
I20260807 22:43:25.949072 15469 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:43:25.949276 15463 sys_catalog.cc:458] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [sys.catalog]: This master's current role is: LEADER
I20260807 22:43:25.949936 15469 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:43:25.951758 15469 catalog_manager.cc:1347] Generated new cluster ID: ce9385cf7b8f46c29925d22b7f447973
Aug 07 22:43:25 dist-test-slave-2d19 krb5kdc[15325](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142605, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:43:25.951812 15469 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:43:25.956010 15457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:25.944018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52110 (local address 127.22.212.126:45651)
0807 22:43:25.944190 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:25.944199 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:25.944235 (+ 36us) server_negotiation.cc:407] Connection header received
0807 22:43:25.944944 (+ 709us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:25.944953 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:25.945041 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:25.945160 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:43:25.946066 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:25.947523 (+ 1457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:25.948755 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:25.949390 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:25.949822 (+ 432us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:25.952392 (+ 2570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:43:25.952397 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:43:25.952397 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:43:25.952408 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:43:25.954346 (+ 1938us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:25.954777 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:25.954780 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:25.954780 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:25.954880 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:25.955109 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:25.955110 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:25.955110 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:25.955393 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:43:25.955530 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:25.955676 (+ 146us) server_negotiation.cc:299] Negotiation successful
0807 22:43:25.955803 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":86,"threads_started":1}
I20260807 22:43:25.983238 15469 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:43:25.984031 15469 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:43:25.989629 15469 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245: Generated new TSK 0
I20260807 22:43:25.989862 15469 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.212.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab.
Entry for principal kudu/127.22.212.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab.
I20260807 22:43:26.023922 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.65:0
--local_ip_for_outbound_sockets=127.22.212.65
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:45651
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:35629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:43:26.107648 15489 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:43:26.107847 15489 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:43:26.107872 15489 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:43:26.109066 15489 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:43:26.109110 15489 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:43:26.109136 15489 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.65
I20260807 22:43:26.110605 15489 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:35629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:45651
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15489
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.65
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:43:26.110848 15489 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:43:26.111091 15489 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:43:26.116520 15499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:43:26.116494 15496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:43:26.116504 15497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:43:26.116757 15489 server_base.cc:1034] running on GCE node
I20260807 22:43:26.116981 15489 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:43:26.117233 15489 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:43:26.118398 15489 hybrid_clock.cc:648] HybridClock initialized: now 1786142606118393 us; error 36 us; skew 500 ppm
Aug 07 22:43:26 dist-test-slave-2d19 krb5kdc[15325](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142606, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:43:26.121133 15489 init.cc:377] Logged in from keytab as kudu/127.22.212.65@KRBTEST.COM (short username kudu)
I20260807 22:43:26.121574 15489 webserver.cc:460] Webserver started at http://127.22.212.65:33497/ using document root <none> and password file <none>
I20260807 22:43:26.121801 15489 fs_manager.cc:359] Metadata directory not provided
I20260807 22:43:26.121869 15489 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:43:26.122020 15489 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:43:26.123082 15489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-0/data/instance:
uuid: "12a897c2d39d4336ab0962100ec3f908"
format_stamp: "Formatted at 2026-08-07 22:43:26 on dist-test-slave-2d19"
server_key: "44995e339fbed6358d194397ec8134ec"
server_key_iv: "350beb061a87a4278650d62955249872"
server_key_version: "encryptionkey@0"
I20260807 22:43:26.123452 15489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance:
uuid: "12a897c2d39d4336ab0962100ec3f908"
format_stamp: "Formatted at 2026-08-07 22:43:26 on dist-test-slave-2d19"
server_key: "44995e339fbed6358d194397ec8134ec"
server_key_iv: "350beb061a87a4278650d62955249872"
server_key_version: "encryptionkey@0"
I20260807 22:43:26.124939 15489 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260807 22:43:26.125702 15512 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:43:26.125873 15489 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 22:43:26.125979 15489 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-0/wal
uuid: "12a897c2d39d4336ab0962100ec3f908"
format_stamp: "Formatted at 2026-08-07 22:43:26 on dist-test-slave-2d19"
server_key: "44995e339fbed6358d194397ec8134ec"
server_key_iv: "350beb061a87a4278650d62955249872"
server_key_version: "encryptionkey@0"
I20260807 22:43:26.126055 15489 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:43:26.140605 15489 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:43:26.142699 15489 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:43:26.142865 15489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:43:26.143116 15489 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:43:26.143435 15489 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:43:26.143489 15489 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:43:26.143558 15489 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:43:26.143587 15489 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:43:26.150098 15489 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.65:41521
I20260807 22:43:26.150149 15698 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.65:41521 every 8 connection(s)
I20260807 22:43:26.150465 15489 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
Aug 07 22:43:26 dist-test-slave-2d19 krb5kdc[15325](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142606, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:43:26.159934 15457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:26.151253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:48001 (local address 127.22.212.126:45651)
0807 22:43:26.151347 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:26.151349 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:26.151511 (+ 162us) server_negotiation.cc:407] Connection header received
0807 22:43:26.152070 (+ 559us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:26.152071 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:26.152085 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:26.152142 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:43:26.153187 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:26.153697 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:26.154719 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:26.154923 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:26.155003 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:26.157237 (+ 2234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:43:26.157239 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:43:26.157239 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:43:26.157247 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:43:26.158728 (+ 1481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:26.159081 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:26.159082 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:26.159082 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:26.159136 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:26.159347 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:26.159348 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:26.159348 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:26.159454 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:43:26.159521 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:26.159755 (+ 234us) server_negotiation.cc:299] Negotiation successful
0807 22:43:26.159827 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 22:43:26.160018 15702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:26.151187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.65:48001)
0807 22:43:26.151363 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:26.151409 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 22:43:26.151948 (+ 539us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:43:26.152216 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:43:26.152220 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:43:26.152871 (+ 651us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:43:26.153074 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:26.153079 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:26.153797 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:26.153798 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:26.154608 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:26.154611 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:26.155018 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:26.155019 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:26.155164 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:26.155662 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:43:26.155670 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:43:26.157142 (+ 1472us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:43:26.158801 (+ 1659us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:26.158807 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:26.158809 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:26.159013 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:26.159196 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:26.159197 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:26.159197 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:26.159291 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:26.159526 (+ 235us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:43:26.159531 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:43:26.159640 (+ 109us) client_negotiation.cc:769] Sending connection context
0807 22:43:26.159721 (+ 81us) client_negotiation.cc:240] Negotiation successful
0807 22:43:26.159839 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":83,"threads_started":1}
I20260807 22:43:26.160095 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 15489
I20260807 22:43:26.160179 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance
I20260807 22:43:26.160369 23377 external_mini_cluster.cc:1428] Setting key 6eb37419b594fc1fa73369bdc6ab1ec6
I20260807 22:43:26.160622 15699 heartbeater.cc:347] Connected to a master server at 127.22.212.126:45651
I20260807 22:43:26.160725 15699 heartbeater.cc:464] Registering TS with master...
I20260807 22:43:26.160902 15699 heartbeater.cc:511] Master 127.22.212.126:45651 requested a full tablet report, sending...
I20260807 22:43:26.161505 15391 ts_manager.cc:194] Registered new tserver with Master: 12a897c2d39d4336ab0962100ec3f908 (127.22.212.65:41521)
I20260807 22:43:26.162112 15391 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.65@KRBTEST.COM'} at 127.22.212.65:48001
WARNING: no policy specified for kudu/127.22.212.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab.
Entry for principal kudu/127.22.212.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab.
I20260807 22:43:26.188098 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.66:0
--local_ip_for_outbound_sockets=127.22.212.66
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:45651
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:35629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:43:26.274187 15708 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:43:26.274382 15708 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:43:26.274405 15708 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:43:26.275514 15708 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:43:26.275557 15708 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:43:26.275611 15708 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.66
I20260807 22:43:26.277195 15708 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:35629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:45651
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15708
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.66
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:43:26.277433 15708 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:43:26.277691 15708 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:43:26.282768 15718 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:43:26.282748 15717 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:43:26.282753 15722 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:43:26.283033 15708 server_base.cc:1034] running on GCE node
I20260807 22:43:26.283258 15708 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:43:26.283552 15708 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:43:26.284723 15708 hybrid_clock.cc:648] HybridClock initialized: now 1786142606284702 us; error 37 us; skew 500 ppm
Aug 07 22:43:26 dist-test-slave-2d19 krb5kdc[15325](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142606, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:43:26.287376 15708 init.cc:377] Logged in from keytab as kudu/127.22.212.66@KRBTEST.COM (short username kudu)
I20260807 22:43:26.287818 15708 webserver.cc:460] Webserver started at http://127.22.212.66:43055/ using document root <none> and password file <none>
I20260807 22:43:26.288116 15708 fs_manager.cc:359] Metadata directory not provided
I20260807 22:43:26.288193 15708 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:43:26.288363 15708 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:43:26.289420 15708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-1/data/instance:
uuid: "b0d14a8c27a147d8ac2182c53d547010"
format_stamp: "Formatted at 2026-08-07 22:43:26 on dist-test-slave-2d19"
server_key: "96d65f2b00e1021d124578c0df0ceb06"
server_key_iv: "b4647d720349d1ce7dab8f789938f50c"
server_key_version: "encryptionkey@0"
I20260807 22:43:26.289799 15708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance:
uuid: "b0d14a8c27a147d8ac2182c53d547010"
format_stamp: "Formatted at 2026-08-07 22:43:26 on dist-test-slave-2d19"
server_key: "96d65f2b00e1021d124578c0df0ceb06"
server_key_iv: "b4647d720349d1ce7dab8f789938f50c"
server_key_version: "encryptionkey@0"
I20260807 22:43:26.291404 15708 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 22:43:26.292182 15734 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:43:26.292393 15708 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:43:26.292507 15708 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-1/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-1/wal
uuid: "b0d14a8c27a147d8ac2182c53d547010"
format_stamp: "Formatted at 2026-08-07 22:43:26 on dist-test-slave-2d19"
server_key: "96d65f2b00e1021d124578c0df0ceb06"
server_key_iv: "b4647d720349d1ce7dab8f789938f50c"
server_key_version: "encryptionkey@0"
I20260807 22:43:26.292583 15708 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:43:26.318706 15708 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:43:26.320645 15708 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:43:26.320813 15708 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:43:26.321116 15708 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:43:26.321460 15708 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:43:26.321517 15708 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:43:26.321559 15708 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:43:26.321589 15708 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:43:26.327543 15708 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.66:39333
I20260807 22:43:26.327621 15921 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.66:39333 every 8 connection(s)
I20260807 22:43:26.327960 15708 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
Aug 07 22:43:26 dist-test-slave-2d19 krb5kdc[15325](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142606, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:43:26.334295 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 15708
I20260807 22:43:26.334384 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance
I20260807 22:43:26.334586 23377 external_mini_cluster.cc:1428] Setting key bcfc75012acb2837386f52eaf526c12c
I20260807 22:43:26.337944 15457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:26.328887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:56569 (local address 127.22.212.126:45651)
0807 22:43:26.328968 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:26.328971 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:26.329166 (+ 195us) server_negotiation.cc:407] Connection header received
0807 22:43:26.329641 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:26.329642 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:26.329653 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:26.329708 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:43:26.330688 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:26.331169 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:26.332148 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:26.332396 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:26.332453 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:26.334771 (+ 2318us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:43:26.334772 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:43:26.334773 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:43:26.334782 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:43:26.336547 (+ 1765us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:26.336945 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:26.336946 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:26.336947 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:26.337013 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:26.337283 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:26.337284 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:26.337284 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:26.337401 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:43:26.337481 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:26.337772 (+ 291us) server_negotiation.cc:299] Negotiation successful
0807 22:43:26.337856 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 22:43:26.338176 15926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:26.328838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.66:56569)
0807 22:43:26.329041 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:26.329078 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 22:43:26.329552 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:43:26.329794 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:43:26.329799 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:43:26.330398 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:43:26.330601 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:26.330607 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:26.331250 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:26.331251 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:26.332062 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:26.332064 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:26.332487 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:26.332487 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:26.332591 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:26.333027 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:43:26.333035 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:43:26.334606 (+ 1571us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:43:26.336640 (+ 2034us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:26.336647 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:26.336648 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:26.336866 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:26.337082 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:26.337082 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:26.337083 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:26.337180 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:26.337472 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:43:26.337479 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:43:26.337626 (+ 147us) client_negotiation.cc:769] Sending connection context
0807 22:43:26.337733 (+ 107us) client_negotiation.cc:240] Negotiation successful
0807 22:43:26.337889 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":111,"threads_started":1}
I20260807 22:43:26.338646 15922 heartbeater.cc:347] Connected to a master server at 127.22.212.126:45651
I20260807 22:43:26.338739 15922 heartbeater.cc:464] Registering TS with master...
I20260807 22:43:26.338940 15922 heartbeater.cc:511] Master 127.22.212.126:45651 requested a full tablet report, sending...
I20260807 22:43:26.339375 15391 ts_manager.cc:194] Registered new tserver with Master: b0d14a8c27a147d8ac2182c53d547010 (127.22.212.66:39333)
I20260807 22:43:26.339905 15391 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.66@KRBTEST.COM'} at 127.22.212.66:56569
WARNING: no policy specified for kudu/127.22.212.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab.
Entry for principal kudu/127.22.212.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab.
I20260807 22:43:26.364005 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.67:0
--local_ip_for_outbound_sockets=127.22.212.67
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:45651
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:35629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:43:26.447875 15936 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:43:26.448141 15936 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:43:26.448169 15936 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:43:26.449599 15936 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:43:26.449659 15936 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:43:26.449687 15936 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.67
I20260807 22:43:26.451083 15936 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:35629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:45651
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15936
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.67
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:43:26.451264 15936 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:43:26.451435 15936 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:43:26.456576 15953 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:43:26.456583 15947 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:43:26.456820 15936 server_base.cc:1034] running on GCE node
W20260807 22:43:26.456597 15948 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:43:26.457139 15936 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:43:26.457379 15936 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:43:26.458554 15936 hybrid_clock.cc:648] HybridClock initialized: now 1786142606458551 us; error 35 us; skew 500 ppm
Aug 07 22:43:26 dist-test-slave-2d19 krb5kdc[15325](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142606, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:43:26.461145 15936 init.cc:377] Logged in from keytab as kudu/127.22.212.67@KRBTEST.COM (short username kudu)
I20260807 22:43:26.461532 15936 webserver.cc:460] Webserver started at http://127.22.212.67:39781/ using document root <none> and password file <none>
I20260807 22:43:26.461706 15936 fs_manager.cc:359] Metadata directory not provided
I20260807 22:43:26.461745 15936 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:43:26.461833 15936 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:43:26.462817 15936 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/data/instance:
uuid: "68deaa8ea7584b4e9a1558e41cab1bad"
format_stamp: "Formatted at 2026-08-07 22:43:26 on dist-test-slave-2d19"
server_key: "8639ee454aaf8a389220f71becf4ddda"
server_key_iv: "ec467386b1f4b3eccb66c4decc931ad1"
server_key_version: "encryptionkey@0"
I20260807 22:43:26.463140 15936 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance:
uuid: "68deaa8ea7584b4e9a1558e41cab1bad"
format_stamp: "Formatted at 2026-08-07 22:43:26 on dist-test-slave-2d19"
server_key: "8639ee454aaf8a389220f71becf4ddda"
server_key_iv: "ec467386b1f4b3eccb66c4decc931ad1"
server_key_version: "encryptionkey@0"
I20260807 22:43:26.464525 15936 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 22:43:26.465219 15963 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:43:26.465415 15936 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 22:43:26.465505 15936 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/wal
uuid: "68deaa8ea7584b4e9a1558e41cab1bad"
format_stamp: "Formatted at 2026-08-07 22:43:26 on dist-test-slave-2d19"
server_key: "8639ee454aaf8a389220f71becf4ddda"
server_key_iv: "ec467386b1f4b3eccb66c4decc931ad1"
server_key_version: "encryptionkey@0"
I20260807 22:43:26.465560 15936 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:43:26.474072 15936 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:43:26.476394 15936 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:43:26.476509 15936 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:43:26.476693 15936 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:43:26.476934 15936 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:43:26.476962 15936 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:43:26.476984 15936 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:43:26.477010 15936 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:43:26.482847 15936 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.67:40323
I20260807 22:43:26.482963 16144 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.67:40323 every 8 connection(s)
I20260807 22:43:26.483270 15936 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
Aug 07 22:43:26 dist-test-slave-2d19 krb5kdc[15325](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142606, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:43:26.489686 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 15936
I20260807 22:43:26.489758 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance
I20260807 22:43:26.489928 23377 external_mini_cluster.cc:1428] Setting key ac13c46f6085a012b80add31c6def7f0
I20260807 22:43:26.493142 15457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:26.484052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:59529 (local address 127.22.212.126:45651)
0807 22:43:26.484140 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:26.484142 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:26.484366 (+ 224us) server_negotiation.cc:407] Connection header received
0807 22:43:26.484911 (+ 545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:26.484913 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:26.484926 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:26.484994 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:43:26.485961 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:26.486481 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:26.487479 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:26.487740 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:26.487827 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:26.490377 (+ 2550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:43:26.490380 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:43:26.490380 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:43:26.490388 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:43:26.491797 (+ 1409us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:26.492192 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:26.492193 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:26.492194 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:26.492246 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:26.492528 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:26.492528 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:26.492529 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:26.492636 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:43:26.492692 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:26.492992 (+ 300us) server_negotiation.cc:299] Negotiation successful
0807 22:43:26.493078 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 22:43:26.493355 16147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:26.484033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.67:59529)
0807 22:43:26.484192 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:26.484229 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 22:43:26.484803 (+ 574us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:43:26.485073 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:43:26.485076 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:43:26.485662 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:43:26.485854 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:26.485859 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:26.486586 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:26.486588 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:26.487380 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:26.487381 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:26.487840 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:26.487842 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:26.487970 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:26.488544 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:43:26.488552 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:43:26.490284 (+ 1732us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:43:26.491883 (+ 1599us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:26.491889 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:26.491891 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:26.492124 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:26.492358 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:26.492358 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:26.492359 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:26.492461 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:26.492721 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:43:26.492728 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:43:26.492857 (+ 129us) client_negotiation.cc:769] Sending connection context
0807 22:43:26.492975 (+ 118us) client_negotiation.cc:240] Negotiation successful
0807 22:43:26.493120 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":75,"threads_started":1}
I20260807 22:43:26.493850 16145 heartbeater.cc:347] Connected to a master server at 127.22.212.126:45651
I20260807 22:43:26.493964 16145 heartbeater.cc:464] Registering TS with master...
I20260807 22:43:26.494150 16145 heartbeater.cc:511] Master 127.22.212.126:45651 requested a full tablet report, sending...
I20260807 22:43:26.494627 15391 ts_manager.cc:194] Registered new tserver with Master: 68deaa8ea7584b4e9a1558e41cab1bad (127.22.212.67:40323)
I20260807 22:43:26.495087 15391 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.67@KRBTEST.COM'} at 127.22.212.67:59529
I20260807 22:43:26.501852 23377 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:43:26.508994 15457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:26.503286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54766 (local address 127.22.212.126:45651)
0807 22:43:26.503354 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:26.503356 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:26.503509 (+ 153us) server_negotiation.cc:407] Connection header received
0807 22:43:26.503554 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:26.503555 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:26.503564 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:26.503611 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:43:26.504114 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:26.504653 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:26.505341 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:26.505527 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:26.505575 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:26.506676 (+ 1101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:43:26.506677 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:43:26.506677 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:43:26.506683 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:43:26.507900 (+ 1217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:26.508213 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:26.508214 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:26.508214 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:26.508330 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:26.508514 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:26.508514 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:26.508514 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:26.508657 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:43:26.508733 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:26.508832 (+ 99us) server_negotiation.cc:299] Negotiation successful
0807 22:43:26.508892 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 22:43:26.510792 15391 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54766:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:43:26.512432 15391 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:43:26.519326 16166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:26.514976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.66:39333 (local address 127.0.0.1:33178)
0807 22:43:26.515393 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:26.515403 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 22:43:26.515455 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:43:26.515646 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:43:26.515650 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:43:26.515652 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:43:26.515716 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:26.515718 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:26.516766 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:26.516767 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:26.518064 (+ 1297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:26.518067 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:26.518994 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:26.518995 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:26.519071 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:26.519083 (+ 12us) client_negotiation.cc:769] Sending connection context
0807 22:43:26.519188 (+ 105us) client_negotiation.cc:240] Negotiation successful
0807 22:43:26.519248 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":399,"mutex_wait_us":5,"thread_start_us":53,"threads_started":1}
I20260807 22:43:26.519340 16167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:26.515114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33178 (local address 127.22.212.66:39333)
0807 22:43:26.515342 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:26.515348 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:26.515460 (+ 112us) server_negotiation.cc:407] Connection header received
0807 22:43:26.515529 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:26.515531 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:26.515546 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:26.515623 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:43:26.515801 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:26.516634 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:26.518165 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:26.518908 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:26.518977 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:26.519049 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:26.519210 (+ 161us) server_negotiation.cc:299] Negotiation successful
0807 22:43:26.519257 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":99,"threads_started":1}
I20260807 22:43:26.519851 16170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:26.515384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57482 (local address 127.22.212.67:40323)
0807 22:43:26.516390 (+ 1006us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:26.516394 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:26.516405 (+ 11us) server_negotiation.cc:407] Connection header received
0807 22:43:26.516449 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:26.516451 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:26.516465 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:26.516586 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:43:26.516736 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:26.517474 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:26.518792 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:26.519474 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:26.519588 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:26.519643 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:26.519725 (+ 82us) server_negotiation.cc:299] Negotiation successful
0807 22:43:26.519761 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":967,"thread_start_us":86,"threads_started":1}
I20260807 22:43:26.520376 16169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:26.515202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57284 (local address 127.22.212.65:41521)
0807 22:43:26.515594 (+ 392us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:26.515604 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:26.515632 (+ 28us) server_negotiation.cc:407] Connection header received
0807 22:43:26.515675 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:26.515677 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:26.515693 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:26.515777 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:43:26.515859 (+ 82us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:26.516873 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:26.519087 (+ 2214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:26.519804 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:26.520070 (+ 266us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:26.520141 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:26.520213 (+ 72us) server_negotiation.cc:299] Negotiation successful
0807 22:43:26.520293 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":75,"threads_started":1}
I20260807 22:43:26.520397 15814 tablet_service.cc:1467] Processing CreateTablet for tablet 4e4360fbaa2d416d932a4af6a8dd77af (DEFAULT_TABLE table=test-table [id=43dfa2b0c48741278932ff17055b6874]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:43:26.520813 15814 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e4360fbaa2d416d932a4af6a8dd77af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:43:26.523526 16173 tablet_bootstrap.cc:492] T 4e4360fbaa2d416d932a4af6a8dd77af P b0d14a8c27a147d8ac2182c53d547010: Bootstrap starting.
I20260807 22:43:26.523584 16168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:26.515188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.67:40323 (local address 127.0.0.1:57482)
0807 22:43:26.515407 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:26.515418 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 22:43:26.515474 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:43:26.516614 (+ 1140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:43:26.516615 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:43:26.516618 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:43:26.516669 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:26.516671 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:26.517664 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:26.517665 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:26.518685 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:26.518688 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:26.519595 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:26.519596 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:26.519655 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:26.519659 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 22:43:26.519715 (+ 56us) client_negotiation.cc:240] Negotiation successful
0807 22:43:26.523481 (+ 3766us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":75,"threads_started":1}
I20260807 22:43:26.523715 16165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:26.514976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:41521 (local address 127.0.0.1:57284)
0807 22:43:26.515211 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:26.515255 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 22:43:26.515332 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:43:26.515773 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:43:26.515774 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:43:26.515776 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:43:26.515807 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:26.515808 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:26.516981 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:26.516982 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:26.518064 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:26.518067 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:26.520075 (+ 2008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:26.520076 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:26.520138 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:26.520142 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 22:43:26.520203 (+ 61us) client_negotiation.cc:240] Negotiation successful
0807 22:43:26.523487 (+ 3284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"mutex_wait_us":3240,"thread_start_us":110,"threads_started":1}
I20260807 22:43:26.524389 16173 tablet_bootstrap.cc:654] T 4e4360fbaa2d416d932a4af6a8dd77af P b0d14a8c27a147d8ac2182c53d547010: Neither blocks nor log segments found. Creating new log.
I20260807 22:43:26.524302 16033 tablet_service.cc:1467] Processing CreateTablet for tablet 4e4360fbaa2d416d932a4af6a8dd77af (DEFAULT_TABLE table=test-table [id=43dfa2b0c48741278932ff17055b6874]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:43:26.524474 15590 tablet_service.cc:1467] Processing CreateTablet for tablet 4e4360fbaa2d416d932a4af6a8dd77af (DEFAULT_TABLE table=test-table [id=43dfa2b0c48741278932ff17055b6874]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:43:26.524638 16033 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e4360fbaa2d416d932a4af6a8dd77af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:43:26.524879 15590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e4360fbaa2d416d932a4af6a8dd77af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:43:26.525008 16173 log.cc:824] T 4e4360fbaa2d416d932a4af6a8dd77af P b0d14a8c27a147d8ac2182c53d547010: Log is configured to *not* fsync() on all Append() calls
I20260807 22:43:26.525874 16173 tablet_bootstrap.cc:492] T 4e4360fbaa2d416d932a4af6a8dd77af P b0d14a8c27a147d8ac2182c53d547010: No bootstrap required, opened a new log
I20260807 22:43:26.525954 16173 ts_tablet_manager.cc:1397] T 4e4360fbaa2d416d932a4af6a8dd77af P b0d14a8c27a147d8ac2182c53d547010: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260807 22:43:26.527552 16177 tablet_bootstrap.cc:492] T 4e4360fbaa2d416d932a4af6a8dd77af P 68deaa8ea7584b4e9a1558e41cab1bad: Bootstrap starting.
I20260807 22:43:26.528097 16173 raft_consensus.cc:348] T 4e4360fbaa2d416d932a4af6a8dd77af P b0d14a8c27a147d8ac2182c53d547010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12a897c2d39d4336ab0962100ec3f908" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 41521 } } peers { permanent_uuid: "b0d14a8c27a147d8ac2182c53d547010" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 39333 } } peers { permanent_uuid: "68deaa8ea7584b4e9a1558e41cab1bad" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 40323 } }
I20260807 22:43:26.528230 16178 tablet_bootstrap.cc:492] T 4e4360fbaa2d416d932a4af6a8dd77af P 12a897c2d39d4336ab0962100ec3f908: Bootstrap starting.
I20260807 22:43:26.528322 16173 raft_consensus.cc:374] T 4e4360fbaa2d416d932a4af6a8dd77af P b0d14a8c27a147d8ac2182c53d547010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:43:26.528379 16173 raft_consensus.cc:729] T 4e4360fbaa2d416d932a4af6a8dd77af P b0d14a8c27a147d8ac2182c53d547010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0d14a8c27a147d8ac2182c53d547010, State: Initialized, Role: FOLLOWER
I20260807 22:43:26.528519 16177 tablet_bootstrap.cc:654] T 4e4360fbaa2d416d932a4af6a8dd77af P 68deaa8ea7584b4e9a1558e41cab1bad: Neither blocks nor log segments found. Creating new log.
I20260807 22:43:26.528527 16173 consensus_queue.cc:260] T 4e4360fbaa2d416d932a4af6a8dd77af P b0d14a8c27a147d8ac2182c53d547010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12a897c2d39d4336ab0962100ec3f908" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 41521 } } peers { permanent_uuid: "b0d14a8c27a147d8ac2182c53d547010" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 39333 } } peers { permanent_uuid: "68deaa8ea7584b4e9a1558e41cab1bad" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 40323 } }
I20260807 22:43:26.528808 16173 ts_tablet_manager.cc:1428] T 4e4360fbaa2d416d932a4af6a8dd77af P b0d14a8c27a147d8ac2182c53d547010: Time spent starting tablet: real 0.003s user 0.003s sys 0.001s
I20260807 22:43:26.528952 15922 heartbeater.cc:503] Master 127.22.212.126:45651 was elected leader, sending a full tablet report...
I20260807 22:43:26.528988 16178 tablet_bootstrap.cc:654] T 4e4360fbaa2d416d932a4af6a8dd77af P 12a897c2d39d4336ab0962100ec3f908: Neither blocks nor log segments found. Creating new log.
I20260807 22:43:26.529114 16177 log.cc:824] T 4e4360fbaa2d416d932a4af6a8dd77af P 68deaa8ea7584b4e9a1558e41cab1bad: Log is configured to *not* fsync() on all Append() calls
I20260807 22:43:26.529546 16178 log.cc:824] T 4e4360fbaa2d416d932a4af6a8dd77af P 12a897c2d39d4336ab0962100ec3f908: Log is configured to *not* fsync() on all Append() calls
I20260807 22:43:26.530117 16177 tablet_bootstrap.cc:492] T 4e4360fbaa2d416d932a4af6a8dd77af P 68deaa8ea7584b4e9a1558e41cab1bad: No bootstrap required, opened a new log
I20260807 22:43:26.530192 16177 ts_tablet_manager.cc:1397] T 4e4360fbaa2d416d932a4af6a8dd77af P 68deaa8ea7584b4e9a1558e41cab1bad: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260807 22:43:26.530336 16178 tablet_bootstrap.cc:492] T 4e4360fbaa2d416d932a4af6a8dd77af P 12a897c2d39d4336ab0962100ec3f908: No bootstrap required, opened a new log
I20260807 22:43:26.530414 16178 ts_tablet_manager.cc:1397] T 4e4360fbaa2d416d932a4af6a8dd77af P 12a897c2d39d4336ab0962100ec3f908: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260807 22:43:26.531600 16177 raft_consensus.cc:348] T 4e4360fbaa2d416d932a4af6a8dd77af P 68deaa8ea7584b4e9a1558e41cab1bad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12a897c2d39d4336ab0962100ec3f908" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 41521 } } peers { permanent_uuid: "b0d14a8c27a147d8ac2182c53d547010" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 39333 } } peers { permanent_uuid: "68deaa8ea7584b4e9a1558e41cab1bad" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 40323 } }
I20260807 22:43:26.531759 16177 raft_consensus.cc:374] T 4e4360fbaa2d416d932a4af6a8dd77af P 68deaa8ea7584b4e9a1558e41cab1bad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:43:26.531807 16177 raft_consensus.cc:729] T 4e4360fbaa2d416d932a4af6a8dd77af P 68deaa8ea7584b4e9a1558e41cab1bad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68deaa8ea7584b4e9a1558e41cab1bad, State: Initialized, Role: FOLLOWER
I20260807 22:43:26.531816 16178 raft_consensus.cc:348] T 4e4360fbaa2d416d932a4af6a8dd77af P 12a897c2d39d4336ab0962100ec3f908 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12a897c2d39d4336ab0962100ec3f908" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 41521 } } peers { permanent_uuid: "b0d14a8c27a147d8ac2182c53d547010" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 39333 } } peers { permanent_uuid: "68deaa8ea7584b4e9a1558e41cab1bad" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 40323 } }
I20260807 22:43:26.531942 16177 consensus_queue.cc:260] T 4e4360fbaa2d416d932a4af6a8dd77af P 68deaa8ea7584b4e9a1558e41cab1bad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12a897c2d39d4336ab0962100ec3f908" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 41521 } } peers { permanent_uuid: "b0d14a8c27a147d8ac2182c53d547010" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 39333 } } peers { permanent_uuid: "68deaa8ea7584b4e9a1558e41cab1bad" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 40323 } }
I20260807 22:43:26.532009 16178 raft_consensus.cc:374] T 4e4360fbaa2d416d932a4af6a8dd77af P 12a897c2d39d4336ab0962100ec3f908 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:43:26.532037 16178 raft_consensus.cc:729] T 4e4360fbaa2d416d932a4af6a8dd77af P 12a897c2d39d4336ab0962100ec3f908 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12a897c2d39d4336ab0962100ec3f908, State: Initialized, Role: FOLLOWER
I20260807 22:43:26.532171 16178 consensus_queue.cc:260] T 4e4360fbaa2d416d932a4af6a8dd77af P 12a897c2d39d4336ab0962100ec3f908 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12a897c2d39d4336ab0962100ec3f908" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 41521 } } peers { permanent_uuid: "b0d14a8c27a147d8ac2182c53d547010" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 39333 } } peers { permanent_uuid: "68deaa8ea7584b4e9a1558e41cab1bad" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 40323 } }
I20260807 22:43:26.532248 16177 ts_tablet_manager.cc:1428] T 4e4360fbaa2d416d932a4af6a8dd77af P 68deaa8ea7584b4e9a1558e41cab1bad: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260807 22:43:26.532318 16145 heartbeater.cc:503] Master 127.22.212.126:45651 was elected leader, sending a full tablet report...
I20260807 22:43:26.532497 15699 heartbeater.cc:503] Master 127.22.212.126:45651 was elected leader, sending a full tablet report...
I20260807 22:43:26.532498 16178 ts_tablet_manager.cc:1428] T 4e4360fbaa2d416d932a4af6a8dd77af P 12a897c2d39d4336ab0962100ec3f908: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
W20260807 22:43:26.578588 15923 tablet.cc:2369] T 4e4360fbaa2d416d932a4af6a8dd77af P b0d14a8c27a147d8ac2182c53d547010: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 22:43:26.651265 15701 tablet.cc:2369] T 4e4360fbaa2d416d932a4af6a8dd77af P 12a897c2d39d4336ab0962100ec3f908: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 22:43:26.733893 16146 tablet.cc:2369] T 4e4360fbaa2d416d932a4af6a8dd77af P 68deaa8ea7584b4e9a1558e41cab1bad: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:43:26.805707 16181 raft_consensus.cc:482] T 4e4360fbaa2d416d932a4af6a8dd77af P b0d14a8c27a147d8ac2182c53d547010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:43:26.805842 16181 raft_consensus.cc:504] T 4e4360fbaa2d416d932a4af6a8dd77af P b0d14a8c27a147d8ac2182c53d547010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12a897c2d39d4336ab0962100ec3f908" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 41521 } } peers { permanent_uuid: "b0d14a8c27a147d8ac2182c53d547010" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 39333 } } peers { permanent_uuid: "68deaa8ea7584b4e9a1558e41cab1bad" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 40323 } }
I20260807 22:43:26.806277 16181 leader_election.cc:288] T 4e4360fbaa2d416d932a4af6a8dd77af P b0d14a8c27a147d8ac2182c53d547010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 12a897c2d39d4336ab0962100ec3f908 (127.22.212.65:41521), 68deaa8ea7584b4e9a1558e41cab1bad (127.22.212.67:40323)
I20260807 22:43:26.809738 16170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:26.806748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:52489 (local address 127.22.212.67:40323)
0807 22:43:26.806823 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:26.806825 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:26.806834 (+ 9us) server_negotiation.cc:407] Connection header received
0807 22:43:26.806867 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:26.806868 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:26.806877 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:26.806945 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:43:26.807124 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:26.807585 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:26.808786 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:26.809376 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:26.809447 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:26.809457 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:26.809639 (+ 182us) server_negotiation.cc:299] Negotiation successful
0807 22:43:26.809675 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 22:43:26.809738 15926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:26.806485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:41521 (local address 127.22.212.66:37835)
0807 22:43:26.806565 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:26.806578 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:43:26.806626 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:43:26.806861 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:43:26.806862 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:43:26.806864 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:43:26.806948 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:26.806950 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:26.807630 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:26.807631 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:26.808642 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:26.808646 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:26.809431 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:26.809432 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:26.809571 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:26.809574 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:43:26.809625 (+ 51us) client_negotiation.cc:240] Negotiation successful
0807 22:43:26.809666 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56,"mutex_wait_us":29}
I20260807 22:43:26.809815 16169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:26.806648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:37835 (local address 127.22.212.65:41521)
0807 22:43:26.806707 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:26.806709 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:26.806721 (+ 12us) server_negotiation.cc:407] Connection header received
0807 22:43:26.806756 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:26.806757 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:26.806768 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:26.806850 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:43:26.807028 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:26.807539 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:26.808759 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:26.809355 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:26.809435 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:26.809447 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:26.809645 (+ 198us) server_negotiation.cc:299] Negotiation successful
0807 22:43:26.809714 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260807 22:43:26.810124 16188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:26.806643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.67:40323 (local address 127.22.212.66:52489)
0807 22:43:26.806734 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:26.806743 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 22:43:26.806810 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:43:26.806966 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:43:26.806967 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:43:26.806969 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:43:26.807047 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:26.807049 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:26.807672 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:26.807674 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:26.808673 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:26.808676 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:26.809486 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:26.809486 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:26.809550 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:26.809553 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:43:26.809962 (+ 409us) client_negotiation.cc:240] Negotiation successful
0807 22:43:26.810019 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":81,"thread_start_us":63,"threads_started":1}
I20260807 22:43:26.810647 16071 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e4360fbaa2d416d932a4af6a8dd77af" candidate_uuid: "b0d14a8c27a147d8ac2182c53d547010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68deaa8ea7584b4e9a1558e41cab1bad" is_pre_election: true
I20260807 22:43:26.810854 16071 raft_consensus.cc:2454] T 4e4360fbaa2d416d932a4af6a8dd77af P 68deaa8ea7584b4e9a1558e41cab1bad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0d14a8c27a147d8ac2182c53d547010 in term 0.
I20260807 22:43:26.810508 15629 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e4360fbaa2d416d932a4af6a8dd77af" candidate_uuid: "b0d14a8c27a147d8ac2182c53d547010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12a897c2d39d4336ab0962100ec3f908" is_pre_election: true
I20260807 22:43:26.811190 15738 leader_election.cc:302] T 4e4360fbaa2d416d932a4af6a8dd77af P b0d14a8c27a147d8ac2182c53d547010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68deaa8ea7584b4e9a1558e41cab1bad, b0d14a8c27a147d8ac2182c53d547010; no voters:
I20260807 22:43:26.811354 16181 raft_consensus.cc:2781] T 4e4360fbaa2d416d932a4af6a8dd77af P b0d14a8c27a147d8ac2182c53d547010 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:43:26.811460 16181 raft_consensus.cc:482] T 4e4360fbaa2d416d932a4af6a8dd77af P b0d14a8c27a147d8ac2182c53d547010 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:43:26.811493 16181 raft_consensus.cc:3037] T 4e4360fbaa2d416d932a4af6a8dd77af P b0d14a8c27a147d8ac2182c53d547010 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:43:26.812405 15629 raft_consensus.cc:2454] T 4e4360fbaa2d416d932a4af6a8dd77af P 12a897c2d39d4336ab0962100ec3f908 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0d14a8c27a147d8ac2182c53d547010 in term 0.
I20260807 22:43:26.812697 16181 raft_consensus.cc:504] T 4e4360fbaa2d416d932a4af6a8dd77af P b0d14a8c27a147d8ac2182c53d547010 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12a897c2d39d4336ab0962100ec3f908" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 41521 } } peers { permanent_uuid: "b0d14a8c27a147d8ac2182c53d547010" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 39333 } } peers { permanent_uuid: "68deaa8ea7584b4e9a1558e41cab1bad" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 40323 } }
I20260807 22:43:26.812847 16181 leader_election.cc:288] T 4e4360fbaa2d416d932a4af6a8dd77af P b0d14a8c27a147d8ac2182c53d547010 [CANDIDATE]: Term 1 election: Requested vote from peers 12a897c2d39d4336ab0962100ec3f908 (127.22.212.65:41521), 68deaa8ea7584b4e9a1558e41cab1bad (127.22.212.67:40323)
I20260807 22:43:26.813088 15629 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e4360fbaa2d416d932a4af6a8dd77af" candidate_uuid: "b0d14a8c27a147d8ac2182c53d547010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12a897c2d39d4336ab0962100ec3f908"
I20260807 22:43:26.813151 16071 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e4360fbaa2d416d932a4af6a8dd77af" candidate_uuid: "b0d14a8c27a147d8ac2182c53d547010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68deaa8ea7584b4e9a1558e41cab1bad"
I20260807 22:43:26.813189 15629 raft_consensus.cc:3037] T 4e4360fbaa2d416d932a4af6a8dd77af P 12a897c2d39d4336ab0962100ec3f908 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:43:26.813238 16071 raft_consensus.cc:3037] T 4e4360fbaa2d416d932a4af6a8dd77af P 68deaa8ea7584b4e9a1558e41cab1bad [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:43:26.814162 16071 raft_consensus.cc:2454] T 4e4360fbaa2d416d932a4af6a8dd77af P 68deaa8ea7584b4e9a1558e41cab1bad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0d14a8c27a147d8ac2182c53d547010 in term 1.
I20260807 22:43:26.814162 15629 raft_consensus.cc:2454] T 4e4360fbaa2d416d932a4af6a8dd77af P 12a897c2d39d4336ab0962100ec3f908 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0d14a8c27a147d8ac2182c53d547010 in term 1.
I20260807 22:43:26.814345 15738 leader_election.cc:302] T 4e4360fbaa2d416d932a4af6a8dd77af P b0d14a8c27a147d8ac2182c53d547010 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12a897c2d39d4336ab0962100ec3f908, b0d14a8c27a147d8ac2182c53d547010; no voters:
I20260807 22:43:26.814541 16181 raft_consensus.cc:2781] T 4e4360fbaa2d416d932a4af6a8dd77af P b0d14a8c27a147d8ac2182c53d547010 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:43:26.814751 16181 raft_consensus.cc:686] T 4e4360fbaa2d416d932a4af6a8dd77af P b0d14a8c27a147d8ac2182c53d547010 [term 1 LEADER]: Becoming Leader. State: Replica: b0d14a8c27a147d8ac2182c53d547010, State: Running, Role: LEADER
I20260807 22:43:26.814858 16181 consensus_queue.cc:237] T 4e4360fbaa2d416d932a4af6a8dd77af P b0d14a8c27a147d8ac2182c53d547010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12a897c2d39d4336ab0962100ec3f908" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 41521 } } peers { permanent_uuid: "b0d14a8c27a147d8ac2182c53d547010" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 39333 } } peers { permanent_uuid: "68deaa8ea7584b4e9a1558e41cab1bad" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 40323 } }
I20260807 22:43:26.815961 15388 catalog_manager.cc:5495] T 4e4360fbaa2d416d932a4af6a8dd77af P b0d14a8c27a147d8ac2182c53d547010 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0d14a8c27a147d8ac2182c53d547010 (127.22.212.66). New cstate: current_term: 1 leader_uuid: "b0d14a8c27a147d8ac2182c53d547010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12a897c2d39d4336ab0962100ec3f908" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 41521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0d14a8c27a147d8ac2182c53d547010" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 39333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68deaa8ea7584b4e9a1558e41cab1bad" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 40323 } health_report { overall_health: UNKNOWN } } }
I20260807 22:43:26.871728 16167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:26.869214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33186 (local address 127.22.212.66:39333)
0807 22:43:26.869273 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:26.869275 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:26.869285 (+ 10us) server_negotiation.cc:407] Connection header received
0807 22:43:26.869350 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:26.869351 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:26.869401 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:26.869490 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:43:26.869647 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:26.870131 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:26.870911 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:26.871126 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:26.871202 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:26.871368 (+ 166us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:43:26.871483 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:43:26.871573 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:26.871595 (+ 22us) server_negotiation.cc:299] Negotiation successful
0807 22:43:26.871616 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260807 22:43:26.873611 16071 raft_consensus.cc:1261] T 4e4360fbaa2d416d932a4af6a8dd77af P 68deaa8ea7584b4e9a1558e41cab1bad [term 1 FOLLOWER]: Refusing update from remote peer b0d14a8c27a147d8ac2182c53d547010: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:43:26.873675 15629 raft_consensus.cc:1261] T 4e4360fbaa2d416d932a4af6a8dd77af P 12a897c2d39d4336ab0962100ec3f908 [term 1 FOLLOWER]: Refusing update from remote peer b0d14a8c27a147d8ac2182c53d547010: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:43:26.873979 16181 consensus_queue.cc:1035] T 4e4360fbaa2d416d932a4af6a8dd77af P b0d14a8c27a147d8ac2182c53d547010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68deaa8ea7584b4e9a1558e41cab1bad" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:43:26.874140 16190 consensus_queue.cc:1035] T 4e4360fbaa2d416d932a4af6a8dd77af P b0d14a8c27a147d8ac2182c53d547010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12a897c2d39d4336ab0962100ec3f908" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 41521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:43:26.876888 16200 mvcc.cc:205] Tried to move back new op lower bound from 7316040117751582720 to 7316040117514559488. Current Snapshot: MvccSnapshot[applied={T|T < 7316040117751582720}]
I20260807 22:43:26.877205 16199 mvcc.cc:205] Tried to move back new op lower bound from 7316040117751582720 to 7316040117514559488. Current Snapshot: MvccSnapshot[applied={T|T < 7316040117751582720 or (T in {7316040117751582720})}]
I20260807 22:43:26.879350 15388 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54766:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:43:26.879453 15388 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54766:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:43:26.880223 15388 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245: Sending DeleteTablet for 3 replicas of tablet 4e4360fbaa2d416d932a4af6a8dd77af
I20260807 22:43:26.880621 15590 tablet_service.cc:1514] Processing DeleteTablet for tablet 4e4360fbaa2d416d932a4af6a8dd77af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:43:26 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:57284
I20260807 22:43:26.880648 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 15489
I20260807 22:43:26.880648 16033 tablet_service.cc:1514] Processing DeleteTablet for tablet 4e4360fbaa2d416d932a4af6a8dd77af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:43:26 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:57482
I20260807 22:43:26.883289 15814 tablet_service.cc:1514] Processing DeleteTablet for tablet 4e4360fbaa2d416d932a4af6a8dd77af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:43:26 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:33178
I20260807 22:43:26.886338 16214 tablet_replica.cc:330] T 4e4360fbaa2d416d932a4af6a8dd77af P 68deaa8ea7584b4e9a1558e41cab1bad: stopping tablet replica
I20260807 22:43:26.886569 16214 raft_consensus.cc:2229] T 4e4360fbaa2d416d932a4af6a8dd77af P 68deaa8ea7584b4e9a1558e41cab1bad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:43:26.886803 16214 raft_consensus.cc:2258] T 4e4360fbaa2d416d932a4af6a8dd77af P 68deaa8ea7584b4e9a1558e41cab1bad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:43:26.888549 16214 ts_tablet_manager.cc:1905] T 4e4360fbaa2d416d932a4af6a8dd77af P 68deaa8ea7584b4e9a1558e41cab1bad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:43:26.891053 16214 ts_tablet_manager.cc:1918] T 4e4360fbaa2d416d932a4af6a8dd77af P 68deaa8ea7584b4e9a1558e41cab1bad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:43:26.891201 16214 log.cc:1196] T 4e4360fbaa2d416d932a4af6a8dd77af P 68deaa8ea7584b4e9a1558e41cab1bad: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/wal/wals/4e4360fbaa2d416d932a4af6a8dd77af
I20260807 22:43:26.891455 16216 tablet_replica.cc:330] T 4e4360fbaa2d416d932a4af6a8dd77af P b0d14a8c27a147d8ac2182c53d547010: stopping tablet replica
I20260807 22:43:26.891602 16216 raft_consensus.cc:2229] T 4e4360fbaa2d416d932a4af6a8dd77af P b0d14a8c27a147d8ac2182c53d547010 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:43:26.891716 16214 ts_tablet_manager.cc:1939] T 4e4360fbaa2d416d932a4af6a8dd77af P 68deaa8ea7584b4e9a1558e41cab1bad: Deleting consensus metadata
I20260807 22:43:26.891758 16216 raft_consensus.cc:2258] T 4e4360fbaa2d416d932a4af6a8dd77af P b0d14a8c27a147d8ac2182c53d547010 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:43:26.892333 16216 ts_tablet_manager.cc:1905] T 4e4360fbaa2d416d932a4af6a8dd77af P b0d14a8c27a147d8ac2182c53d547010: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:43:26.892316 15368 catalog_manager.cc:4841] TS 68deaa8ea7584b4e9a1558e41cab1bad (127.22.212.67:40323): tablet 4e4360fbaa2d416d932a4af6a8dd77af (table test-table [id=43dfa2b0c48741278932ff17055b6874]) successfully deleted
I20260807 22:43:26.893930 16216 ts_tablet_manager.cc:1918] T 4e4360fbaa2d416d932a4af6a8dd77af P b0d14a8c27a147d8ac2182c53d547010: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:43:26.894011 16216 log.cc:1196] T 4e4360fbaa2d416d932a4af6a8dd77af P b0d14a8c27a147d8ac2182c53d547010: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-1/wal/wals/4e4360fbaa2d416d932a4af6a8dd77af
I20260807 22:43:26.894266 16216 ts_tablet_manager.cc:1939] T 4e4360fbaa2d416d932a4af6a8dd77af P b0d14a8c27a147d8ac2182c53d547010: Deleting consensus metadata
I20260807 22:43:26.894754 15367 catalog_manager.cc:4841] TS b0d14a8c27a147d8ac2182c53d547010 (127.22.212.66:39333): tablet 4e4360fbaa2d416d932a4af6a8dd77af (table test-table [id=43dfa2b0c48741278932ff17055b6874]) successfully deleted
W20260807 22:43:26.899622 15368 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.212.65:41521 (error 108)
I20260807 22:43:26.899803 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 15708
I20260807 22:43:26.904220 16168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:26.904086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:41521 (local address 127.0.0.1:57298)
0807 22:43:26.904137 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:26.904179 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.65:41521: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260807 22:43:26.904373 15368 catalog_manager.cc:4584] TS 12a897c2d39d4336ab0962100ec3f908 (127.22.212.65:41521): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4e4360fbaa2d416d932a4af6a8dd77af: Network error: Client connection negotiation failed: client connection to 127.22.212.65:41521: connect: Connection refused (error 111)
I20260807 22:43:26.912432 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 15936
I20260807 22:43:26.919875 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 15348
I20260807 22:43:46.930733 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:45651
--webserver_interface=127.22.212.126
--webserver_port=40795
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:35629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:45651
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:43:47.038794 16218 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:43:47.039007 16218 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:43:47.039042 16218 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:43:47.040144 16218 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 22:43:47.040180 16218 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 22:43:47.040194 16218 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 22:43:47.040205 16218 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:43:47.040217 16218 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:43:47.040230 16218 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:43:47.040242 16218 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:43:47.040273 16218 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:43:47.041767 16218 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:35629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:45651
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:45651
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=40795
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16218
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:43:47.041971 16218 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:43:47.042163 16218 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:43:47.051801 16225 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:43:47.052222 16218 server_base.cc:1034] running on GCE node
W20260807 22:43:47.051802 16227 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:43:47.051882 16232 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:43:47.054514 16218 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:43:47.054870 16218 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:43:47.056061 16218 hybrid_clock.cc:648] HybridClock initialized: now 1786142627056049 us; error 46 us; skew 500 ppm
Aug 07 22:43:47 dist-test-slave-2d19 krb5kdc[15325](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142627, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:43:47.058758 16218 init.cc:377] Logged in from keytab as kudu/127.22.212.126@KRBTEST.COM (short username kudu)
I20260807 22:43:47.059293 16218 webserver.cc:460] Webserver started at http://127.22.212.126:40795/ using document root <none> and password file <none>
I20260807 22:43:47.059537 16218 fs_manager.cc:359] Metadata directory not provided
I20260807 22:43:47.059597 16218 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:43:47.061098 16218 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260807 22:43:47.061837 16241 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:43:47.062132 16218 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:43:47.062223 16218 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "475450f7eff24c1d868f703ebd215245"
format_stamp: "Formatted at 2026-08-07 22:43:25 on dist-test-slave-2d19"
server_key: "bc45ebe01c18bb6ad4d65b74a26233fd"
server_key_iv: "998afd6d91564d2049bc7670fd16719a"
server_key_version: "encryptionkey@0"
I20260807 22:43:47.062634 16218 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:43:47.087666 16218 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:43:47.090143 16218 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:43:47.090267 16218 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:43:47.094542 16218 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:45651
I20260807 22:43:47.094576 16313 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:45651 every 8 connection(s)
I20260807 22:43:47.095007 16218 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:43:47.096698 16314 sys_catalog.cc:263] Verifying existing consensus state
I20260807 22:43:47.097419 16314 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245: Bootstrap starting.
I20260807 22:43:47.099952 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 16218
I20260807 22:43:47.100240 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.65:41521
--local_ip_for_outbound_sockets=127.22.212.65
--tserver_master_addrs=127.22.212.126:45651
--webserver_port=33497
--webserver_interface=127.22.212.65
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:35629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:43:47.107401 16314 log.cc:824] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245: Log is configured to *not* fsync() on all Append() calls
I20260807 22:43:47.110332 16314 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 22:43:47.110742 16314 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245: Bootstrap complete.
I20260807 22:43:47.114619 16314 raft_consensus.cc:348] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "475450f7eff24c1d868f703ebd215245" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 45651 } }
I20260807 22:43:47.114933 16314 raft_consensus.cc:729] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 475450f7eff24c1d868f703ebd215245, State: Initialized, Role: FOLLOWER
I20260807 22:43:47.115092 16314 consensus_queue.cc:260] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "475450f7eff24c1d868f703ebd215245" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 45651 } }
I20260807 22:43:47.115170 16314 raft_consensus.cc:388] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:43:47.115221 16314 raft_consensus.cc:482] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:43:47.115264 16314 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [term 1 FOLLOWER]: Advancing to term 2
I20260807 22:43:47.116614 16314 raft_consensus.cc:504] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "475450f7eff24c1d868f703ebd215245" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 45651 } }
I20260807 22:43:47.116724 16314 leader_election.cc:302] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 475450f7eff24c1d868f703ebd215245; no voters:
I20260807 22:43:47.116881 16314 leader_election.cc:288] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 22:43:47.116966 16322 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 22:43:47.117133 16322 raft_consensus.cc:686] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [term 2 LEADER]: Becoming Leader. State: Replica: 475450f7eff24c1d868f703ebd215245, State: Running, Role: LEADER
I20260807 22:43:47.117139 16314 sys_catalog.cc:564] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:43:47.118403 16322 consensus_queue.cc:237] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "475450f7eff24c1d868f703ebd215245" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 45651 } }
I20260807 22:43:47.118906 16325 sys_catalog.cc:455] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "475450f7eff24c1d868f703ebd215245" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "475450f7eff24c1d868f703ebd215245" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 45651 } } }
I20260807 22:43:47.118993 16325 sys_catalog.cc:458] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [sys.catalog]: This master's current role is: LEADER
I20260807 22:43:47.119195 16344 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:43:47.119184 16326 sys_catalog.cc:455] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 475450f7eff24c1d868f703ebd215245. Latest consensus state: current_term: 2 leader_uuid: "475450f7eff24c1d868f703ebd215245" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "475450f7eff24c1d868f703ebd215245" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 45651 } } }
I20260807 22:43:47.119297 16326 sys_catalog.cc:458] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [sys.catalog]: This master's current role is: LEADER
I20260807 22:43:47.120038 16344 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:43:47.120144 16344 catalog_manager.cc:1259] Loaded cluster ID: ce9385cf7b8f46c29925d22b7f447973
I20260807 22:43:47.120180 16344 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:43:47.121343 16344 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:43:47.121543 16344 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245: Loaded TSK: 0
I20260807 22:43:47.138080 16344 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245: Generated new TSK 1
I20260807 22:43:47.138200 16344 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 22:43:47.191206 16318 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:43:47.191455 16318 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:43:47.191499 16318 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:43:47.192804 16318 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:43:47.192867 16318 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:43:47.192911 16318 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.65
I20260807 22:43:47.194408 16318 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:35629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.65:41521
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.212.65
--webserver_port=33497
--tserver_master_addrs=127.22.212.126:45651
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16318
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.65
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:43:47.194667 16318 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:43:47.194904 16318 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:43:47.201581 16359 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:43:47.201588 16364 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:43:47.201594 16362 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:43:47.201879 16318 server_base.cc:1034] running on GCE node
I20260807 22:43:47.202116 16318 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:43:47.202365 16318 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:43:47.203534 16318 hybrid_clock.cc:648] HybridClock initialized: now 1786142627203520 us; error 35 us; skew 500 ppm
Aug 07 22:43:47 dist-test-slave-2d19 krb5kdc[15325](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142627, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:43:47.206140 16318 init.cc:377] Logged in from keytab as kudu/127.22.212.65@KRBTEST.COM (short username kudu)
I20260807 22:43:47.206687 16318 webserver.cc:460] Webserver started at http://127.22.212.65:33497/ using document root <none> and password file <none>
I20260807 22:43:47.206947 16318 fs_manager.cc:359] Metadata directory not provided
I20260807 22:43:47.207010 16318 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:43:47.208428 16318 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260807 22:43:47.209153 16381 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:43:47.209352 16318 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:43:47.209474 16318 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-0/wal
uuid: "12a897c2d39d4336ab0962100ec3f908"
format_stamp: "Formatted at 2026-08-07 22:43:26 on dist-test-slave-2d19"
server_key: "44995e339fbed6358d194397ec8134ec"
server_key_iv: "350beb061a87a4278650d62955249872"
server_key_version: "encryptionkey@0"
I20260807 22:43:47.209844 16318 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:43:47.232030 16318 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:43:47.235178 16318 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:43:47.235347 16318 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:43:47.235689 16318 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:43:47.236791 16395 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 22:43:47.239019 16318 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 22:43:47.239092 16318 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.003s user 0.000s sys 0.000s
I20260807 22:43:47.239140 16318 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 22:43:47.239825 16318 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 22:43:47.239881 16318 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260807 22:43:47.239986 16395 tablet_bootstrap.cc:492] T 4e4360fbaa2d416d932a4af6a8dd77af P 12a897c2d39d4336ab0962100ec3f908: Bootstrap starting.
I20260807 22:43:47.247607 16318 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.65:41521
I20260807 22:43:47.248091 16318 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
I20260807 22:43:47.248652 16568 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.65:41521 every 8 connection(s)
I20260807 22:43:47.251611 16395 log.cc:824] T 4e4360fbaa2d416d932a4af6a8dd77af P 12a897c2d39d4336ab0962100ec3f908: Log is configured to *not* fsync() on all Append() calls
I20260807 22:43:47.254729 16395 tablet_bootstrap.cc:492] T 4e4360fbaa2d416d932a4af6a8dd77af P 12a897c2d39d4336ab0962100ec3f908: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 22:43:47.255177 16395 tablet_bootstrap.cc:492] T 4e4360fbaa2d416d932a4af6a8dd77af P 12a897c2d39d4336ab0962100ec3f908: Bootstrap complete.
Aug 07 22:43:47 dist-test-slave-2d19 krb5kdc[15325](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142627, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:43:47.256570 16395 ts_tablet_manager.cc:1397] T 4e4360fbaa2d416d932a4af6a8dd77af P 12a897c2d39d4336ab0962100ec3f908: Time spent bootstrapping tablet: real 0.017s user 0.007s sys 0.009s
I20260807 22:43:47.257531 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 16318
I20260807 22:43:47.257817 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.66:39333
--local_ip_for_outbound_sockets=127.22.212.66
--tserver_master_addrs=127.22.212.126:45651
--webserver_port=43055
--webserver_interface=127.22.212.66
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:35629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:43:47.257992 16395 raft_consensus.cc:348] T 4e4360fbaa2d416d932a4af6a8dd77af P 12a897c2d39d4336ab0962100ec3f908 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12a897c2d39d4336ab0962100ec3f908" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 41521 } } peers { permanent_uuid: "b0d14a8c27a147d8ac2182c53d547010" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 39333 } } peers { permanent_uuid: "68deaa8ea7584b4e9a1558e41cab1bad" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 40323 } }
I20260807 22:43:47.258342 16395 raft_consensus.cc:729] T 4e4360fbaa2d416d932a4af6a8dd77af P 12a897c2d39d4336ab0962100ec3f908 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12a897c2d39d4336ab0962100ec3f908, State: Initialized, Role: FOLLOWER
I20260807 22:43:47.258526 16395 consensus_queue.cc:260] T 4e4360fbaa2d416d932a4af6a8dd77af P 12a897c2d39d4336ab0962100ec3f908 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12a897c2d39d4336ab0962100ec3f908" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 41521 } } peers { permanent_uuid: "b0d14a8c27a147d8ac2182c53d547010" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 39333 } } peers { permanent_uuid: "68deaa8ea7584b4e9a1558e41cab1bad" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 40323 } }
I20260807 22:43:47.258846 16395 ts_tablet_manager.cc:1428] T 4e4360fbaa2d416d932a4af6a8dd77af P 12a897c2d39d4336ab0962100ec3f908: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260807 22:43:47.260316 16575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:47.248816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.65:48909)
0807 22:43:47.249014 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:47.249060 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 22:43:47.249783 (+ 723us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:43:47.250246 (+ 463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:43:47.250250 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:43:47.250543 (+ 293us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:43:47.250729 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:47.250733 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:47.252007 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:47.252008 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:47.252991 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:47.252994 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:47.253610 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:47.253611 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:47.253761 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:47.254339 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:43:47.254349 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:43:47.255825 (+ 1476us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:43:47.258305 (+ 2480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:47.258312 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:47.258315 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:47.258654 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:47.258952 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:47.258953 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:47.258954 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:47.259086 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:47.259596 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:43:47.259604 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:43:47.259774 (+ 170us) client_negotiation.cc:769] Sending connection context
0807 22:43:47.259907 (+ 133us) client_negotiation.cc:240] Negotiation successful
0807 22:43:47.260089 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":117,"threads_started":1}
I20260807 22:43:47.260335 16578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:47.249182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:48909 (local address 127.22.212.126:45651)
0807 22:43:47.249363 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:47.249372 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:47.249412 (+ 40us) server_negotiation.cc:407] Connection header received
0807 22:43:47.250027 (+ 615us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:47.250033 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:47.250078 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:47.250214 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:43:47.250854 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:47.251842 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:47.253090 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:47.253485 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:47.253606 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:47.255945 (+ 2339us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:43:47.255950 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:43:47.255950 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:43:47.255962 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:43:47.258206 (+ 2244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:47.258751 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:47.258754 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:47.258755 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:47.258878 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:47.259160 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:47.259161 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:47.259161 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:47.259477 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:43:47.259562 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:47.259992 (+ 430us) server_negotiation.cc:299] Negotiation successful
0807 22:43:47.260119 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":110,"threads_started":1}
I20260807 22:43:47.260985 16569 heartbeater.cc:347] Connected to a master server at 127.22.212.126:45651
I20260807 22:43:47.261085 16569 heartbeater.cc:464] Registering TS with master...
I20260807 22:43:47.261256 16569 heartbeater.cc:511] Master 127.22.212.126:45651 requested a full tablet report, sending...
I20260807 22:43:47.262024 16264 ts_manager.cc:194] Registered new tserver with Master: 12a897c2d39d4336ab0962100ec3f908 (127.22.212.65:41521)
I20260807 22:43:47.263049 16264 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.65@KRBTEST.COM'} at 127.22.212.65:48909
I20260807 22:43:47.264016 16569 heartbeater.cc:503] Master 127.22.212.126:45651 was elected leader, sending a full tablet report...
Aug 07 22:43:47 dist-test-slave-2d19 krb5kdc[15325](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142627, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for kudu/127.22.212.65@KRBTEST.COM
I20260807 22:43:47.274446 16588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:47.262677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:41521 (local address 127.0.0.1:55158)
0807 22:43:47.262935 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:47.262968 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0807 22:43:47.263034 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:43:47.263409 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:43:47.263413 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:43:47.263742 (+ 329us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:43:47.263821 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:47.263824 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:47.265233 (+ 1409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:47.265235 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:47.266332 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:47.266337 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:47.267062 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:47.267063 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:47.267181 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:47.268445 (+ 1264us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:43:47.268451 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:43:47.270368 (+ 1917us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:43:47.272944 (+ 2576us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:47.272952 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:47.272955 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:47.273249 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:47.273557 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:47.273559 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:47.273559 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:47.273636 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:47.274012 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:43:47.274020 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:43:47.274084 (+ 64us) client_negotiation.cc:769] Sending connection context
0807 22:43:47.274190 (+ 106us) client_negotiation.cc:240] Negotiation successful
0807 22:43:47.274324 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":109,"threads_started":1}
I20260807 22:43:47.274461 16589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:47.262738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55158 (local address 127.22.212.65:41521)
0807 22:43:47.263164 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:47.263169 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:47.263179 (+ 10us) server_negotiation.cc:407] Connection header received
0807 22:43:47.263212 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:47.263213 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:47.263230 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:47.263304 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:43:47.263925 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:47.265131 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:47.266428 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:47.266964 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:47.267050 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:47.270473 (+ 3423us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:43:47.270482 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:43:47.270483 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:43:47.270491 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:43:47.272833 (+ 2342us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:47.273383 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:47.273386 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:47.273387 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:47.273465 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:47.273721 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:47.273722 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:47.273722 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:47.273926 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:43:47.274012 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:47.274242 (+ 230us) server_negotiation.cc:299] Negotiation successful
0807 22:43:47.274353 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":85,"threads_started":1}
I20260807 22:43:47.275185 16459 tablet_service.cc:1514] Processing DeleteTablet for tablet 4e4360fbaa2d416d932a4af6a8dd77af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:43:26 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:55158
I20260807 22:43:47.275818 16590 tablet_replica.cc:330] stopping tablet replica
I20260807 22:43:47.275943 16590 raft_consensus.cc:2229] T 4e4360fbaa2d416d932a4af6a8dd77af P 12a897c2d39d4336ab0962100ec3f908 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:43:47.276016 16590 raft_consensus.cc:2258] T 4e4360fbaa2d416d932a4af6a8dd77af P 12a897c2d39d4336ab0962100ec3f908 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:43:47.276373 16590 ts_tablet_manager.cc:1905] T 4e4360fbaa2d416d932a4af6a8dd77af P 12a897c2d39d4336ab0962100ec3f908: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:43:47.278985 16590 ts_tablet_manager.cc:1918] T 4e4360fbaa2d416d932a4af6a8dd77af P 12a897c2d39d4336ab0962100ec3f908: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:43:47.279071 16590 log.cc:1196] T 4e4360fbaa2d416d932a4af6a8dd77af P 12a897c2d39d4336ab0962100ec3f908: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-0/wal/wals/4e4360fbaa2d416d932a4af6a8dd77af
I20260807 22:43:47.279335 16590 ts_tablet_manager.cc:1939] T 4e4360fbaa2d416d932a4af6a8dd77af P 12a897c2d39d4336ab0962100ec3f908: Deleting consensus metadata
I20260807 22:43:47.279948 16244 catalog_manager.cc:4841] TS 12a897c2d39d4336ab0962100ec3f908 (127.22.212.65:41521): tablet 4e4360fbaa2d416d932a4af6a8dd77af (table test-table [id=43dfa2b0c48741278932ff17055b6874]) successfully deleted
W20260807 22:43:47.351931 16586 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:43:47.352176 16586 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:43:47.352216 16586 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:43:47.353376 16586 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:43:47.353443 16586 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:43:47.353485 16586 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.66
I20260807 22:43:47.354948 16586 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:35629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.66:39333
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.212.66
--webserver_port=43055
--tserver_master_addrs=127.22.212.126:45651
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16586
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.66
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:43:47.355235 16586 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:43:47.355477 16586 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:43:47.360788 16600 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:43:47.360828 16601 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:43:47.360811 16586 server_base.cc:1034] running on GCE node
W20260807 22:43:47.360795 16603 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:43:47.361294 16586 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:43:47.361562 16586 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:43:47.362736 16586 hybrid_clock.cc:648] HybridClock initialized: now 1786142627362728 us; error 43 us; skew 500 ppm
Aug 07 22:43:47 dist-test-slave-2d19 krb5kdc[15325](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142627, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:43:47.365458 16586 init.cc:377] Logged in from keytab as kudu/127.22.212.66@KRBTEST.COM (short username kudu)
I20260807 22:43:47.365940 16586 webserver.cc:460] Webserver started at http://127.22.212.66:43055/ using document root <none> and password file <none>
I20260807 22:43:47.366221 16586 fs_manager.cc:359] Metadata directory not provided
I20260807 22:43:47.366310 16586 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:43:47.367772 16586 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 22:43:47.368468 16614 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:43:47.368649 16586 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:43:47.368759 16586 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-1/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-1/wal
uuid: "b0d14a8c27a147d8ac2182c53d547010"
format_stamp: "Formatted at 2026-08-07 22:43:26 on dist-test-slave-2d19"
server_key: "96d65f2b00e1021d124578c0df0ceb06"
server_key_iv: "b4647d720349d1ce7dab8f789938f50c"
server_key_version: "encryptionkey@0"
I20260807 22:43:47.369131 16586 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:43:47.380039 16586 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:43:47.382099 16586 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:43:47.382262 16586 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:43:47.382485 16586 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:43:47.382791 16586 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:43:47.382846 16586 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:43:47.382886 16586 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:43:47.382917 16586 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:43:47.389012 16586 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.66:39333
I20260807 22:43:47.389057 16786 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.66:39333 every 8 connection(s)
I20260807 22:43:47.389405 16586 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
Aug 07 22:43:47 dist-test-slave-2d19 krb5kdc[15325](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142627, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:43:47.398113 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 16586
I20260807 22:43:47.398378 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.67:40323
--local_ip_for_outbound_sockets=127.22.212.67
--tserver_master_addrs=127.22.212.126:45651
--webserver_port=39781
--webserver_interface=127.22.212.67
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:35629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:43:47.398896 16578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:47.390141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:50587 (local address 127.22.212.126:45651)
0807 22:43:47.390203 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:47.390205 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:47.390399 (+ 194us) server_negotiation.cc:407] Connection header received
0807 22:43:47.390903 (+ 504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:47.390904 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:47.390917 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:47.390977 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:43:47.391956 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:47.392597 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:47.393565 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:47.393756 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:47.393807 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:47.395970 (+ 2163us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:43:47.395972 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:43:47.395973 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:43:47.395980 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:43:47.397380 (+ 1400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:47.397814 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:47.397815 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:47.397815 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:47.397878 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:47.398135 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:47.398137 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:47.398137 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:47.398295 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:43:47.398374 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:47.398708 (+ 334us) server_negotiation.cc:299] Negotiation successful
0807 22:43:47.398805 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 22:43:47.399113 16797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:47.390087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.66:50587)
0807 22:43:47.390276 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:47.390318 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 22:43:47.390817 (+ 499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:43:47.391057 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:43:47.391061 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:43:47.391643 (+ 582us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:43:47.391835 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:47.391839 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:47.392677 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:47.392678 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:47.393472 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:47.393474 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:47.393829 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:47.393830 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:47.393935 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:47.394421 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:43:47.394429 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:43:47.395873 (+ 1444us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:43:47.397468 (+ 1595us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:47.397476 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:47.397478 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:47.397716 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:47.397947 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:47.397948 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:47.397948 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:47.398064 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:47.398364 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:43:47.398371 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:43:47.398539 (+ 168us) client_negotiation.cc:769] Sending connection context
0807 22:43:47.398682 (+ 143us) client_negotiation.cc:240] Negotiation successful
0807 22:43:47.398835 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":117,"threads_started":1}
I20260807 22:43:47.399647 16792 heartbeater.cc:347] Connected to a master server at 127.22.212.126:45651
I20260807 22:43:47.399755 16792 heartbeater.cc:464] Registering TS with master...
I20260807 22:43:47.399951 16792 heartbeater.cc:511] Master 127.22.212.126:45651 requested a full tablet report, sending...
I20260807 22:43:47.400409 16264 ts_manager.cc:194] Registered new tserver with Master: b0d14a8c27a147d8ac2182c53d547010 (127.22.212.66:39333)
I20260807 22:43:47.400955 16264 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.66@KRBTEST.COM'} at 127.22.212.66:50587
W20260807 22:43:47.482969 16799 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:43:47.483217 16799 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:43:47.483260 16799 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:43:47.484524 16799 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:43:47.484593 16799 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:43:47.484642 16799 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.67
I20260807 22:43:47.486126 16799 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:35629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.67:40323
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.212.67
--webserver_port=39781
--tserver_master_addrs=127.22.212.126:45651
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16799
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.67
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:43:47.486408 16799 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:43:47.486672 16799 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:43:47.492026 16810 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:43:47.492105 16807 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:43:47.492187 16799 server_base.cc:1034] running on GCE node
W20260807 22:43:47.492156 16808 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:43:47.492558 16799 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:43:47.492769 16799 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:43:47.493911 16799 hybrid_clock.cc:648] HybridClock initialized: now 1786142627493895 us; error 36 us; skew 500 ppm
Aug 07 22:43:47 dist-test-slave-2d19 krb5kdc[15325](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142627, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:43:47.496529 16799 init.cc:377] Logged in from keytab as kudu/127.22.212.67@KRBTEST.COM (short username kudu)
I20260807 22:43:47.496984 16799 webserver.cc:460] Webserver started at http://127.22.212.67:39781/ using document root <none> and password file <none>
I20260807 22:43:47.497231 16799 fs_manager.cc:359] Metadata directory not provided
I20260807 22:43:47.497319 16799 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:43:47.498749 16799 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 22:43:47.499343 16820 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:43:47.499504 16799 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 22:43:47.499615 16799 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/wal
uuid: "68deaa8ea7584b4e9a1558e41cab1bad"
format_stamp: "Formatted at 2026-08-07 22:43:26 on dist-test-slave-2d19"
server_key: "8639ee454aaf8a389220f71becf4ddda"
server_key_iv: "ec467386b1f4b3eccb66c4decc931ad1"
server_key_version: "encryptionkey@0"
I20260807 22:43:47.499969 16799 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:43:47.532898 16799 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:43:47.534880 16799 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:43:47.535058 16799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:43:47.535310 16799 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:43:47.535637 16799 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:43:47.535692 16799 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:43:47.535728 16799 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:43:47.535755 16799 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:43:47.541369 16799 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.67:40323
I20260807 22:43:47.541417 17011 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.67:40323 every 8 connection(s)
I20260807 22:43:47.541812 16799 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
I20260807 22:43:47.545208 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 16799
Aug 07 22:43:47 dist-test-slave-2d19 krb5kdc[15325](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142627, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:43:47.551705 16578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:47.542607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:36723 (local address 127.22.212.126:45651)
0807 22:43:47.542676 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:47.542678 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:47.542875 (+ 197us) server_negotiation.cc:407] Connection header received
0807 22:43:47.543371 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:47.543372 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:47.543384 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:47.543436 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:43:47.544444 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:47.544935 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:47.546171 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:47.546355 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:47.546406 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:47.548728 (+ 2322us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:43:47.548730 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:43:47.548730 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:43:47.548739 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:43:47.550295 (+ 1556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:47.550708 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:47.550709 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:47.550710 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:47.550769 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:47.551042 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:47.551043 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:47.551044 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:47.551158 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:43:47.551232 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:47.551532 (+ 300us) server_negotiation.cc:299] Negotiation successful
0807 22:43:47.551616 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260807 22:43:47.552012 17016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:47.542588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.67:36723)
0807 22:43:47.542749 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:47.542784 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 22:43:47.543282 (+ 498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:43:47.543490 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:43:47.543494 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:43:47.544087 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:43:47.544350 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:47.544362 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:47.545012 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:47.545013 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:47.546086 (+ 1073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:47.546090 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:47.546434 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:47.546436 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:47.546597 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:47.547176 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:43:47.547185 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:43:47.548629 (+ 1444us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:43:47.550380 (+ 1751us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:47.550386 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:47.550389 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:47.550626 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:47.550845 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:43:47.550845 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:43:47.550846 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:43:47.550953 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:43:47.551235 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:43:47.551243 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:43:47.551383 (+ 140us) client_negotiation.cc:769] Sending connection context
0807 22:43:47.551488 (+ 105us) client_negotiation.cc:240] Negotiation successful
0807 22:43:47.551650 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":93,"threads_started":1}
I20260807 22:43:47.552577 17012 heartbeater.cc:347] Connected to a master server at 127.22.212.126:45651
I20260807 22:43:47.552681 17012 heartbeater.cc:464] Registering TS with master...
I20260807 22:43:47.552758 17019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:47.545648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45332 (local address 127.22.212.126:45651)
0807 22:43:47.545964 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:47.545996 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:47.546002 (+ 6us) server_negotiation.cc:407] Connection header received
0807 22:43:47.546020 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:47.546020 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:47.546029 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:47.546078 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:43:47.546920 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:47.547460 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:47.548382 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:47.548582 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:47.548657 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:47.550002 (+ 1345us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:43:47.550004 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:43:47.550004 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:43:47.550011 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:43:47.551453 (+ 1442us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:47.551907 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:47.551908 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:47.551909 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:47.551968 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:47.552215 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:47.552216 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:47.552217 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:47.552372 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:43:47.552537 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:47.552629 (+ 92us) server_negotiation.cc:299] Negotiation successful
0807 22:43:47.552695 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300,"thread_start_us":75,"threads_started":1}
I20260807 22:43:47.552889 17012 heartbeater.cc:511] Master 127.22.212.126:45651 requested a full tablet report, sending...
I20260807 22:43:47.553316 16264 ts_manager.cc:194] Registered new tserver with Master: 68deaa8ea7584b4e9a1558e41cab1bad (127.22.212.67:40323)
I20260807 22:43:47.553658 23377 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:43:47.553689 16264 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.67@KRBTEST.COM'} at 127.22.212.67:36723
I20260807 22:43:47.556531 17019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:47.554041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45338 (local address 127.22.212.126:45651)
0807 22:43:47.554080 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:47.554082 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:47.554194 (+ 112us) server_negotiation.cc:407] Connection header received
0807 22:43:47.554260 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:47.554261 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:47.554304 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:47.554376 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:43:47.554505 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:47.554948 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:47.555813 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:47.556033 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:47.556086 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:47.556234 (+ 148us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:43:47.556330 (+ 96us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0807 22:43:47.556467 (+ 137us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:45338: token expired
Metrics: {"server-negotiator.queue_time_us":18}
W20260807 22:43:47.556588 17019 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:45338: token expired
W20260807 22:43:47.556793 16152 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.22.212.126:45651)
I20260807 22:43:47.562794 17019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:47.557020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45352 (local address 127.22.212.126:45651)
0807 22:43:47.557058 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:47.557059 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:47.557170 (+ 111us) server_negotiation.cc:407] Connection header received
0807 22:43:47.557214 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:47.557214 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:47.557222 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:47.557265 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:43:47.557749 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:47.558200 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:47.558911 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:47.559095 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:47.559144 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:47.560521 (+ 1377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:43:47.560522 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:43:47.560523 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:43:47.560529 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:43:47.561846 (+ 1317us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:47.562209 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:47.562210 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:47.562211 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:47.562264 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:43:47.562434 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:43:47.562435 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:43:47.562435 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:43:47.562529 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:43:47.562603 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:47.562683 (+ 80us) server_negotiation.cc:299] Negotiation successful
0807 22:43:47.562739 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260807 22:43:47.564011 16264 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45352:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:43:47.565742 16264 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:43:47.568066 16459 tablet_service.cc:1467] Processing CreateTablet for tablet ff71afc3f1e94096a9a0642efadd5aaa (DEFAULT_TABLE table=test-table [id=a7b6194ce988405590a82dd84f39915c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:43:47.568310 16459 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff71afc3f1e94096a9a0642efadd5aaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:43:47.569659 16395 tablet_bootstrap.cc:492] T ff71afc3f1e94096a9a0642efadd5aaa P 12a897c2d39d4336ab0962100ec3f908: Bootstrap starting.
I20260807 22:43:47.570053 16395 tablet_bootstrap.cc:654] T ff71afc3f1e94096a9a0642efadd5aaa P 12a897c2d39d4336ab0962100ec3f908: Neither blocks nor log segments found. Creating new log.
I20260807 22:43:47.570686 16395 tablet_bootstrap.cc:492] T ff71afc3f1e94096a9a0642efadd5aaa P 12a897c2d39d4336ab0962100ec3f908: No bootstrap required, opened a new log
I20260807 22:43:47.570740 16395 ts_tablet_manager.cc:1397] T ff71afc3f1e94096a9a0642efadd5aaa P 12a897c2d39d4336ab0962100ec3f908: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260807 22:43:47.571089 16395 raft_consensus.cc:348] T ff71afc3f1e94096a9a0642efadd5aaa P 12a897c2d39d4336ab0962100ec3f908 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68deaa8ea7584b4e9a1558e41cab1bad" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 40323 } } peers { permanent_uuid: "b0d14a8c27a147d8ac2182c53d547010" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 39333 } } peers { permanent_uuid: "12a897c2d39d4336ab0962100ec3f908" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 41521 } }
I20260807 22:43:47.571187 16395 raft_consensus.cc:374] T ff71afc3f1e94096a9a0642efadd5aaa P 12a897c2d39d4336ab0962100ec3f908 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:43:47.571259 16395 raft_consensus.cc:729] T ff71afc3f1e94096a9a0642efadd5aaa P 12a897c2d39d4336ab0962100ec3f908 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12a897c2d39d4336ab0962100ec3f908, State: Initialized, Role: FOLLOWER
I20260807 22:43:47.571312 16395 consensus_queue.cc:260] T ff71afc3f1e94096a9a0642efadd5aaa P 12a897c2d39d4336ab0962100ec3f908 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68deaa8ea7584b4e9a1558e41cab1bad" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 40323 } } peers { permanent_uuid: "b0d14a8c27a147d8ac2182c53d547010" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 39333 } } peers { permanent_uuid: "12a897c2d39d4336ab0962100ec3f908" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 41521 } }
I20260807 22:43:47.571410 16395 ts_tablet_manager.cc:1428] T ff71afc3f1e94096a9a0642efadd5aaa P 12a897c2d39d4336ab0962100ec3f908: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260807 22:43:47.572147 16588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:47.567711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.67:40323 (local address 127.0.0.1:40924)
0807 22:43:47.567763 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:47.567775 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:43:47.567815 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:43:47.568558 (+ 743us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:43:47.568559 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:43:47.568561 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:43:47.568606 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:47.568607 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:47.569893 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:47.569894 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:47.570939 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:47.570942 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:47.571839 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:47.571841 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:47.571924 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:47.571962 (+ 38us) client_negotiation.cc:769] Sending connection context
0807 22:43:47.572048 (+ 86us) client_negotiation.cc:240] Negotiation successful
0807 22:43:47.572097 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36,"mutex_wait_us":1}
I20260807 22:43:47.572196 17025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:47.567809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40924 (local address 127.22.212.67:40323)
0807 22:43:47.568370 (+ 561us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:47.568374 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:47.568383 (+ 9us) server_negotiation.cc:407] Connection header received
0807 22:43:47.568423 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:47.568425 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:47.568440 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:47.568543 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:43:47.568691 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:47.569791 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:47.571028 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:47.571734 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:47.571833 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:47.571907 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:47.572068 (+ 161us) server_negotiation.cc:299] Negotiation successful
0807 22:43:47.572107 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":523,"thread_start_us":89,"threads_started":1}
I20260807 22:43:47.572636 17022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:47.567754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.66:39333 (local address 127.0.0.1:60156)
0807 22:43:47.567974 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:47.567984 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 22:43:47.568041 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:43:47.568474 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:43:47.568475 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:43:47.568478 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:43:47.568528 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:47.568530 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:47.569894 (+ 1364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:47.569894 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:47.571093 (+ 1199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:47.571096 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:47.572374 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:47.572375 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:47.572460 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:47.572465 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 22:43:47.572522 (+ 57us) client_negotiation.cc:240] Negotiation successful
0807 22:43:47.572561 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"mutex_wait_us":61,"thread_start_us":76,"threads_started":1}
I20260807 22:43:47.572899 17026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:47.567993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60156 (local address 127.22.212.66:39333)
0807 22:43:47.568224 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:47.568229 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:47.568239 (+ 10us) server_negotiation.cc:407] Connection header received
0807 22:43:47.568320 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:47.568322 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:47.568341 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:47.568609 (+ 268us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:43:47.568695 (+ 86us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:47.569780 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:47.571230 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:47.572177 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:47.572247 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:47.572339 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:47.572769 (+ 430us) server_negotiation.cc:299] Negotiation successful
0807 22:43:47.572818 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":113,"threads_started":1}
I20260807 22:43:47.573137 16907 tablet_service.cc:1467] Processing CreateTablet for tablet ff71afc3f1e94096a9a0642efadd5aaa (DEFAULT_TABLE table=test-table [id=a7b6194ce988405590a82dd84f39915c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:43:47.573474 16907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff71afc3f1e94096a9a0642efadd5aaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:43:47.576084 17031 tablet_bootstrap.cc:492] T ff71afc3f1e94096a9a0642efadd5aaa P 68deaa8ea7584b4e9a1558e41cab1bad: Bootstrap starting.
I20260807 22:43:47.576576 16694 tablet_service.cc:1467] Processing CreateTablet for tablet ff71afc3f1e94096a9a0642efadd5aaa (DEFAULT_TABLE table=test-table [id=a7b6194ce988405590a82dd84f39915c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:43:47.576769 17031 tablet_bootstrap.cc:654] T ff71afc3f1e94096a9a0642efadd5aaa P 68deaa8ea7584b4e9a1558e41cab1bad: Neither blocks nor log segments found. Creating new log.
I20260807 22:43:47.576928 16694 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff71afc3f1e94096a9a0642efadd5aaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:43:47.577332 17031 log.cc:824] T ff71afc3f1e94096a9a0642efadd5aaa P 68deaa8ea7584b4e9a1558e41cab1bad: Log is configured to *not* fsync() on all Append() calls
I20260807 22:43:47.578071 17031 tablet_bootstrap.cc:492] T ff71afc3f1e94096a9a0642efadd5aaa P 68deaa8ea7584b4e9a1558e41cab1bad: No bootstrap required, opened a new log
I20260807 22:43:47.578125 17031 ts_tablet_manager.cc:1397] T ff71afc3f1e94096a9a0642efadd5aaa P 68deaa8ea7584b4e9a1558e41cab1bad: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 22:43:47.579638 17031 raft_consensus.cc:348] T ff71afc3f1e94096a9a0642efadd5aaa P 68deaa8ea7584b4e9a1558e41cab1bad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68deaa8ea7584b4e9a1558e41cab1bad" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 40323 } } peers { permanent_uuid: "b0d14a8c27a147d8ac2182c53d547010" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 39333 } } peers { permanent_uuid: "12a897c2d39d4336ab0962100ec3f908" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 41521 } }
I20260807 22:43:47.579798 17031 raft_consensus.cc:374] T ff71afc3f1e94096a9a0642efadd5aaa P 68deaa8ea7584b4e9a1558e41cab1bad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:43:47.579845 17031 raft_consensus.cc:729] T ff71afc3f1e94096a9a0642efadd5aaa P 68deaa8ea7584b4e9a1558e41cab1bad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68deaa8ea7584b4e9a1558e41cab1bad, State: Initialized, Role: FOLLOWER
I20260807 22:43:47.579874 17033 tablet_bootstrap.cc:492] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010: Bootstrap starting.
I20260807 22:43:47.580009 17031 consensus_queue.cc:260] T ff71afc3f1e94096a9a0642efadd5aaa P 68deaa8ea7584b4e9a1558e41cab1bad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68deaa8ea7584b4e9a1558e41cab1bad" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 40323 } } peers { permanent_uuid: "b0d14a8c27a147d8ac2182c53d547010" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 39333 } } peers { permanent_uuid: "12a897c2d39d4336ab0962100ec3f908" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 41521 } }
I20260807 22:43:47.580346 17031 ts_tablet_manager.cc:1428] T ff71afc3f1e94096a9a0642efadd5aaa P 68deaa8ea7584b4e9a1558e41cab1bad: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 22:43:47.580403 17012 heartbeater.cc:503] Master 127.22.212.126:45651 was elected leader, sending a full tablet report...
I20260807 22:43:47.580618 17033 tablet_bootstrap.cc:654] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010: Neither blocks nor log segments found. Creating new log.
I20260807 22:43:47.581291 17033 log.cc:824] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010: Log is configured to *not* fsync() on all Append() calls
I20260807 22:43:47.581975 17033 tablet_bootstrap.cc:492] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010: No bootstrap required, opened a new log
I20260807 22:43:47.582062 17033 ts_tablet_manager.cc:1397] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 22:43:47.583323 17033 raft_consensus.cc:348] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68deaa8ea7584b4e9a1558e41cab1bad" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 40323 } } peers { permanent_uuid: "b0d14a8c27a147d8ac2182c53d547010" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 39333 } } peers { permanent_uuid: "12a897c2d39d4336ab0962100ec3f908" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 41521 } }
I20260807 22:43:47.583472 17033 raft_consensus.cc:374] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:43:47.583498 17033 raft_consensus.cc:729] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0d14a8c27a147d8ac2182c53d547010, State: Initialized, Role: FOLLOWER
I20260807 22:43:47.583611 17033 consensus_queue.cc:260] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68deaa8ea7584b4e9a1558e41cab1bad" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 40323 } } peers { permanent_uuid: "b0d14a8c27a147d8ac2182c53d547010" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 39333 } } peers { permanent_uuid: "12a897c2d39d4336ab0962100ec3f908" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 41521 } }
I20260807 22:43:47.583842 17033 ts_tablet_manager.cc:1428] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 22:43:47.583894 16792 heartbeater.cc:503] Master 127.22.212.126:45651 was elected leader, sending a full tablet report...
W20260807 22:43:47.639952 16796 tablet.cc:2369] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:43:47.648052 17038 raft_consensus.cc:482] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:43:47.648219 17038 raft_consensus.cc:504] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68deaa8ea7584b4e9a1558e41cab1bad" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 40323 } } peers { permanent_uuid: "b0d14a8c27a147d8ac2182c53d547010" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 39333 } } peers { permanent_uuid: "12a897c2d39d4336ab0962100ec3f908" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 41521 } }
I20260807 22:43:47.648667 17038 leader_election.cc:288] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68deaa8ea7584b4e9a1558e41cab1bad (127.22.212.67:40323), 12a897c2d39d4336ab0962100ec3f908 (127.22.212.65:41521)
I20260807 22:43:47.651486 16797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:47.648869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.67:40323 (local address 127.22.212.66:46659)
0807 22:43:47.648929 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:47.648940 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 22:43:47.649018 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:43:47.649164 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:43:47.649164 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:43:47.649166 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:43:47.649240 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:47.649242 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:47.649884 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:47.649885 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:47.650636 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:47.650639 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:47.651212 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:47.651213 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:47.651295 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:47.651298 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:43:47.651368 (+ 70us) client_negotiation.cc:240] Negotiation successful
0807 22:43:47.651407 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260807 22:43:47.651477 17025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:47.648934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:46659 (local address 127.22.212.67:40323)
0807 22:43:47.649013 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:47.649015 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:47.649026 (+ 11us) server_negotiation.cc:407] Connection header received
0807 22:43:47.649079 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:47.649080 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:47.649091 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:47.649153 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:43:47.649314 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:47.649796 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:47.650737 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:47.651126 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:47.651213 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:47.651224 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:47.651374 (+ 150us) server_negotiation.cc:299] Negotiation successful
0807 22:43:47.651411 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 22:43:47.651790 17039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:47.648996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:41521 (local address 127.22.212.66:45573)
0807 22:43:47.649160 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:47.649170 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 22:43:47.649234 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:43:47.649425 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:43:47.649426 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:43:47.649428 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:43:47.649500 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:47.649501 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:47.650185 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:47.650186 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:47.650908 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:43:47.650910 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:43:47.651498 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:43:47.651499 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:43:47.651575 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:47.651580 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 22:43:47.651669 (+ 89us) client_negotiation.cc:240] Negotiation successful
0807 22:43:47.651713 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":100,"threads_started":1}
I20260807 22:43:47.651836 16589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:47.649103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:45573 (local address 127.22.212.65:41521)
0807 22:43:47.649170 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:47.649173 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:47.649237 (+ 64us) server_negotiation.cc:407] Connection header received
0807 22:43:47.649301 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:47.649302 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:47.649335 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:47.649408 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:43:47.649598 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:47.650092 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:47.651010 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:47.651413 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:47.651499 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:47.651574 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:47.651723 (+ 149us) server_negotiation.cc:299] Negotiation successful
0807 22:43:47.651773 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 22:43:47.651810 16938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff71afc3f1e94096a9a0642efadd5aaa" candidate_uuid: "b0d14a8c27a147d8ac2182c53d547010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68deaa8ea7584b4e9a1558e41cab1bad" is_pre_election: true
I20260807 22:43:47.652034 16938 raft_consensus.cc:2454] T ff71afc3f1e94096a9a0642efadd5aaa P 68deaa8ea7584b4e9a1558e41cab1bad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0d14a8c27a147d8ac2182c53d547010 in term 0.
I20260807 22:43:47.652191 16487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff71afc3f1e94096a9a0642efadd5aaa" candidate_uuid: "b0d14a8c27a147d8ac2182c53d547010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12a897c2d39d4336ab0962100ec3f908" is_pre_election: true
I20260807 22:43:47.652323 16620 leader_election.cc:302] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68deaa8ea7584b4e9a1558e41cab1bad, b0d14a8c27a147d8ac2182c53d547010; no voters:
I20260807 22:43:47.652405 16487 raft_consensus.cc:2454] T ff71afc3f1e94096a9a0642efadd5aaa P 12a897c2d39d4336ab0962100ec3f908 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0d14a8c27a147d8ac2182c53d547010 in term 0.
I20260807 22:43:47.652487 17038 raft_consensus.cc:2781] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:43:47.652558 17038 raft_consensus.cc:482] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:43:47.652591 17038 raft_consensus.cc:3037] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:43:47.653311 17038 raft_consensus.cc:504] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68deaa8ea7584b4e9a1558e41cab1bad" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 40323 } } peers { permanent_uuid: "b0d14a8c27a147d8ac2182c53d547010" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 39333 } } peers { permanent_uuid: "12a897c2d39d4336ab0962100ec3f908" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 41521 } }
I20260807 22:43:47.653457 17038 leader_election.cc:288] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010 [CANDIDATE]: Term 1 election: Requested vote from peers 68deaa8ea7584b4e9a1558e41cab1bad (127.22.212.67:40323), 12a897c2d39d4336ab0962100ec3f908 (127.22.212.65:41521)
I20260807 22:43:47.653601 16938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff71afc3f1e94096a9a0642efadd5aaa" candidate_uuid: "b0d14a8c27a147d8ac2182c53d547010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68deaa8ea7584b4e9a1558e41cab1bad"
I20260807 22:43:47.653627 16487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff71afc3f1e94096a9a0642efadd5aaa" candidate_uuid: "b0d14a8c27a147d8ac2182c53d547010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12a897c2d39d4336ab0962100ec3f908"
I20260807 22:43:47.653680 16938 raft_consensus.cc:3037] T ff71afc3f1e94096a9a0642efadd5aaa P 68deaa8ea7584b4e9a1558e41cab1bad [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:43:47.653726 16487 raft_consensus.cc:3037] T ff71afc3f1e94096a9a0642efadd5aaa P 12a897c2d39d4336ab0962100ec3f908 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:43:47.654400 16487 raft_consensus.cc:2454] T ff71afc3f1e94096a9a0642efadd5aaa P 12a897c2d39d4336ab0962100ec3f908 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0d14a8c27a147d8ac2182c53d547010 in term 1.
I20260807 22:43:47.654456 16938 raft_consensus.cc:2454] T ff71afc3f1e94096a9a0642efadd5aaa P 68deaa8ea7584b4e9a1558e41cab1bad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0d14a8c27a147d8ac2182c53d547010 in term 1.
I20260807 22:43:47.654608 16620 leader_election.cc:302] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68deaa8ea7584b4e9a1558e41cab1bad, b0d14a8c27a147d8ac2182c53d547010; no voters:
I20260807 22:43:47.654732 17038 raft_consensus.cc:2781] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:43:47.654915 17038 raft_consensus.cc:686] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010 [term 1 LEADER]: Becoming Leader. State: Replica: b0d14a8c27a147d8ac2182c53d547010, State: Running, Role: LEADER
I20260807 22:43:47.655016 17038 consensus_queue.cc:237] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68deaa8ea7584b4e9a1558e41cab1bad" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 40323 } } peers { permanent_uuid: "b0d14a8c27a147d8ac2182c53d547010" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 39333 } } peers { permanent_uuid: "12a897c2d39d4336ab0962100ec3f908" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 41521 } }
I20260807 22:43:47.655936 16264 catalog_manager.cc:5495] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0d14a8c27a147d8ac2182c53d547010 (127.22.212.66). New cstate: current_term: 1 leader_uuid: "b0d14a8c27a147d8ac2182c53d547010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68deaa8ea7584b4e9a1558e41cab1bad" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0d14a8c27a147d8ac2182c53d547010" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 39333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "12a897c2d39d4336ab0962100ec3f908" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 41521 } health_report { overall_health: UNKNOWN } } }
I20260807 22:43:47.669458 17026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:47.667238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60158 (local address 127.22.212.66:39333)
0807 22:43:47.667301 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0807 22:43:47.667303 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:43:47.667311 (+ 8us) server_negotiation.cc:407] Connection header received
0807 22:43:47.667367 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:43:47.667368 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:43:47.667384 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:43:47.667446 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:43:47.667563 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:47.668044 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:47.668741 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:43:47.668923 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:43:47.669006 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:43:47.669128 (+ 122us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:43:47.669226 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:43:47.669288 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0807 22:43:47.669306 (+ 18us) server_negotiation.cc:299] Negotiation successful
0807 22:43:47.669323 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 22:43:47.671296 16938 raft_consensus.cc:1261] T ff71afc3f1e94096a9a0642efadd5aaa P 68deaa8ea7584b4e9a1558e41cab1bad [term 1 FOLLOWER]: Refusing update from remote peer b0d14a8c27a147d8ac2182c53d547010: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:43:47.671356 16487 raft_consensus.cc:1261] T ff71afc3f1e94096a9a0642efadd5aaa P 12a897c2d39d4336ab0962100ec3f908 [term 1 FOLLOWER]: Refusing update from remote peer b0d14a8c27a147d8ac2182c53d547010: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:43:47.671664 17040 consensus_queue.cc:1035] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68deaa8ea7584b4e9a1558e41cab1bad" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:43:47.671798 17038 consensus_queue.cc:1035] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12a897c2d39d4336ab0962100ec3f908" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 41521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:43:47.675406 17044 mvcc.cc:205] Tried to move back new op lower bound from 7316040202938630144 to 7316040202875662336. Current Snapshot: MvccSnapshot[applied={T|T < 7316040202938630144 or (T in {7316040202938630144})}]
I20260807 22:43:47.675529 17047 mvcc.cc:205] Tried to move back new op lower bound from 7316040202938630144 to 7316040202875662336. Current Snapshot: MvccSnapshot[applied={T|T < 7316040202938630144 or (T in {7316040202938630144})}]
I20260807 22:43:47.676630 16262 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45352:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:43:47.676731 16262 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45352:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:43:47.677465 16262 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245: Sending DeleteTablet for 3 replicas of tablet ff71afc3f1e94096a9a0642efadd5aaa
I20260807 22:43:47.677778 16694 tablet_service.cc:1514] Processing DeleteTablet for tablet ff71afc3f1e94096a9a0642efadd5aaa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:43:47 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:60156
I20260807 22:43:47.677819 16459 tablet_service.cc:1514] Processing DeleteTablet for tablet ff71afc3f1e94096a9a0642efadd5aaa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:43:47 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:55158
I20260807 22:43:47.677845 16907 tablet_service.cc:1514] Processing DeleteTablet for tablet ff71afc3f1e94096a9a0642efadd5aaa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:43:47 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:40924
I20260807 22:43:47.678026 16590 tablet_replica.cc:330] T ff71afc3f1e94096a9a0642efadd5aaa P 12a897c2d39d4336ab0962100ec3f908: stopping tablet replica
I20260807 22:43:47.678058 17057 tablet_replica.cc:330] T ff71afc3f1e94096a9a0642efadd5aaa P 68deaa8ea7584b4e9a1558e41cab1bad: stopping tablet replica
I20260807 22:43:47.678087 16590 raft_consensus.cc:2229] T ff71afc3f1e94096a9a0642efadd5aaa P 12a897c2d39d4336ab0962100ec3f908 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:43:47.678148 16590 raft_consensus.cc:2258] T ff71afc3f1e94096a9a0642efadd5aaa P 12a897c2d39d4336ab0962100ec3f908 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:43:47.678155 17057 raft_consensus.cc:2229] T ff71afc3f1e94096a9a0642efadd5aaa P 68deaa8ea7584b4e9a1558e41cab1bad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:43:47.678247 17057 raft_consensus.cc:2258] T ff71afc3f1e94096a9a0642efadd5aaa P 68deaa8ea7584b4e9a1558e41cab1bad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:43:47.678452 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 16318
I20260807 22:43:47.693722 17057 ts_tablet_manager.cc:1905] T ff71afc3f1e94096a9a0642efadd5aaa P 68deaa8ea7584b4e9a1558e41cab1bad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:43:47.695915 17057 ts_tablet_manager.cc:1918] T ff71afc3f1e94096a9a0642efadd5aaa P 68deaa8ea7584b4e9a1558e41cab1bad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:43:47.696012 17057 log.cc:1196] T ff71afc3f1e94096a9a0642efadd5aaa P 68deaa8ea7584b4e9a1558e41cab1bad: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/wal/wals/ff71afc3f1e94096a9a0642efadd5aaa
I20260807 22:43:47.696395 17057 ts_tablet_manager.cc:1939] T ff71afc3f1e94096a9a0642efadd5aaa P 68deaa8ea7584b4e9a1558e41cab1bad: Deleting consensus metadata
I20260807 22:43:47.696895 16244 catalog_manager.cc:4841] TS 68deaa8ea7584b4e9a1558e41cab1bad (127.22.212.67:40323): tablet ff71afc3f1e94096a9a0642efadd5aaa (table test-table [id=a7b6194ce988405590a82dd84f39915c]) successfully deleted
W20260807 22:43:47.698552 16244 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.212.65:41521 (error 108)
I20260807 22:43:47.699020 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 16586
I20260807 22:43:47.699163 17056 tablet_replica.cc:330] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010: stopping tablet replica
I20260807 22:43:47.699281 17056 raft_consensus.cc:2229] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:43:47.699386 17056 raft_consensus.cc:2258] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:43:47.701072 17022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:47.699149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:41521 (local address 127.0.0.1:55166)
0807 22:43:47.700978 (+ 1829us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:47.701030 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.65:41521: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1803}
W20260807 22:43:47.705067 16244 catalog_manager.cc:4584] TS 12a897c2d39d4336ab0962100ec3f908 (127.22.212.65:41521): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ff71afc3f1e94096a9a0642efadd5aaa: Network error: Client connection negotiation failed: client connection to 127.22.212.65:41521: connect: Connection refused (error 111)
I20260807 22:43:47.713568 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 16799
I20260807 22:43:47.713624 17022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:43:47.713517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.66:39333 (local address 127.0.0.1:60160)
0807 22:43:47.713561 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0807 22:43:47.713593 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.66:39333: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260807 22:43:47.724140 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 16218
I20260807 22:44:07.737799 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:45651
--webserver_interface=127.22.212.126
--webserver_port=40795
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:35629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:45651
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:44:07.824198 17061 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:44:07.824519 17061 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:44:07.824563 17061 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:44:07.825847 17061 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 22:44:07.825935 17061 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 22:44:07.825961 17061 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 22:44:07.825994 17061 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:44:07.826026 17061 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:44:07.826056 17061 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:44:07.826076 17061 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:44:07.826102 17061 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:44:07.827801 17061 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:35629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:45651
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:45651
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=40795
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17061
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:44:07.828123 17061 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:44:07.828447 17061 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:44:07.834345 17070 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:07.834369 17061 server_base.cc:1034] running on GCE node
W20260807 22:44:07.834352 17075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:07.834352 17073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:07.834849 17061 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:44:07.835208 17061 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:44:07.836328 17061 hybrid_clock.cc:648] HybridClock initialized: now 1786142647836310 us; error 46 us; skew 500 ppm
Aug 07 22:44:07 dist-test-slave-2d19 krb5kdc[15325](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142647, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:44:07.838814 17061 init.cc:377] Logged in from keytab as kudu/127.22.212.126@KRBTEST.COM (short username kudu)
I20260807 22:44:07.839327 17061 webserver.cc:460] Webserver started at http://127.22.212.126:40795/ using document root <none> and password file <none>
I20260807 22:44:07.839612 17061 fs_manager.cc:359] Metadata directory not provided
I20260807 22:44:07.839690 17061 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:44:07.841159 17061 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 22:44:07.841871 17082 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:07.842051 17061 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 22:44:07.842161 17061 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "475450f7eff24c1d868f703ebd215245"
format_stamp: "Formatted at 2026-08-07 22:43:25 on dist-test-slave-2d19"
server_key: "bc45ebe01c18bb6ad4d65b74a26233fd"
server_key_iv: "998afd6d91564d2049bc7670fd16719a"
server_key_version: "encryptionkey@0"
I20260807 22:44:07.842530 17061 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:44:07.861334 17061 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:44:07.863394 17061 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:44:07.863579 17061 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:44:07.868006 17061 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:45651
I20260807 22:44:07.868083 17165 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:45651 every 8 connection(s)
I20260807 22:44:07.868748 17061 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:44:07.870335 17166 sys_catalog.cc:263] Verifying existing consensus state
I20260807 22:44:07.870952 17166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245: Bootstrap starting.
I20260807 22:44:07.874032 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 17061
I20260807 22:44:07.874361 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.65:41521
--local_ip_for_outbound_sockets=127.22.212.65
--tserver_master_addrs=127.22.212.126:45651
--webserver_port=33497
--webserver_interface=127.22.212.65
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:35629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:44:07.880136 17166 log.cc:824] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245: Log is configured to *not* fsync() on all Append() calls
I20260807 22:44:07.882447 17166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 22:44:07.882804 17166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245: Bootstrap complete.
I20260807 22:44:07.885214 17166 raft_consensus.cc:348] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "475450f7eff24c1d868f703ebd215245" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 45651 } }
I20260807 22:44:07.885434 17166 raft_consensus.cc:729] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 475450f7eff24c1d868f703ebd215245, State: Initialized, Role: FOLLOWER
I20260807 22:44:07.885617 17166 consensus_queue.cc:260] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "475450f7eff24c1d868f703ebd215245" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 45651 } }
I20260807 22:44:07.885689 17166 raft_consensus.cc:388] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:44:07.885756 17166 raft_consensus.cc:482] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:44:07.885802 17166 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [term 2 FOLLOWER]: Advancing to term 3
I20260807 22:44:07.886821 17166 raft_consensus.cc:504] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "475450f7eff24c1d868f703ebd215245" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 45651 } }
I20260807 22:44:07.886914 17166 leader_election.cc:302] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 475450f7eff24c1d868f703ebd215245; no voters:
I20260807 22:44:07.887135 17166 leader_election.cc:288] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260807 22:44:07.887171 17170 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 22:44:07.887298 17170 raft_consensus.cc:686] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [term 3 LEADER]: Becoming Leader. State: Replica: 475450f7eff24c1d868f703ebd215245, State: Running, Role: LEADER
I20260807 22:44:07.887389 17170 consensus_queue.cc:237] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "475450f7eff24c1d868f703ebd215245" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 45651 } }
I20260807 22:44:07.887416 17166 sys_catalog.cc:564] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:44:07.887698 17170 sys_catalog.cc:455] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 475450f7eff24c1d868f703ebd215245. Latest consensus state: current_term: 3 leader_uuid: "475450f7eff24c1d868f703ebd215245" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "475450f7eff24c1d868f703ebd215245" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 45651 } } }
I20260807 22:44:07.887779 17170 sys_catalog.cc:458] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:07.887702 17171 sys_catalog.cc:455] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "475450f7eff24c1d868f703ebd215245" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "475450f7eff24c1d868f703ebd215245" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 45651 } } }
I20260807 22:44:07.887955 17171 sys_catalog.cc:458] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245 [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:07.887981 17177 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:44:07.889052 17177 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:44:07.889184 17177 catalog_manager.cc:1259] Loaded cluster ID: ce9385cf7b8f46c29925d22b7f447973
I20260807 22:44:07.889546 17177 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:44:07.890383 17177 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:44:07.890615 17177 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245: Loaded TSK: 0
I20260807 22:44:07.890679 17177 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 475450f7eff24c1d868f703ebd215245: Loaded TSK: 1
F20260807 22:44:07.890902 17177 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f71a81e49ad google::LogMessage::Fail() at ??:0
@ 0x7f71a81e788a google::LogMessage::SendToLog() at ??:0
@ 0x7f71a81e44de google::LogMessage::Flush() at ??:0
@ 0x7f71a81e5a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f71aa951104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f71aa94ed41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f71b013e1cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f71b013e48e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f71b013e594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f71b0104c48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f71b010ead0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f71aa0b20d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f71aa0a7954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f71aaf0b6db start_thread at ??:0
@ 0x7f71a6ce261f clone at ??:0
W20260807 22:44:07.978237 17168 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:44:07.978484 17168 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:44:07.978533 17168 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:44:07.979696 17168 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:44:07.979770 17168 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:44:07.979816 17168 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.65
I20260807 22:44:07.981432 17168 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:35629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.65:41521
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.212.65
--webserver_port=33497
--tserver_master_addrs=127.22.212.126:45651
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17168
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.65
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:44:07.981716 17168 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:44:07.981959 17168 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:44:07.987349 17236 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:07.987345 17240 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:07.987651 17168 server_base.cc:1034] running on GCE node
W20260807 22:44:07.987437 17237 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:07.987954 17168 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:44:07.988251 17168 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:44:07.989437 17168 hybrid_clock.cc:648] HybridClock initialized: now 1786142647989421 us; error 33 us; skew 500 ppm
Aug 07 22:44:07 dist-test-slave-2d19 krb5kdc[15325](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142647, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:44:07.992328 17168 init.cc:377] Logged in from keytab as kudu/127.22.212.65@KRBTEST.COM (short username kudu)
I20260807 22:44:07.992878 17168 webserver.cc:460] Webserver started at http://127.22.212.65:33497/ using document root <none> and password file <none>
I20260807 22:44:07.993130 17168 fs_manager.cc:359] Metadata directory not provided
I20260807 22:44:07.993204 17168 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:44:07.994618 17168 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:44:07.995386 17248 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:07.995549 17168 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:44:07.995651 17168 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-0/wal
uuid: "12a897c2d39d4336ab0962100ec3f908"
format_stamp: "Formatted at 2026-08-07 22:43:26 on dist-test-slave-2d19"
server_key: "44995e339fbed6358d194397ec8134ec"
server_key_iv: "350beb061a87a4278650d62955249872"
server_key_version: "encryptionkey@0"
I20260807 22:44:07.996016 17168 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:44:08.008196 17168 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:44:08.010836 17168 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:44:08.011000 17168 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:44:08.011279 17168 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:44:08.011762 17264 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 22:44:08.013885 17168 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 22:44:08.013952 17168 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260807 22:44:08.013998 17168 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 22:44:08.014673 17168 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 22:44:08.014739 17168 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260807 22:44:08.014808 17264 tablet_bootstrap.cc:492] T ff71afc3f1e94096a9a0642efadd5aaa P 12a897c2d39d4336ab0962100ec3f908: Bootstrap starting.
I20260807 22:44:08.022274 17168 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.65:41521
I20260807 22:44:08.022697 17168 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
I20260807 22:44:08.023273 17448 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.65:41521 every 8 connection(s)
I20260807 22:44:08.026206 17264 log.cc:824] T ff71afc3f1e94096a9a0642efadd5aaa P 12a897c2d39d4336ab0962100ec3f908: Log is configured to *not* fsync() on all Append() calls
I20260807 22:44:08.029325 17264 tablet_bootstrap.cc:492] T ff71afc3f1e94096a9a0642efadd5aaa P 12a897c2d39d4336ab0962100ec3f908: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 22:44:08.029727 17264 tablet_bootstrap.cc:492] T ff71afc3f1e94096a9a0642efadd5aaa P 12a897c2d39d4336ab0962100ec3f908: Bootstrap complete.
I20260807 22:44:08.030998 17264 ts_tablet_manager.cc:1397] T ff71afc3f1e94096a9a0642efadd5aaa P 12a897c2d39d4336ab0962100ec3f908: Time spent bootstrapping tablet: real 0.016s user 0.010s sys 0.003s
I20260807 22:44:08.031131 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 17168
I20260807 22:44:08.031437 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.66:39333
--local_ip_for_outbound_sockets=127.22.212.66
--tserver_master_addrs=127.22.212.126:45651
--webserver_port=43055
--webserver_interface=127.22.212.66
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:35629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:44:08.032725 17264 raft_consensus.cc:348] T ff71afc3f1e94096a9a0642efadd5aaa P 12a897c2d39d4336ab0962100ec3f908 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68deaa8ea7584b4e9a1558e41cab1bad" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 40323 } } peers { permanent_uuid: "b0d14a8c27a147d8ac2182c53d547010" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 39333 } } peers { permanent_uuid: "12a897c2d39d4336ab0962100ec3f908" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 41521 } }
I20260807 22:44:08.033090 17264 raft_consensus.cc:729] T ff71afc3f1e94096a9a0642efadd5aaa P 12a897c2d39d4336ab0962100ec3f908 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12a897c2d39d4336ab0962100ec3f908, State: Initialized, Role: FOLLOWER
I20260807 22:44:08.033289 17264 consensus_queue.cc:260] T ff71afc3f1e94096a9a0642efadd5aaa P 12a897c2d39d4336ab0962100ec3f908 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68deaa8ea7584b4e9a1558e41cab1bad" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 40323 } } peers { permanent_uuid: "b0d14a8c27a147d8ac2182c53d547010" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 39333 } } peers { permanent_uuid: "12a897c2d39d4336ab0962100ec3f908" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 41521 } }
I20260807 22:44:08.033623 17264 ts_tablet_manager.cc:1428] T ff71afc3f1e94096a9a0642efadd5aaa P 12a897c2d39d4336ab0962100ec3f908: Time spent starting tablet: real 0.003s user 0.005s sys 0.000s
W20260807 22:44:08.100410 17451 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:44:08.023504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.65:59891)
0807 22:44:08.023703 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:08.023769 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:08.024621 (+ 852us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:08.100148 (+ 75527us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":76,"threads_started":1}
W20260807 22:44:08.100677 17449 heartbeater.cc:644] Failed to heartbeat to 127.22.212.126:45651 (0 consecutive failures): Network error: Failed to ping master at 127.22.212.126:45651: Client connection negotiation failed: client connection to 127.22.212.126:45651: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 22:44:08.101045 17451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:08.100906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.65:34177)
0807 22:44:08.100968 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:08.101022 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260807 22:44:08.101370 17451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:08.101278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.65:45923)
0807 22:44:08.101325 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:08.101349 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260807 22:44:08.101486 17449 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 22:44:08.119728 17453 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:44:08.119997 17453 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:44:08.120047 17453 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:44:08.121331 17453 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:44:08.121410 17453 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:44:08.121459 17453 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.66
I20260807 22:44:08.122964 17453 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:35629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.66:39333
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.212.66
--webserver_port=43055
--tserver_master_addrs=127.22.212.126:45651
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17453
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.66
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:44:08.123363 17453 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:44:08.123694 17453 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:44:08.129611 17470 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:08.129704 17453 server_base.cc:1034] running on GCE node
W20260807 22:44:08.129658 17467 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:08.129611 17466 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:08.130095 17453 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:44:08.130359 17453 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:44:08.131560 17453 hybrid_clock.cc:648] HybridClock initialized: now 1786142648131518 us; error 35 us; skew 500 ppm
Aug 07 22:44:08 dist-test-slave-2d19 krb5kdc[15325](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142648, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:44:08.134464 17453 init.cc:377] Logged in from keytab as kudu/127.22.212.66@KRBTEST.COM (short username kudu)
I20260807 22:44:08.134980 17453 webserver.cc:460] Webserver started at http://127.22.212.66:43055/ using document root <none> and password file <none>
I20260807 22:44:08.135231 17453 fs_manager.cc:359] Metadata directory not provided
I20260807 22:44:08.135308 17453 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:44:08.136849 17453 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:44:08.137602 17477 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:08.137780 17453 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 22:44:08.137892 17453 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-1/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-1/wal
uuid: "b0d14a8c27a147d8ac2182c53d547010"
format_stamp: "Formatted at 2026-08-07 22:43:26 on dist-test-slave-2d19"
server_key: "96d65f2b00e1021d124578c0df0ceb06"
server_key_iv: "b4647d720349d1ce7dab8f789938f50c"
server_key_version: "encryptionkey@0"
I20260807 22:44:08.138319 17453 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:44:08.153792 17453 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:44:08.156376 17453 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:44:08.156560 17453 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:44:08.156845 17453 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:44:08.157339 17487 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 22:44:08.158988 17453 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 22:44:08.159058 17453 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260807 22:44:08.159102 17453 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 22:44:08.159783 17453 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 22:44:08.159845 17453 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260807 22:44:08.159917 17487 tablet_bootstrap.cc:492] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010: Bootstrap starting.
I20260807 22:44:08.167603 17453 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.66:39333
I20260807 22:44:08.167714 17668 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.66:39333 every 8 connection(s)
I20260807 22:44:08.168089 17453 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
I20260807 22:44:08.169431 17674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:08.168941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.66:52107)
0807 22:44:08.169151 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:08.169241 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":91,"threads_started":1}
I20260807 22:44:08.169425 17487 log.cc:824] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010: Log is configured to *not* fsync() on all Append() calls
W20260807 22:44:08.169727 17669 heartbeater.cc:644] Failed to heartbeat to 127.22.212.126:45651 (0 consecutive failures): Network error: Failed to ping master at 127.22.212.126:45651: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
I20260807 22:44:08.170054 17674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:08.169960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.66:43563)
0807 22:44:08.169995 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:08.170033 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260807 22:44:08.170385 17674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:08.170293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.66:54457)
0807 22:44:08.170342 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:08.170367 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260807 22:44:08.170526 17669 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 22:44:08.171821 17487 tablet_bootstrap.cc:492] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 22:44:08.172168 17487 tablet_bootstrap.cc:492] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010: Bootstrap complete.
I20260807 22:44:08.173209 17487 ts_tablet_manager.cc:1397] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.012s
I20260807 22:44:08.174446 17487 raft_consensus.cc:348] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68deaa8ea7584b4e9a1558e41cab1bad" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 40323 } } peers { permanent_uuid: "b0d14a8c27a147d8ac2182c53d547010" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 39333 } } peers { permanent_uuid: "12a897c2d39d4336ab0962100ec3f908" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 41521 } }
I20260807 22:44:08.174703 17487 raft_consensus.cc:729] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0d14a8c27a147d8ac2182c53d547010, State: Initialized, Role: FOLLOWER
I20260807 22:44:08.174865 17487 consensus_queue.cc:260] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68deaa8ea7584b4e9a1558e41cab1bad" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 40323 } } peers { permanent_uuid: "b0d14a8c27a147d8ac2182c53d547010" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 39333 } } peers { permanent_uuid: "12a897c2d39d4336ab0962100ec3f908" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 41521 } }
I20260807 22:44:08.175127 17487 ts_tablet_manager.cc:1428] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260807 22:44:08.175418 17674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:08.175308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.66:46277)
0807 22:44:08.175369 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:08.175399 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260807 22:44:08.175696 17674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:08.175644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.66:41765)
0807 22:44:08.175666 (+ 22us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:08.175684 (+ 18us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":12}
I20260807 22:44:08.178288 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 17453
I20260807 22:44:08.178506 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.67:40323
--local_ip_for_outbound_sockets=127.22.212.67
--tserver_master_addrs=127.22.212.126:45651
--webserver_port=39781
--webserver_interface=127.22.212.67
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:35629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:44:08.264387 17677 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:44:08.264596 17677 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:44:08.264621 17677 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:44:08.265763 17677 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:44:08.265805 17677 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:44:08.265830 17677 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.67
I20260807 22:44:08.267266 17677 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:35629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.67:40323
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.212.67
--webserver_port=39781
--tserver_master_addrs=127.22.212.126:45651
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17677
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.67
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:44:08.267462 17677 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:44:08.267649 17677 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:44:08.273092 17691 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:08.273008 17688 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:08.273154 17689 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:08.273603 17677 server_base.cc:1034] running on GCE node
I20260807 22:44:08.273765 17677 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:44:08.274019 17677 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:44:08.275164 17677 hybrid_clock.cc:648] HybridClock initialized: now 1786142648275154 us; error 31 us; skew 500 ppm
Aug 07 22:44:08 dist-test-slave-2d19 krb5kdc[15325](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142648, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:44:08.277848 17677 init.cc:377] Logged in from keytab as kudu/127.22.212.67@KRBTEST.COM (short username kudu)
I20260807 22:44:08.278285 17677 webserver.cc:460] Webserver started at http://127.22.212.67:39781/ using document root <none> and password file <none>
I20260807 22:44:08.278539 17677 fs_manager.cc:359] Metadata directory not provided
I20260807 22:44:08.278586 17677 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:44:08.279959 17677 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:44:08.280666 17702 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:08.280872 17677 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260807 22:44:08.280947 17677 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/wal
uuid: "68deaa8ea7584b4e9a1558e41cab1bad"
format_stamp: "Formatted at 2026-08-07 22:43:26 on dist-test-slave-2d19"
server_key: "8639ee454aaf8a389220f71becf4ddda"
server_key_iv: "ec467386b1f4b3eccb66c4decc931ad1"
server_key_version: "encryptionkey@0"
I20260807 22:44:08.281298 17677 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:44:08.294956 17677 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:44:08.297359 17677 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:44:08.297528 17677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:44:08.297767 17677 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:44:08.298084 17677 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:44:08.298159 17677 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:08.298195 17677 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:44:08.298228 17677 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:08.304563 17677 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.67:40323
I20260807 22:44:08.304701 17877 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.67:40323 every 8 connection(s)
I20260807 22:44:08.305009 17677 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
I20260807 22:44:08.306075 17880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:08.305708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.67:46927)
0807 22:44:08.305860 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:08.305930 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":69,"threads_started":1}
W20260807 22:44:08.306561 17878 heartbeater.cc:644] Failed to heartbeat to 127.22.212.126:45651 (0 consecutive failures): Network error: Failed to ping master at 127.22.212.126:45651: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
I20260807 22:44:08.306890 17880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:08.306798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.67:46771)
0807 22:44:08.306845 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:08.306871 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260807 22:44:08.307158 17880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:08.307106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.67:38957)
0807 22:44:08.307126 (+ 20us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:08.307146 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":11}
W20260807 22:44:08.307294 17878 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 22:44:08.314610 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 17677
I20260807 22:44:09.102164 17882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:09.101844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.65:44377)
0807 22:44:09.102039 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:09.102094 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":65,"threads_started":1}
I20260807 22:44:09.176429 17883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:09.176101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.66:34751)
0807 22:44:09.176317 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:09.176367 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":62,"threads_started":1}
I20260807 22:44:09.308001 17884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:09.307678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.67:43159)
0807 22:44:09.307862 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:09.307932 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":123,"threads_started":1}
I20260807 22:44:09.377254 17885 raft_consensus.cc:482] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:44:09.377440 17885 raft_consensus.cc:504] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68deaa8ea7584b4e9a1558e41cab1bad" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 40323 } } peers { permanent_uuid: "b0d14a8c27a147d8ac2182c53d547010" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 39333 } } peers { permanent_uuid: "12a897c2d39d4336ab0962100ec3f908" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 41521 } }
I20260807 22:44:09.377818 17885 leader_election.cc:288] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 68deaa8ea7584b4e9a1558e41cab1bad (127.22.212.67:40323), 12a897c2d39d4336ab0962100ec3f908 (127.22.212.65:41521)
Aug 07 22:44:09 dist-test-slave-2d19 krb5kdc[15325](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142648, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for kudu/127.22.212.65@KRBTEST.COM
Aug 07 22:44:09 dist-test-slave-2d19 krb5kdc[15325](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142648, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for kudu/127.22.212.67@KRBTEST.COM
I20260807 22:44:09.389806 17886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:09.378120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:36275 (local address 127.22.212.67:40323)
0807 22:44:09.378306 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:09.378318 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:09.378358 (+ 40us) server_negotiation.cc:407] Connection header received
0807 22:44:09.378956 (+ 598us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:09.378959 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:09.379000 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:09.379116 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:09.379536 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:09.380975 (+ 1439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:09.382138 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:09.382579 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:09.382706 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:09.385697 (+ 2991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:09.385701 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:09.385702 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:44:09.385713 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:09.387933 (+ 2220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:09.388368 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:09.388371 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:09.388372 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:09.388516 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:09.388839 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:09.388840 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:09.388840 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:09.389139 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:09.389226 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:09.389547 (+ 321us) server_negotiation.cc:299] Negotiation successful
0807 22:44:09.389684 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":61,"threads_started":1}
I20260807 22:44:09.389793 17883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:09.377995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.67:40323 (local address 127.22.212.66:36275)
0807 22:44:09.378058 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:09.378088 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:09.378278 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:09.379146 (+ 868us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:09.379146 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:09.379316 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:44:09.379370 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:09.379377 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:09.381092 (+ 1715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:09.381093 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:09.382039 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:09.382042 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:09.382682 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:09.382683 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:09.382795 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:09.383539 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:44:09.383543 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:44:09.385578 (+ 2035us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:44:09.388041 (+ 2463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:44:09.388042 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:44:09.388042 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:44:09.388231 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:44:09.388625 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:44:09.388626 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:44:09.388626 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:44:09.388710 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:44:09.389259 (+ 549us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:44:09.389260 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:44:09.389368 (+ 108us) client_negotiation.cc:769] Sending connection context
0807 22:44:09.389487 (+ 119us) client_negotiation.cc:240] Negotiation successful
0807 22:44:09.389698 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":26}
I20260807 22:44:09.390172 17889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:09.378257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:45323 (local address 127.22.212.65:41521)
0807 22:44:09.378413 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:09.378416 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:09.378425 (+ 9us) server_negotiation.cc:407] Connection header received
0807 22:44:09.378485 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:09.378487 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:09.378510 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:09.378613 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:09.379518 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:09.380976 (+ 1458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:09.382174 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:09.382592 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:09.382731 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:09.385300 (+ 2569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:09.385304 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:09.385304 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:44:09.385334 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:09.387519 (+ 2185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:09.388090 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:09.388094 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:09.388094 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:09.388324 (+ 230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:09.388812 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:09.388813 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:09.388814 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:09.389140 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:09.389226 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:09.389981 (+ 755us) server_negotiation.cc:299] Negotiation successful
0807 22:44:09.390106 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":65,"threads_started":1}
I20260807 22:44:09.390604 17888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:09.378138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:41521 (local address 127.22.212.66:45323)
0807 22:44:09.378254 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:09.378263 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:09.378307 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:09.378701 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:09.378706 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:09.379059 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:44:09.379369 (+ 310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:09.379377 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:09.381116 (+ 1739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:09.381117 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:09.382040 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:09.382043 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:09.382714 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:09.382715 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:09.382796 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:09.383429 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:44:09.383439 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:44:09.385197 (+ 1758us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:44:09.387625 (+ 2428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:44:09.387631 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:44:09.387634 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:44:09.387948 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:44:09.388431 (+ 483us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:44:09.388432 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:44:09.388432 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:44:09.388572 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:44:09.389218 (+ 646us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:44:09.389225 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:44:09.389376 (+ 151us) client_negotiation.cc:769] Sending connection context
0807 22:44:09.389489 (+ 113us) client_negotiation.cc:240] Negotiation successful
0807 22:44:09.389801 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"mutex_wait_us":185,"thread_start_us":69,"threads_started":1}
W20260807 22:44:09.390892 17479 leader_election.cc:341] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 68deaa8ea7584b4e9a1558e41cab1bad (127.22.212.67:40323): Not found: Tablet not found: ff71afc3f1e94096a9a0642efadd5aaa
I20260807 22:44:09.391242 17364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff71afc3f1e94096a9a0642efadd5aaa" candidate_uuid: "b0d14a8c27a147d8ac2182c53d547010" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "12a897c2d39d4336ab0962100ec3f908" is_pre_election: true
I20260807 22:44:09.391371 17364 raft_consensus.cc:2454] T ff71afc3f1e94096a9a0642efadd5aaa P 12a897c2d39d4336ab0962100ec3f908 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0d14a8c27a147d8ac2182c53d547010 in term 1.
I20260807 22:44:09.391637 17479 leader_election.cc:302] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 12a897c2d39d4336ab0962100ec3f908, b0d14a8c27a147d8ac2182c53d547010; no voters: 68deaa8ea7584b4e9a1558e41cab1bad
I20260807 22:44:09.391784 17885 raft_consensus.cc:2781] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 22:44:09.391901 17885 raft_consensus.cc:482] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:44:09.391944 17885 raft_consensus.cc:3037] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010 [term 1 FOLLOWER]: Advancing to term 2
I20260807 22:44:09.393149 17885 raft_consensus.cc:504] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68deaa8ea7584b4e9a1558e41cab1bad" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 40323 } } peers { permanent_uuid: "b0d14a8c27a147d8ac2182c53d547010" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 39333 } } peers { permanent_uuid: "12a897c2d39d4336ab0962100ec3f908" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 41521 } }
I20260807 22:44:09.393301 17885 leader_election.cc:288] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010 [CANDIDATE]: Term 2 election: Requested vote from peers 68deaa8ea7584b4e9a1558e41cab1bad (127.22.212.67:40323), 12a897c2d39d4336ab0962100ec3f908 (127.22.212.65:41521)
I20260807 22:44:09.393519 17364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff71afc3f1e94096a9a0642efadd5aaa" candidate_uuid: "b0d14a8c27a147d8ac2182c53d547010" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "12a897c2d39d4336ab0962100ec3f908"
I20260807 22:44:09.393601 17364 raft_consensus.cc:3037] T ff71afc3f1e94096a9a0642efadd5aaa P 12a897c2d39d4336ab0962100ec3f908 [term 1 FOLLOWER]: Advancing to term 2
W20260807 22:44:09.393628 17479 leader_election.cc:341] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 68deaa8ea7584b4e9a1558e41cab1bad (127.22.212.67:40323): Not found: Tablet not found: ff71afc3f1e94096a9a0642efadd5aaa
I20260807 22:44:09.394724 17364 raft_consensus.cc:2454] T ff71afc3f1e94096a9a0642efadd5aaa P 12a897c2d39d4336ab0962100ec3f908 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0d14a8c27a147d8ac2182c53d547010 in term 2.
I20260807 22:44:09.394918 17479 leader_election.cc:302] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 12a897c2d39d4336ab0962100ec3f908, b0d14a8c27a147d8ac2182c53d547010; no voters: 68deaa8ea7584b4e9a1558e41cab1bad
I20260807 22:44:09.395025 17885 raft_consensus.cc:2781] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 22:44:09.395153 17885 raft_consensus.cc:686] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010 [term 2 LEADER]: Becoming Leader. State: Replica: b0d14a8c27a147d8ac2182c53d547010, State: Running, Role: LEADER
I20260807 22:44:09.395249 17885 consensus_queue.cc:237] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68deaa8ea7584b4e9a1558e41cab1bad" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 40323 } } peers { permanent_uuid: "b0d14a8c27a147d8ac2182c53d547010" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 39333 } } peers { permanent_uuid: "12a897c2d39d4336ab0962100ec3f908" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 41521 } }
I20260807 22:44:09.395522 17888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:09.395434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.66:49143)
0807 22:44:09.395471 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:09.395497 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
I20260807 22:44:09.791374 17364 raft_consensus.cc:1261] T ff71afc3f1e94096a9a0642efadd5aaa P 12a897c2d39d4336ab0962100ec3f908 [term 2 FOLLOWER]: Refusing update from remote peer b0d14a8c27a147d8ac2182c53d547010: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260807 22:44:09.791800 17885 consensus_queue.cc:1035] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12a897c2d39d4336ab0962100ec3f908" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 41521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 22:44:09.792928 17895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:09.792685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.65:51837)
0807 22:44:09.792819 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:09.792880 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":68,"threads_started":1}
I20260807 22:44:09.793881 17888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:09.793774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.66:47519)
0807 22:44:09.793818 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:09.793847 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260807 22:44:09.794099 17479 consensus_peers.cc:487] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010 -> Peer 68deaa8ea7584b4e9a1558e41cab1bad (127.22.212.67:40323): Couldn't send request to peer 68deaa8ea7584b4e9a1558e41cab1bad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ff71afc3f1e94096a9a0642efadd5aaa. This is attempt 1: this message will repeat every 5th retry.
I20260807 22:44:09.794143 17895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:09.794056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.65:38245)
0807 22:44:09.794097 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:09.794123 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
I20260807 22:44:10.218545 17901 ts_tablet_manager.cc:927] T ff71afc3f1e94096a9a0642efadd5aaa P 68deaa8ea7584b4e9a1558e41cab1bad: Initiating tablet copy from peer b0d14a8c27a147d8ac2182c53d547010 (127.22.212.66:39333)
I20260807 22:44:10.218888 17901 tablet_copy_client.cc:316] T ff71afc3f1e94096a9a0642efadd5aaa P 68deaa8ea7584b4e9a1558e41cab1bad: tablet copy: Beginning tablet copy session from remote peer at address 127.22.212.66:39333
Aug 07 22:44:10 dist-test-slave-2d19 krb5kdc[15325](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142648, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for kudu/127.22.212.66@KRBTEST.COM
I20260807 22:44:10.227654 17907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:10.219217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.66:39333 (local address 127.22.212.67:56719)
0807 22:44:10.219424 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:10.219443 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:10.219510 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:10.219654 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:10.219657 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:10.220026 (+ 369us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:44:10.220098 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:10.220101 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:10.221119 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:10.221120 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:10.221735 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:10.221737 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:10.222243 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:10.222244 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:10.222315 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:10.222917 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:44:10.222922 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:44:10.224458 (+ 1536us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:44:10.226357 (+ 1899us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:44:10.226365 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:44:10.226367 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:44:10.226578 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:44:10.226842 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:44:10.226843 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:44:10.226843 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:44:10.226909 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:44:10.227238 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:44:10.227245 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:44:10.227308 (+ 63us) client_negotiation.cc:769] Sending connection context
0807 22:44:10.227398 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 22:44:10.227530 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":117,"threads_started":1}
I20260807 22:44:10.227661 17908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:10.219340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:56719 (local address 127.22.212.66:39333)
0807 22:44:10.219473 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:10.219479 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:10.219495 (+ 16us) server_negotiation.cc:407] Connection header received
0807 22:44:10.219566 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:10.219568 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:10.219582 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:10.219649 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:10.220213 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:10.221011 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:10.221830 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:10.222157 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:10.222218 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:10.224572 (+ 2354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:10.224581 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:10.224581 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:44:10.224591 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:10.226241 (+ 1650us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:10.226688 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:10.226692 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:10.226692 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:10.226762 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:10.226982 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:10.226983 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:10.226983 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:10.227147 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:10.227246 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:10.227460 (+ 214us) server_negotiation.cc:299] Negotiation successful
0807 22:44:10.227565 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":75,"threads_started":1}
I20260807 22:44:10.228191 17617 tablet_copy_service.cc:140] P b0d14a8c27a147d8ac2182c53d547010: Received BeginTabletCopySession request for tablet ff71afc3f1e94096a9a0642efadd5aaa from peer 68deaa8ea7584b4e9a1558e41cab1bad ({username='kudu', principal='kudu/127.22.212.67@KRBTEST.COM'} at 127.22.212.67:56719)
I20260807 22:44:10.228317 17617 tablet_copy_service.cc:161] P b0d14a8c27a147d8ac2182c53d547010: Beginning new tablet copy session on tablet ff71afc3f1e94096a9a0642efadd5aaa from peer 68deaa8ea7584b4e9a1558e41cab1bad at {username='kudu', principal='kudu/127.22.212.67@KRBTEST.COM'} at 127.22.212.67:56719: session id = 68deaa8ea7584b4e9a1558e41cab1bad-ff71afc3f1e94096a9a0642efadd5aaa
I20260807 22:44:10.228802 17617 tablet_copy_source_session.cc:205] T ff71afc3f1e94096a9a0642efadd5aaa P b0d14a8c27a147d8ac2182c53d547010: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 22:44:10.229992 17901 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff71afc3f1e94096a9a0642efadd5aaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:44:10.232764 17901 tablet_copy_client.cc:791] T ff71afc3f1e94096a9a0642efadd5aaa P 68deaa8ea7584b4e9a1558e41cab1bad: tablet copy: Starting download of 0 data blocks...
I20260807 22:44:10.232926 17901 tablet_copy_client.cc:655] T ff71afc3f1e94096a9a0642efadd5aaa P 68deaa8ea7584b4e9a1558e41cab1bad: tablet copy: Starting download of 1 WAL segments...
I20260807 22:44:10.233840 17901 tablet_copy_client.cc:531] T ff71afc3f1e94096a9a0642efadd5aaa P 68deaa8ea7584b4e9a1558e41cab1bad: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 22:44:10.234493 17901 tablet_bootstrap.cc:492] T ff71afc3f1e94096a9a0642efadd5aaa P 68deaa8ea7584b4e9a1558e41cab1bad: Bootstrap starting.
I20260807 22:44:10.235791 17901 log.cc:824] T ff71afc3f1e94096a9a0642efadd5aaa P 68deaa8ea7584b4e9a1558e41cab1bad: Log is configured to *not* fsync() on all Append() calls
I20260807 22:44:10.238308 17901 tablet_bootstrap.cc:492] T ff71afc3f1e94096a9a0642efadd5aaa P 68deaa8ea7584b4e9a1558e41cab1bad: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 22:44:10.238510 17901 tablet_bootstrap.cc:492] T ff71afc3f1e94096a9a0642efadd5aaa P 68deaa8ea7584b4e9a1558e41cab1bad: Bootstrap complete.
I20260807 22:44:10.238607 17901 ts_tablet_manager.cc:1397] T ff71afc3f1e94096a9a0642efadd5aaa P 68deaa8ea7584b4e9a1558e41cab1bad: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260807 22:44:10.239521 17901 raft_consensus.cc:348] T ff71afc3f1e94096a9a0642efadd5aaa P 68deaa8ea7584b4e9a1558e41cab1bad [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68deaa8ea7584b4e9a1558e41cab1bad" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 40323 } } peers { permanent_uuid: "b0d14a8c27a147d8ac2182c53d547010" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 39333 } } peers { permanent_uuid: "12a897c2d39d4336ab0962100ec3f908" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 41521 } }
I20260807 22:44:10.239661 17901 raft_consensus.cc:729] T ff71afc3f1e94096a9a0642efadd5aaa P 68deaa8ea7584b4e9a1558e41cab1bad [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68deaa8ea7584b4e9a1558e41cab1bad, State: Initialized, Role: FOLLOWER
I20260807 22:44:10.239816 17901 consensus_queue.cc:260] T ff71afc3f1e94096a9a0642efadd5aaa P 68deaa8ea7584b4e9a1558e41cab1bad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68deaa8ea7584b4e9a1558e41cab1bad" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 40323 } } peers { permanent_uuid: "b0d14a8c27a147d8ac2182c53d547010" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 39333 } } peers { permanent_uuid: "12a897c2d39d4336ab0962100ec3f908" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 41521 } }
I20260807 22:44:10.240137 17901 ts_tablet_manager.cc:1428] T ff71afc3f1e94096a9a0642efadd5aaa P 68deaa8ea7584b4e9a1558e41cab1bad: Time spent starting tablet: real 0.001s user 0.000s sys 0.004s
I20260807 22:44:10.240612 17907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:10.240462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.67:48113)
0807 22:44:10.240544 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:10.240580 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260807 22:44:10.240689 17617 tablet_copy_service.cc:342] P b0d14a8c27a147d8ac2182c53d547010: Request end of tablet copy session 68deaa8ea7584b4e9a1558e41cab1bad-ff71afc3f1e94096a9a0642efadd5aaa received from {username='kudu', principal='kudu/127.22.212.67@KRBTEST.COM'} at 127.22.212.67:56719
I20260807 22:44:10.240768 17617 tablet_copy_service.cc:433] P b0d14a8c27a147d8ac2182c53d547010: ending tablet copy session 68deaa8ea7584b4e9a1558e41cab1bad-ff71afc3f1e94096a9a0642efadd5aaa on tablet ff71afc3f1e94096a9a0642efadd5aaa with peer 68deaa8ea7584b4e9a1558e41cab1bad
I20260807 22:44:10.240875 17907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:10.240801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.67:45459)
0807 22:44:10.240836 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:10.240857 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
I20260807 22:44:10.747103 17808 raft_consensus.cc:1203] T ff71afc3f1e94096a9a0642efadd5aaa P 68deaa8ea7584b4e9a1558e41cab1bad [term 2 FOLLOWER]: Deduplicated request from leader. Original: 1.2->[2.3-2.3] Dedup: 2.3->[]
I20260807 22:44:10.747182 17912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:10.746975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.66:45895)
0807 22:44:10.747081 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:10.747137 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88,"thread_start_us":68,"threads_started":1}
I20260807 22:44:10.747794 17915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:10.747579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.67:50533)
0807 22:44:10.747682 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:10.747715 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88,"thread_start_us":37,"threads_started":1}
I20260807 22:44:10.794760 17918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:10.794540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.65:34935)
0807 22:44:10.794677 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:10.794713 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":73,"threads_started":1}
I20260807 22:44:11.748040 17919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:11.747789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.66:38155)
0807 22:44:11.747953 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:11.747992 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":74,"threads_started":1}
I20260807 22:44:11.748551 17920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:11.748345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.67:46225)
0807 22:44:11.748472 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:11.748512 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":76,"threads_started":1}
I20260807 22:44:11.795569 17921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:11.795295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.65:41481)
0807 22:44:11.795476 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:11.795520 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":89,"threads_started":1}
I20260807 22:44:12.749101 17922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:12.748662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.66:47633)
0807 22:44:12.749001 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:12.749054 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":66,"threads_started":1}
I20260807 22:44:12.749380 17924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:12.749152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.67:44361)
0807 22:44:12.749286 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:12.749327 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":61,"threads_started":1}
I20260807 22:44:12.796402 17925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:12.796121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.65:45243)
0807 22:44:12.796296 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:12.796338 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":66,"threads_started":1}
I20260807 22:44:13.749980 17926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:13.749723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.66:59621)
0807 22:44:13.749894 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:13.749934 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":109,"threads_started":1}
I20260807 22:44:13.750113 17929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:13.749905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.67:49671)
0807 22:44:13.750017 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:13.750049 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87,"thread_start_us":63,"threads_started":1}
I20260807 22:44:13.750427 17926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:13.750311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.66:56125)
0807 22:44:13.750357 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:13.750402 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260807 22:44:13.797160 17931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:13.796943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.65:32957)
0807 22:44:13.797072 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:13.797113 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":67,"threads_started":1}
I20260807 22:44:14.750982 17932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:14.750750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.67:48899)
0807 22:44:14.750898 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:14.750934 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":92,"threads_started":1}
I20260807 22:44:14.751139 17934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:14.750850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.66:54863)
0807 22:44:14.750991 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:14.751069 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":94,"threads_started":1}
I20260807 22:44:14.797842 17938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:14.797645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.65:35117)
0807 22:44:14.797764 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:14.797794 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":61,"threads_started":1}
I20260807 22:44:15.751734 17939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:15.751502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.67:32925)
0807 22:44:15.751644 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:15.751687 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":78,"threads_started":1}
I20260807 22:44:15.751807 17940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:15.751567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.66:50653)
0807 22:44:15.751716 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:15.751749 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":96,"threads_started":1}
I20260807 22:44:15.798600 17941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:15.798382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.65:60383)
0807 22:44:15.798498 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:15.798536 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":62,"threads_started":1}
I20260807 22:44:16.752545 17942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:16.752212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.67:45035)
0807 22:44:16.752420 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:16.752476 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":121,"threads_started":1}
I20260807 22:44:16.752607 17943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:16.752404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.66:39181)
0807 22:44:16.752530 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:16.752566 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":66,"threads_started":1}
I20260807 22:44:16.799362 17944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:16.799112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.65:57757)
0807 22:44:16.799270 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:16.799314 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":86,"threads_started":1}
I20260807 22:44:17.753249 17945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:17.753028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.67:39797)
0807 22:44:17.753172 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:17.753203 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":89,"threads_started":1}
I20260807 22:44:17.753301 17946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:17.753098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.66:40075)
0807 22:44:17.753220 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:17.753260 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":76,"threads_started":1}
I20260807 22:44:17.800094 17949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:17.799834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.65:33143)
0807 22:44:17.800010 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:17.800046 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":122,"threads_started":1}
I20260807 22:44:18.754011 17950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:18.753763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.67:37135)
0807 22:44:18.753913 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:18.753962 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":68,"threads_started":1}
I20260807 22:44:18.754041 17951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:18.753803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.66:55821)
0807 22:44:18.753958 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:18.753994 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":92,"threads_started":1}
I20260807 22:44:18.800814 17952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:18.800607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.65:51743)
0807 22:44:18.800731 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:18.800768 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":69,"threads_started":1}
I20260807 22:44:19.754890 17956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:19.754658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.66:35997)
0807 22:44:19.754807 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:19.754837 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":79,"threads_started":1}
I20260807 22:44:19.754884 17955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:19.754658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.67:35183)
0807 22:44:19.754798 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:19.754838 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":79,"threads_started":1}
I20260807 22:44:19.801532 17957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:19.801289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.65:50527)
0807 22:44:19.801425 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:19.801467 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":81,"threads_started":1}
I20260807 22:44:20.755613 17959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:20.755382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.66:44811)
0807 22:44:20.755516 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:20.755549 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":80,"threads_started":1}
I20260807 22:44:20.755661 17962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:20.755450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.67:47589)
0807 22:44:20.755582 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:20.755620 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":92,"threads_started":1}
I20260807 22:44:20.802305 17963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:20.801989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.65:41781)
0807 22:44:20.802147 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:20.802208 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":105,"threads_started":1}
I20260807 22:44:21.756465 17964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:21.756191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.66:40723)
0807 22:44:21.756377 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:21.756415 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":112,"threads_started":1}
I20260807 22:44:21.756484 17965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:21.756206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.67:50813)
0807 22:44:21.756394 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:21.756435 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":141,"threads_started":1}
I20260807 22:44:21.803004 17966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:21.802759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.65:37617)
0807 22:44:21.802910 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:21.802956 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":70,"threads_started":1}
I20260807 22:44:22.757198 17969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:22.756971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.66:50087)
0807 22:44:22.757132 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:22.757159 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":91,"threads_started":1}
I20260807 22:44:22.757191 17967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:22.756969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.67:40239)
0807 22:44:22.757108 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:22.757147 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":88,"threads_started":1}
I20260807 22:44:22.803725 17971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:22.803452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:45651 (local address 127.22.212.65:50323)
0807 22:44:22.803639 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:22.803677 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.126:45651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":119,"threads_started":1}
I20260807 22:44:23.323689 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 17168
I20260807 22:44:23.336748 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 17453
I20260807 22:44:23.347687 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 17677
2026-08-07T22:44:23Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58984 ms)
[----------] 30 tests from SecurityITest (244718 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:44:23 dist-test-slave-2d19 krb5kdc[17977](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:44:23 dist-test-slave-2d19 krb5kdc[17977](info): set up 2 sockets
Aug 07 22:44:23 dist-test-slave-2d19 krb5kdc[17977](info): commencing operation
krb5kdc: starting...
W20260807 22:44:24.616447 23377 mini_kdc.cc:121] Time spent starting KDC: real 1.243s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Aug 07 22:44:24 dist-test-slave-2d19 krb5kdc[17977](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142664, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:44:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:44:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.212.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
I20260807 22:44:24.743122 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:34755
--webserver_interface=127.22.212.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:42623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:34755
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:44:24.827518 17995 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:44:24.827785 17995 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:44:24.827826 17995 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:44:24.829068 17995 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:44:24.829136 17995 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:44:24.829160 17995 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:44:24.829182 17995 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:44:24.829209 17995 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:44:24.830693 17995 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:42623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:34755
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:34755
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17995
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:44:24.830993 17995 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:44:24.831228 17995 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:44:24.836557 18004 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:24.836578 18011 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:24.836587 18008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:24.836578 17995 server_base.cc:1034] running on GCE node
I20260807 22:44:24.837059 17995 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:44:24.837373 17995 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:44:24.838550 17995 hybrid_clock.cc:648] HybridClock initialized: now 1786142664838534 us; error 45 us; skew 500 ppm
Aug 07 22:44:24 dist-test-slave-2d19 krb5kdc[17977](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142664, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:44:24.841207 17995 init.cc:377] Logged in from keytab as kudu/127.22.212.126@KRBTEST.COM (short username kudu)
I20260807 22:44:24.841662 17995 webserver.cc:460] Webserver started at http://127.22.212.126:35371/ using document root <none> and password file <none>
I20260807 22:44:24.841903 17995 fs_manager.cc:359] Metadata directory not provided
I20260807 22:44:24.841972 17995 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:44:24.842131 17995 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:44:24.843218 17995 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "0db8d8573803418f9c63780efbf9e96a"
format_stamp: "Formatted at 2026-08-07 22:44:24 on dist-test-slave-2d19"
server_key: "c07d060a4056b3548c50eb4a58dc2a9a"
server_key_iv: "0aff810a9076c5275f20acb8fbe5d84f"
server_key_version: "encryptionkey@0"
I20260807 22:44:24.843597 17995 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "0db8d8573803418f9c63780efbf9e96a"
format_stamp: "Formatted at 2026-08-07 22:44:24 on dist-test-slave-2d19"
server_key: "c07d060a4056b3548c50eb4a58dc2a9a"
server_key_iv: "0aff810a9076c5275f20acb8fbe5d84f"
server_key_version: "encryptionkey@0"
I20260807 22:44:24.845180 17995 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 22:44:24.846002 18022 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:24.846230 17995 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 22:44:24.846349 17995 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "0db8d8573803418f9c63780efbf9e96a"
format_stamp: "Formatted at 2026-08-07 22:44:24 on dist-test-slave-2d19"
server_key: "c07d060a4056b3548c50eb4a58dc2a9a"
server_key_iv: "0aff810a9076c5275f20acb8fbe5d84f"
server_key_version: "encryptionkey@0"
I20260807 22:44:24.846436 17995 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:44:24.854794 17995 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:44:24.856644 17995 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:44:24.856799 17995 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:44:24.860838 17995 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:34755
I20260807 22:44:24.860872 18104 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:34755 every 8 connection(s)
I20260807 22:44:24.861230 17995 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:44:24.862144 18105 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:44:24.864557 18105 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0db8d8573803418f9c63780efbf9e96a: Bootstrap starting.
I20260807 22:44:24.865146 18105 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0db8d8573803418f9c63780efbf9e96a: Neither blocks nor log segments found. Creating new log.
I20260807 22:44:24.865449 18105 log.cc:824] T 00000000000000000000000000000000 P 0db8d8573803418f9c63780efbf9e96a: Log is configured to *not* fsync() on all Append() calls
I20260807 22:44:24.866233 18105 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0db8d8573803418f9c63780efbf9e96a: No bootstrap required, opened a new log
I20260807 22:44:24.867834 18105 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0db8d8573803418f9c63780efbf9e96a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0db8d8573803418f9c63780efbf9e96a" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 34755 } }
I20260807 22:44:24.867970 18105 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0db8d8573803418f9c63780efbf9e96a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:44:24.867993 18105 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0db8d8573803418f9c63780efbf9e96a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0db8d8573803418f9c63780efbf9e96a, State: Initialized, Role: FOLLOWER
I20260807 22:44:24.868167 18105 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0db8d8573803418f9c63780efbf9e96a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0db8d8573803418f9c63780efbf9e96a" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 34755 } }
I20260807 22:44:24.868235 18105 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0db8d8573803418f9c63780efbf9e96a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:44:24.868306 18105 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0db8d8573803418f9c63780efbf9e96a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:44:24.868364 18105 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0db8d8573803418f9c63780efbf9e96a [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:44:24.868911 18105 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0db8d8573803418f9c63780efbf9e96a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0db8d8573803418f9c63780efbf9e96a" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 34755 } }
I20260807 22:44:24.868935 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 17995
I20260807 22:44:24.869042 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:44:24.868999 18105 leader_election.cc:302] T 00000000000000000000000000000000 P 0db8d8573803418f9c63780efbf9e96a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0db8d8573803418f9c63780efbf9e96a; no voters:
I20260807 22:44:24.869230 23377 external_mini_cluster.cc:1428] Setting key ea572c206a7c997ea67ac16072f600b0
I20260807 22:44:24.869226 18105 leader_election.cc:288] T 00000000000000000000000000000000 P 0db8d8573803418f9c63780efbf9e96a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:44:24.869253 18110 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0db8d8573803418f9c63780efbf9e96a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:44:24.869366 18110 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0db8d8573803418f9c63780efbf9e96a [term 1 LEADER]: Becoming Leader. State: Replica: 0db8d8573803418f9c63780efbf9e96a, State: Running, Role: LEADER
I20260807 22:44:24.869444 18110 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0db8d8573803418f9c63780efbf9e96a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0db8d8573803418f9c63780efbf9e96a" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 34755 } }
I20260807 22:44:24.869500 18105 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0db8d8573803418f9c63780efbf9e96a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:44:24.869751 18110 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0db8d8573803418f9c63780efbf9e96a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0db8d8573803418f9c63780efbf9e96a. Latest consensus state: current_term: 1 leader_uuid: "0db8d8573803418f9c63780efbf9e96a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0db8d8573803418f9c63780efbf9e96a" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 34755 } } }
I20260807 22:44:24.869843 18110 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0db8d8573803418f9c63780efbf9e96a [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:24.870044 18112 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0db8d8573803418f9c63780efbf9e96a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0db8d8573803418f9c63780efbf9e96a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0db8d8573803418f9c63780efbf9e96a" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 34755 } } }
I20260807 22:44:24.870154 18117 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:44:24.870183 18112 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0db8d8573803418f9c63780efbf9e96a [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:24.871232 18117 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:44:24.873227 18117 catalog_manager.cc:1347] Generated new cluster ID: b2ccf06665824c338f30d0b4a260ed48
I20260807 22:44:24.873302 18117 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 22:44:24 dist-test-slave-2d19 krb5kdc[17977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142664, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:44:24.882072 18115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:24.869743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45008 (local address 127.22.212.126:34755)
0807 22:44:24.870218 (+ 475us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:24.870229 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:24.870266 (+ 37us) server_negotiation.cc:407] Connection header received
0807 22:44:24.870389 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:24.870396 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:24.870453 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:24.870595 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:24.871520 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:24.873054 (+ 1534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:24.874141 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:24.874746 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:24.874856 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:24.877697 (+ 2841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:24.877702 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:24.877702 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:44:24.877715 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:24.880403 (+ 2688us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:24.880786 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:24.880790 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:24.880790 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:24.880917 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:24.881133 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:24.881134 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:24.881135 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:24.881454 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:24.881626 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:24.881699 (+ 73us) server_negotiation.cc:299] Negotiation successful
0807 22:44:24.881842 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":419,"thread_start_us":75,"threads_started":1}
I20260807 22:44:24.902671 18117 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:44:24.903451 18117 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:44:24.910868 18117 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0db8d8573803418f9c63780efbf9e96a: Generated new TSK 0
I20260807 22:44:24.911075 18117 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.212.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab.
Entry for principal kudu/127.22.212.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab.
I20260807 22:44:24.947909 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.65:0
--local_ip_for_outbound_sockets=127.22.212.65
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:34755
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:42623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:44:25.034090 18142 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:44:25.034297 18142 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:44:25.034323 18142 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:44:25.035513 18142 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:44:25.035557 18142 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:44:25.035614 18142 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.65
I20260807 22:44:25.037397 18142 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:42623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:34755
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18142
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.65
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:44:25.037683 18142 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:44:25.037981 18142 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:44:25.043344 18157 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:25.043486 18142 server_base.cc:1034] running on GCE node
W20260807 22:44:25.043638 18155 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:25.043684 18154 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:25.044023 18142 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:44:25.044333 18142 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:44:25.045504 18142 hybrid_clock.cc:648] HybridClock initialized: now 1786142665045488 us; error 32 us; skew 500 ppm
Aug 07 22:44:25 dist-test-slave-2d19 krb5kdc[17977](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142665, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:44:25.048040 18142 init.cc:377] Logged in from keytab as kudu/127.22.212.65@KRBTEST.COM (short username kudu)
I20260807 22:44:25.048571 18142 webserver.cc:460] Webserver started at http://127.22.212.65:43153/ using document root <none> and password file <none>
I20260807 22:44:25.048811 18142 fs_manager.cc:359] Metadata directory not provided
I20260807 22:44:25.048859 18142 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:44:25.049000 18142 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:44:25.050149 18142 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-0/data/instance:
uuid: "a76fa72468a6474da6e779a74d7f4dec"
format_stamp: "Formatted at 2026-08-07 22:44:25 on dist-test-slave-2d19"
server_key: "b840b75750694788b13d297b0c970c43"
server_key_iv: "18c3db7eb481588eed25c6d33f056f7c"
server_key_version: "encryptionkey@0"
I20260807 22:44:25.050611 18142 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance:
uuid: "a76fa72468a6474da6e779a74d7f4dec"
format_stamp: "Formatted at 2026-08-07 22:44:25 on dist-test-slave-2d19"
server_key: "b840b75750694788b13d297b0c970c43"
server_key_iv: "18c3db7eb481588eed25c6d33f056f7c"
server_key_version: "encryptionkey@0"
I20260807 22:44:25.052016 18142 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260807 22:44:25.052889 18165 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:25.053081 18142 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 22:44:25.053177 18142 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-0/wal
uuid: "a76fa72468a6474da6e779a74d7f4dec"
format_stamp: "Formatted at 2026-08-07 22:44:25 on dist-test-slave-2d19"
server_key: "b840b75750694788b13d297b0c970c43"
server_key_iv: "18c3db7eb481588eed25c6d33f056f7c"
server_key_version: "encryptionkey@0"
I20260807 22:44:25.053257 18142 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:44:25.060555 18142 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:44:25.062371 18142 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:44:25.062544 18142 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:44:25.062770 18142 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:44:25.063103 18142 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:44:25.063163 18142 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:25.063205 18142 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:44:25.063234 18142 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:25.069293 18142 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.65:34473
I20260807 22:44:25.069341 18319 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.65:34473 every 8 connection(s)
I20260807 22:44:25.069721 18142 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
I20260807 22:44:25.074517 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 18142
I20260807 22:44:25.074635 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance
I20260807 22:44:25.074811 23377 external_mini_cluster.cc:1428] Setting key 926a9d7d7a436da29b17035126bd2669
Aug 07 22:44:25 dist-test-slave-2d19 krb5kdc[17977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142665, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:44:25.079691 18115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:25.070445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:48887 (local address 127.22.212.126:34755)
0807 22:44:25.070515 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:25.070517 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:25.070807 (+ 290us) server_negotiation.cc:407] Connection header received
0807 22:44:25.071319 (+ 512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:25.071320 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:25.071335 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:25.071429 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:25.072482 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:25.072973 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:25.073986 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:25.074195 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:25.074246 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:25.076582 (+ 2336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:25.076584 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:25.076584 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:44:25.076592 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:25.078146 (+ 1554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:25.078674 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:25.078675 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:25.078675 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:25.078734 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:25.079024 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:25.079025 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:25.079025 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:25.079139 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:25.079194 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:25.079540 (+ 346us) server_negotiation.cc:299] Negotiation successful
0807 22:44:25.079626 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260807 22:44:25.079948 18323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:25.070430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:34755 (local address 127.22.212.65:48887)
0807 22:44:25.070661 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:25.070702 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:25.071229 (+ 527us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:25.071526 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:25.071530 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:25.072123 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:44:25.072400 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:25.072406 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:25.073088 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:25.073089 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:25.073904 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:25.073906 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:25.074268 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:25.074269 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:25.074442 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:25.075000 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:44:25.075011 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:44:25.076494 (+ 1483us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:44:25.078233 (+ 1739us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:44:25.078240 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:44:25.078243 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:44:25.078574 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:44:25.078809 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:44:25.078810 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:44:25.078810 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:44:25.078954 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:44:25.079204 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:44:25.079210 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:44:25.079378 (+ 168us) client_negotiation.cc:769] Sending connection context
0807 22:44:25.079494 (+ 116us) client_negotiation.cc:240] Negotiation successful
0807 22:44:25.079673 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":115,"threads_started":1}
I20260807 22:44:25.080648 18320 heartbeater.cc:347] Connected to a master server at 127.22.212.126:34755
I20260807 22:44:25.080768 18320 heartbeater.cc:464] Registering TS with master...
I20260807 22:44:25.080987 18320 heartbeater.cc:511] Master 127.22.212.126:34755 requested a full tablet report, sending...
I20260807 22:44:25.081624 18047 ts_manager.cc:194] Registered new tserver with Master: a76fa72468a6474da6e779a74d7f4dec (127.22.212.65:34473)
I20260807 22:44:25.082648 18047 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.65@KRBTEST.COM'} at 127.22.212.65:48887
WARNING: no policy specified for kudu/127.22.212.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab.
Entry for principal kudu/127.22.212.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab.
I20260807 22:44:25.103727 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.66:0
--local_ip_for_outbound_sockets=127.22.212.66
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:34755
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:42623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:44:25.189145 18327 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:44:25.189394 18327 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:44:25.189435 18327 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:44:25.190748 18327 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:44:25.190820 18327 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:44:25.190866 18327 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.66
I20260807 22:44:25.192374 18327 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:42623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:34755
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18327
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.66
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:44:25.192651 18327 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:44:25.192890 18327 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 22:44:25.198287 18327 server_base.cc:1034] running on GCE node
W20260807 22:44:25.198252 18335 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:25.198257 18337 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:25.198354 18334 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:25.198673 18327 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:44:25.198937 18327 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:44:25.200107 18327 hybrid_clock.cc:648] HybridClock initialized: now 1786142665200095 us; error 29 us; skew 500 ppm
Aug 07 22:44:25 dist-test-slave-2d19 krb5kdc[17977](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142665, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:44:25.202790 18327 init.cc:377] Logged in from keytab as kudu/127.22.212.66@KRBTEST.COM (short username kudu)
I20260807 22:44:25.203235 18327 webserver.cc:460] Webserver started at http://127.22.212.66:38713/ using document root <none> and password file <none>
I20260807 22:44:25.203425 18327 fs_manager.cc:359] Metadata directory not provided
I20260807 22:44:25.203466 18327 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:44:25.203568 18327 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:44:25.204685 18327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-1/data/instance:
uuid: "f86b3696547b4c40a5d99d3718c23cbc"
format_stamp: "Formatted at 2026-08-07 22:44:25 on dist-test-slave-2d19"
server_key: "299fbef472567f8f77f2a97c5da448fa"
server_key_iv: "0987f29edd260a188954c3ca7d902386"
server_key_version: "encryptionkey@0"
I20260807 22:44:25.205000 18327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance:
uuid: "f86b3696547b4c40a5d99d3718c23cbc"
format_stamp: "Formatted at 2026-08-07 22:44:25 on dist-test-slave-2d19"
server_key: "299fbef472567f8f77f2a97c5da448fa"
server_key_iv: "0987f29edd260a188954c3ca7d902386"
server_key_version: "encryptionkey@0"
I20260807 22:44:25.206313 18327 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260807 22:44:25.207031 18349 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:25.207233 18327 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260807 22:44:25.207324 18327 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-1/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-1/wal
uuid: "f86b3696547b4c40a5d99d3718c23cbc"
format_stamp: "Formatted at 2026-08-07 22:44:25 on dist-test-slave-2d19"
server_key: "299fbef472567f8f77f2a97c5da448fa"
server_key_iv: "0987f29edd260a188954c3ca7d902386"
server_key_version: "encryptionkey@0"
I20260807 22:44:25.207383 18327 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:44:25.221244 18327 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:44:25.223109 18327 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:44:25.223224 18327 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:44:25.223416 18327 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:44:25.223690 18327 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:44:25.223721 18327 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:25.223742 18327 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:44:25.223754 18327 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:25.229837 18327 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.66:33723
I20260807 22:44:25.229882 18508 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.66:33723 every 8 connection(s)
I20260807 22:44:25.230327 18327 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
Aug 07 22:44:25 dist-test-slave-2d19 krb5kdc[17977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142665, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:44:25.239710 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 18327
I20260807 22:44:25.239799 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance
I20260807 22:44:25.239990 23377 external_mini_cluster.cc:1428] Setting key 03b594de587c55a55dd88356778e62d0
I20260807 22:44:25.241817 18115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:25.231096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:50723 (local address 127.22.212.126:34755)
0807 22:44:25.231141 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:25.231143 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:25.231523 (+ 380us) server_negotiation.cc:407] Connection header received
0807 22:44:25.232354 (+ 831us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:25.232356 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:25.232372 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:25.232445 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:25.233963 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:25.234585 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:25.236090 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:25.236491 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:25.236568 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:25.238691 (+ 2123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:25.238692 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:25.238693 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:44:25.238700 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:25.240381 (+ 1681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:25.240777 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:25.240778 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:25.240779 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:25.240839 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:25.241124 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:25.241125 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:25.241125 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:25.241247 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:25.241331 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:25.241628 (+ 297us) server_negotiation.cc:299] Negotiation successful
0807 22:44:25.241726 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260807 22:44:25.242091 18516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:25.231094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:34755 (local address 127.22.212.66:50723)
0807 22:44:25.231314 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:25.231390 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:25.232204 (+ 814us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:25.232545 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:25.232562 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:25.233516 (+ 954us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:44:25.233833 (+ 317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:25.233840 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:25.234693 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:25.234694 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:25.235991 (+ 1297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:25.235995 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:25.236591 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:25.236593 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:25.236747 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:25.237247 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:44:25.237256 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:44:25.238604 (+ 1348us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:44:25.240450 (+ 1846us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:44:25.240458 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:44:25.240460 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:44:25.240694 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:44:25.240930 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:44:25.240931 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:44:25.240932 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:44:25.241044 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:44:25.241318 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:44:25.241326 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:44:25.241488 (+ 162us) client_negotiation.cc:769] Sending connection context
0807 22:44:25.241605 (+ 117us) client_negotiation.cc:240] Negotiation successful
0807 22:44:25.241766 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":104,"threads_started":1}
I20260807 22:44:25.242637 18512 heartbeater.cc:347] Connected to a master server at 127.22.212.126:34755
I20260807 22:44:25.242738 18512 heartbeater.cc:464] Registering TS with master...
I20260807 22:44:25.242939 18512 heartbeater.cc:511] Master 127.22.212.126:34755 requested a full tablet report, sending...
I20260807 22:44:25.243335 18047 ts_manager.cc:194] Registered new tserver with Master: f86b3696547b4c40a5d99d3718c23cbc (127.22.212.66:33723)
I20260807 22:44:25.243675 18047 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.66@KRBTEST.COM'} at 127.22.212.66:50723
WARNING: no policy specified for kudu/127.22.212.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab.
Entry for principal kudu/127.22.212.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab.
I20260807 22:44:25.267299 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.67:0
--local_ip_for_outbound_sockets=127.22.212.67
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:34755
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:42623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:44:25.350869 18520 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:44:25.351118 18520 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:44:25.351156 18520 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:44:25.352408 18520 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:44:25.352469 18520 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:44:25.352514 18520 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.67
I20260807 22:44:25.353992 18520 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:42623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:34755
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18520
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.67
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:44:25.354282 18520 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:44:25.354519 18520 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:44:25.359957 18529 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:25.359965 18526 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:25.360023 18520 server_base.cc:1034] running on GCE node
W20260807 22:44:25.359959 18527 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:25.360440 18520 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:44:25.360705 18520 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:44:25.361883 18520 hybrid_clock.cc:648] HybridClock initialized: now 1786142665361864 us; error 46 us; skew 500 ppm
Aug 07 22:44:25 dist-test-slave-2d19 krb5kdc[17977](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142665, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:44:25.364650 18520 init.cc:377] Logged in from keytab as kudu/127.22.212.67@KRBTEST.COM (short username kudu)
I20260807 22:44:25.365114 18520 webserver.cc:460] Webserver started at http://127.22.212.67:36053/ using document root <none> and password file <none>
I20260807 22:44:25.365371 18520 fs_manager.cc:359] Metadata directory not provided
I20260807 22:44:25.365442 18520 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:44:25.365608 18520 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:44:25.366755 18520 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-2/data/instance:
uuid: "1ff91a6bd2034effa176d3c84f7899da"
format_stamp: "Formatted at 2026-08-07 22:44:25 on dist-test-slave-2d19"
server_key: "f995aa67182a11253a415fcf236438ac"
server_key_iv: "ed75c157a44b3159a6e68af2fac71f37"
server_key_version: "encryptionkey@0"
I20260807 22:44:25.367136 18520 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance:
uuid: "1ff91a6bd2034effa176d3c84f7899da"
format_stamp: "Formatted at 2026-08-07 22:44:25 on dist-test-slave-2d19"
server_key: "f995aa67182a11253a415fcf236438ac"
server_key_iv: "ed75c157a44b3159a6e68af2fac71f37"
server_key_version: "encryptionkey@0"
I20260807 22:44:25.368570 18520 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260807 22:44:25.369390 18537 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:25.369593 18520 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:44:25.369700 18520 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-2/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-2/wal
uuid: "1ff91a6bd2034effa176d3c84f7899da"
format_stamp: "Formatted at 2026-08-07 22:44:25 on dist-test-slave-2d19"
server_key: "f995aa67182a11253a415fcf236438ac"
server_key_iv: "ed75c157a44b3159a6e68af2fac71f37"
server_key_version: "encryptionkey@0"
I20260807 22:44:25.369783 18520 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:44:25.380767 18520 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:44:25.382915 18520 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:44:25.383095 18520 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:44:25.383333 18520 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:44:25.383661 18520 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:44:25.383716 18520 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:25.383760 18520 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:44:25.383788 18520 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:25.389804 18520 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.67:39641
I20260807 22:44:25.389849 18701 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.67:39641 every 8 connection(s)
I20260807 22:44:25.390180 18520 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
I20260807 22:44:25.393009 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 18520
I20260807 22:44:25.393111 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance
I20260807 22:44:25.393287 23377 external_mini_cluster.cc:1428] Setting key d3bf804d32003b0f106b75e5094e1286
Aug 07 22:44:25 dist-test-slave-2d19 krb5kdc[17977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142665, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:44:25.400056 18115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:25.391018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:49539 (local address 127.22.212.126:34755)
0807 22:44:25.391094 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:25.391096 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:25.391303 (+ 207us) server_negotiation.cc:407] Connection header received
0807 22:44:25.391797 (+ 494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:25.391798 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:25.391808 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:25.391863 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:25.392961 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:25.393644 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:25.394843 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:25.395033 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:25.395090 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:25.397470 (+ 2380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:25.397472 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:25.397472 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:44:25.397479 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:25.398808 (+ 1329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:25.399182 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:25.399183 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:25.399183 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:25.399236 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:25.399492 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:25.399493 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:25.399494 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:25.399615 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:25.399694 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:25.399922 (+ 228us) server_negotiation.cc:299] Negotiation successful
0807 22:44:25.399990 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 22:44:25.400249 18704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:25.390979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:34755 (local address 127.22.212.67:49539)
0807 22:44:25.391172 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:25.391214 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:25.391711 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:25.391989 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:25.391992 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:25.392660 (+ 668us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:44:25.392857 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:25.392862 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:25.393751 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:25.393753 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:25.394766 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:25.394769 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:25.395111 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:25.395112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:25.395223 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:25.395791 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:44:25.395800 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:44:25.397358 (+ 1558us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:44:25.398880 (+ 1522us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:44:25.398887 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:44:25.398889 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:44:25.399110 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:44:25.399298 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:44:25.399299 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:44:25.399299 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:44:25.399408 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:44:25.399683 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:44:25.399687 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:44:25.399802 (+ 115us) client_negotiation.cc:769] Sending connection context
0807 22:44:25.399884 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 22:44:25.400007 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":108,"threads_started":1}
I20260807 22:44:25.400758 18702 heartbeater.cc:347] Connected to a master server at 127.22.212.126:34755
I20260807 22:44:25.400879 18702 heartbeater.cc:464] Registering TS with master...
I20260807 22:44:25.401131 18702 heartbeater.cc:511] Master 127.22.212.126:34755 requested a full tablet report, sending...
I20260807 22:44:25.401500 18047 ts_manager.cc:194] Registered new tserver with Master: 1ff91a6bd2034effa176d3c84f7899da (127.22.212.67:39641)
I20260807 22:44:25.401861 18047 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.67@KRBTEST.COM'} at 127.22.212.67:49539
I20260807 22:44:25.405220 23377 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:44:25.412680 18115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:25.406621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45014 (local address 127.22.212.126:34755)
0807 22:44:25.406660 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:25.406661 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:25.406790 (+ 129us) server_negotiation.cc:407] Connection header received
0807 22:44:25.406816 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:25.406817 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:25.406826 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:25.406877 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:25.407372 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:25.407833 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:25.408638 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:25.408822 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:25.408877 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:25.410045 (+ 1168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:25.410046 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:25.410046 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:44:25.410053 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:25.411590 (+ 1537us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:25.411900 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:25.411901 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:25.411901 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:25.411949 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:25.412125 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:25.412126 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:25.412126 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:25.412303 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:25.412388 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:25.412490 (+ 102us) server_negotiation.cc:299] Negotiation successful
0807 22:44:25.412562 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260807 22:44:25.414209 18047 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45014:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:44:25.415757 18047 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:44:25.422765 18719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:25.418209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.66:33723 (local address 127.0.0.1:51402)
0807 22:44:25.418362 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:25.418402 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:25.418467 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:25.419211 (+ 744us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:25.419212 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:25.419213 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:44:25.419278 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:25.419280 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:25.420627 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:25.420628 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:25.421590 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:25.421593 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:25.422445 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:25.422446 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:25.422544 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:25.422558 (+ 14us) client_negotiation.cc:769] Sending connection context
0807 22:44:25.422628 (+ 70us) client_negotiation.cc:240] Negotiation successful
0807 22:44:25.422676 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"mutex_wait_us":2,"thread_start_us":104,"threads_started":1}
I20260807 22:44:25.422874 18717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:25.418209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.67:39641 (local address 127.0.0.1:49286)
0807 22:44:25.418362 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:25.418402 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:25.418485 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:25.418842 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:25.418845 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:25.418847 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:44:25.418929 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:25.418931 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:25.420295 (+ 1364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:25.420296 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:25.421771 (+ 1475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:25.421775 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:25.422607 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:25.422608 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:25.422670 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:25.422674 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 22:44:25.422732 (+ 58us) client_negotiation.cc:240] Negotiation successful
0807 22:44:25.422776 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"mutex_wait_us":136,"thread_start_us":45,"threads_started":1}
I20260807 22:44:25.422873 18722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:25.418468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49286 (local address 127.22.212.67:39641)
0807 22:44:25.418646 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:25.418651 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:25.418663 (+ 12us) server_negotiation.cc:407] Connection header received
0807 22:44:25.418701 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:25.418703 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:25.418718 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:25.418838 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:44:25.419027 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:25.420164 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:25.421875 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:25.422519 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:25.422606 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:25.422661 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:25.422751 (+ 90us) server_negotiation.cc:299] Negotiation successful
0807 22:44:25.422789 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":93,"threads_started":1}
I20260807 22:44:25.423038 18721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:25.418394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51402 (local address 127.22.212.66:33723)
0807 22:44:25.418986 (+ 592us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:25.418991 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:25.419001 (+ 10us) server_negotiation.cc:407] Connection header received
0807 22:44:25.419040 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:25.419041 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:25.419056 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:25.419127 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:44:25.419340 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:25.420512 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:25.421686 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:25.422277 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:25.422347 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:25.422408 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:25.422899 (+ 491us) server_negotiation.cc:299] Negotiation successful
0807 22:44:25.422942 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":547,"thread_start_us":87,"threads_started":1}
I20260807 22:44:25.423378 18720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:25.418218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:34473 (local address 127.0.0.1:60448)
0807 22:44:25.418575 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:25.418585 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:25.418623 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:25.419890 (+ 1267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:25.419891 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:25.419893 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:44:25.419930 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:25.419932 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:25.421056 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:25.421057 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:25.422156 (+ 1099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:25.422159 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:25.423159 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:25.423160 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:25.423218 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:25.423221 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:44:25.423255 (+ 34us) client_negotiation.cc:240] Negotiation successful
0807 22:44:25.423316 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":93,"threads_started":1}
I20260807 22:44:25.423684 18724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:25.419416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60448 (local address 127.22.212.65:34473)
0807 22:44:25.419723 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:25.419727 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:25.419739 (+ 12us) server_negotiation.cc:407] Connection header received
0807 22:44:25.419782 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:25.419784 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:25.419798 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:25.419879 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:44:25.419982 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:25.420932 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:25.422252 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:25.422974 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:25.423056 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:25.423541 (+ 485us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:25.423567 (+ 26us) server_negotiation.cc:299] Negotiation successful
0807 22:44:25.423606 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":265,"thread_start_us":100,"threads_started":1}
I20260807 22:44:25.423779 18608 tablet_service.cc:1467] Processing CreateTablet for tablet 4c269c7ee0d64a58ad43329c9911b213 (DEFAULT_TABLE table=test-table [id=172bbbcf258443dc906cc7edc28ed30a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:44:25.424183 18608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c269c7ee0d64a58ad43329c9911b213. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:44:25.424187 18417 tablet_service.cc:1467] Processing CreateTablet for tablet 4c269c7ee0d64a58ad43329c9911b213 (DEFAULT_TABLE table=test-table [id=172bbbcf258443dc906cc7edc28ed30a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:44:25.424289 18230 tablet_service.cc:1467] Processing CreateTablet for tablet 4c269c7ee0d64a58ad43329c9911b213 (DEFAULT_TABLE table=test-table [id=172bbbcf258443dc906cc7edc28ed30a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:44:25.424583 18230 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c269c7ee0d64a58ad43329c9911b213. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:44:25.424582 18417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c269c7ee0d64a58ad43329c9911b213. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:44:25.427927 18728 tablet_bootstrap.cc:492] T 4c269c7ee0d64a58ad43329c9911b213 P f86b3696547b4c40a5d99d3718c23cbc: Bootstrap starting.
I20260807 22:44:25.428117 18725 tablet_bootstrap.cc:492] T 4c269c7ee0d64a58ad43329c9911b213 P 1ff91a6bd2034effa176d3c84f7899da: Bootstrap starting.
I20260807 22:44:25.428437 18726 tablet_bootstrap.cc:492] T 4c269c7ee0d64a58ad43329c9911b213 P a76fa72468a6474da6e779a74d7f4dec: Bootstrap starting.
I20260807 22:44:25.428788 18725 tablet_bootstrap.cc:654] T 4c269c7ee0d64a58ad43329c9911b213 P 1ff91a6bd2034effa176d3c84f7899da: Neither blocks nor log segments found. Creating new log.
I20260807 22:44:25.428799 18728 tablet_bootstrap.cc:654] T 4c269c7ee0d64a58ad43329c9911b213 P f86b3696547b4c40a5d99d3718c23cbc: Neither blocks nor log segments found. Creating new log.
I20260807 22:44:25.429105 18726 tablet_bootstrap.cc:654] T 4c269c7ee0d64a58ad43329c9911b213 P a76fa72468a6474da6e779a74d7f4dec: Neither blocks nor log segments found. Creating new log.
I20260807 22:44:25.429368 18725 log.cc:824] T 4c269c7ee0d64a58ad43329c9911b213 P 1ff91a6bd2034effa176d3c84f7899da: Log is configured to *not* fsync() on all Append() calls
I20260807 22:44:25.429421 18728 log.cc:824] T 4c269c7ee0d64a58ad43329c9911b213 P f86b3696547b4c40a5d99d3718c23cbc: Log is configured to *not* fsync() on all Append() calls
I20260807 22:44:25.429693 18726 log.cc:824] T 4c269c7ee0d64a58ad43329c9911b213 P a76fa72468a6474da6e779a74d7f4dec: Log is configured to *not* fsync() on all Append() calls
I20260807 22:44:25.430282 18728 tablet_bootstrap.cc:492] T 4c269c7ee0d64a58ad43329c9911b213 P f86b3696547b4c40a5d99d3718c23cbc: No bootstrap required, opened a new log
I20260807 22:44:25.430291 18725 tablet_bootstrap.cc:492] T 4c269c7ee0d64a58ad43329c9911b213 P 1ff91a6bd2034effa176d3c84f7899da: No bootstrap required, opened a new log
I20260807 22:44:25.430356 18728 ts_tablet_manager.cc:1397] T 4c269c7ee0d64a58ad43329c9911b213 P f86b3696547b4c40a5d99d3718c23cbc: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 22:44:25.430356 18725 ts_tablet_manager.cc:1397] T 4c269c7ee0d64a58ad43329c9911b213 P 1ff91a6bd2034effa176d3c84f7899da: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260807 22:44:25.430470 18726 tablet_bootstrap.cc:492] T 4c269c7ee0d64a58ad43329c9911b213 P a76fa72468a6474da6e779a74d7f4dec: No bootstrap required, opened a new log
I20260807 22:44:25.430536 18726 ts_tablet_manager.cc:1397] T 4c269c7ee0d64a58ad43329c9911b213 P a76fa72468a6474da6e779a74d7f4dec: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 22:44:25.431912 18726 raft_consensus.cc:348] T 4c269c7ee0d64a58ad43329c9911b213 P a76fa72468a6474da6e779a74d7f4dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f86b3696547b4c40a5d99d3718c23cbc" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 33723 } } peers { permanent_uuid: "1ff91a6bd2034effa176d3c84f7899da" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39641 } } peers { permanent_uuid: "a76fa72468a6474da6e779a74d7f4dec" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 34473 } }
I20260807 22:44:25.432091 18726 raft_consensus.cc:374] T 4c269c7ee0d64a58ad43329c9911b213 P a76fa72468a6474da6e779a74d7f4dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:44:25.432137 18726 raft_consensus.cc:729] T 4c269c7ee0d64a58ad43329c9911b213 P a76fa72468a6474da6e779a74d7f4dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a76fa72468a6474da6e779a74d7f4dec, State: Initialized, Role: FOLLOWER
I20260807 22:44:25.432315 18726 consensus_queue.cc:260] T 4c269c7ee0d64a58ad43329c9911b213 P a76fa72468a6474da6e779a74d7f4dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f86b3696547b4c40a5d99d3718c23cbc" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 33723 } } peers { permanent_uuid: "1ff91a6bd2034effa176d3c84f7899da" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39641 } } peers { permanent_uuid: "a76fa72468a6474da6e779a74d7f4dec" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 34473 } }
I20260807 22:44:25.432377 18728 raft_consensus.cc:348] T 4c269c7ee0d64a58ad43329c9911b213 P f86b3696547b4c40a5d99d3718c23cbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f86b3696547b4c40a5d99d3718c23cbc" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 33723 } } peers { permanent_uuid: "1ff91a6bd2034effa176d3c84f7899da" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39641 } } peers { permanent_uuid: "a76fa72468a6474da6e779a74d7f4dec" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 34473 } }
I20260807 22:44:25.432377 18725 raft_consensus.cc:348] T 4c269c7ee0d64a58ad43329c9911b213 P 1ff91a6bd2034effa176d3c84f7899da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f86b3696547b4c40a5d99d3718c23cbc" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 33723 } } peers { permanent_uuid: "1ff91a6bd2034effa176d3c84f7899da" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39641 } } peers { permanent_uuid: "a76fa72468a6474da6e779a74d7f4dec" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 34473 } }
I20260807 22:44:25.432556 18728 raft_consensus.cc:374] T 4c269c7ee0d64a58ad43329c9911b213 P f86b3696547b4c40a5d99d3718c23cbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:44:25.432556 18725 raft_consensus.cc:374] T 4c269c7ee0d64a58ad43329c9911b213 P 1ff91a6bd2034effa176d3c84f7899da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:44:25.432605 18728 raft_consensus.cc:729] T 4c269c7ee0d64a58ad43329c9911b213 P f86b3696547b4c40a5d99d3718c23cbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f86b3696547b4c40a5d99d3718c23cbc, State: Initialized, Role: FOLLOWER
I20260807 22:44:25.432605 18725 raft_consensus.cc:729] T 4c269c7ee0d64a58ad43329c9911b213 P 1ff91a6bd2034effa176d3c84f7899da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ff91a6bd2034effa176d3c84f7899da, State: Initialized, Role: FOLLOWER
I20260807 22:44:25.432623 18726 ts_tablet_manager.cc:1428] T 4c269c7ee0d64a58ad43329c9911b213 P a76fa72468a6474da6e779a74d7f4dec: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 22:44:25.432745 18320 heartbeater.cc:503] Master 127.22.212.126:34755 was elected leader, sending a full tablet report...
I20260807 22:44:25.432725 18725 consensus_queue.cc:260] T 4c269c7ee0d64a58ad43329c9911b213 P 1ff91a6bd2034effa176d3c84f7899da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f86b3696547b4c40a5d99d3718c23cbc" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 33723 } } peers { permanent_uuid: "1ff91a6bd2034effa176d3c84f7899da" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39641 } } peers { permanent_uuid: "a76fa72468a6474da6e779a74d7f4dec" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 34473 } }
I20260807 22:44:25.432725 18728 consensus_queue.cc:260] T 4c269c7ee0d64a58ad43329c9911b213 P f86b3696547b4c40a5d99d3718c23cbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f86b3696547b4c40a5d99d3718c23cbc" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 33723 } } peers { permanent_uuid: "1ff91a6bd2034effa176d3c84f7899da" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39641 } } peers { permanent_uuid: "a76fa72468a6474da6e779a74d7f4dec" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 34473 } }
I20260807 22:44:25.432997 18725 ts_tablet_manager.cc:1428] T 4c269c7ee0d64a58ad43329c9911b213 P 1ff91a6bd2034effa176d3c84f7899da: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260807 22:44:25.432997 18728 ts_tablet_manager.cc:1428] T 4c269c7ee0d64a58ad43329c9911b213 P f86b3696547b4c40a5d99d3718c23cbc: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 22:44:25.433125 18702 heartbeater.cc:503] Master 127.22.212.126:34755 was elected leader, sending a full tablet report...
I20260807 22:44:25.433581 18512 heartbeater.cc:503] Master 127.22.212.126:34755 was elected leader, sending a full tablet report...
W20260807 22:44:25.483956 18513 tablet.cc:2369] T 4c269c7ee0d64a58ad43329c9911b213 P f86b3696547b4c40a5d99d3718c23cbc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:44:25.500177 18736 raft_consensus.cc:482] T 4c269c7ee0d64a58ad43329c9911b213 P f86b3696547b4c40a5d99d3718c23cbc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:44:25.500324 18736 raft_consensus.cc:504] T 4c269c7ee0d64a58ad43329c9911b213 P f86b3696547b4c40a5d99d3718c23cbc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f86b3696547b4c40a5d99d3718c23cbc" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 33723 } } peers { permanent_uuid: "1ff91a6bd2034effa176d3c84f7899da" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39641 } } peers { permanent_uuid: "a76fa72468a6474da6e779a74d7f4dec" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 34473 } }
I20260807 22:44:25.500660 18736 leader_election.cc:288] T 4c269c7ee0d64a58ad43329c9911b213 P f86b3696547b4c40a5d99d3718c23cbc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ff91a6bd2034effa176d3c84f7899da (127.22.212.67:39641), a76fa72468a6474da6e779a74d7f4dec (127.22.212.65:34473)
I20260807 22:44:25.504675 18724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:25.500996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:56935 (local address 127.22.212.65:34473)
0807 22:44:25.501080 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:25.501082 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:25.501091 (+ 9us) server_negotiation.cc:407] Connection header received
0807 22:44:25.501124 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:25.501124 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:25.501135 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:25.501194 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:44:25.501415 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:25.502186 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:25.503674 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:25.504300 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:25.504363 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:25.504372 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:25.504565 (+ 193us) server_negotiation.cc:299] Negotiation successful
0807 22:44:25.504603 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 22:44:25.504675 18722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:25.501051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:57785 (local address 127.22.212.67:39641)
0807 22:44:25.501110 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:25.501112 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:25.501169 (+ 57us) server_negotiation.cc:407] Connection header received
0807 22:44:25.501261 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:25.501262 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:25.501269 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:25.501311 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:44:25.501480 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:25.502177 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:25.503674 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:25.504281 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:25.504362 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:25.504372 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:25.504565 (+ 193us) server_negotiation.cc:299] Negotiation successful
0807 22:44:25.504603 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260807 22:44:25.504676 18516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:25.500858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:34473 (local address 127.22.212.66:56935)
0807 22:44:25.500924 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:25.500939 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:25.501004 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:25.501224 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:25.501225 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:25.501227 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:44:25.501327 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:25.501329 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:25.502269 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:25.502270 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:25.503568 (+ 1298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:25.503572 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:25.504378 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:25.504379 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:25.504468 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:25.504473 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 22:44:25.504536 (+ 63us) client_negotiation.cc:240] Negotiation successful
0807 22:44:25.504584 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40,"mutex_wait_us":53}
I20260807 22:44:25.504686 18738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:25.500858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.67:39641 (local address 127.22.212.66:57785)
0807 22:44:25.501100 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:25.501110 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:25.501200 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:25.501343 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:25.501344 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:25.501346 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:44:25.501407 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:25.501409 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:25.502269 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:25.502270 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:25.503571 (+ 1301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:25.503572 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:25.504378 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:25.504379 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:25.504477 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:25.504480 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:44:25.504536 (+ 56us) client_negotiation.cc:240] Negotiation successful
0807 22:44:25.504583 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"mutex_wait_us":137,"thread_start_us":116,"threads_started":1}
I20260807 22:44:25.505065 18254 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c269c7ee0d64a58ad43329c9911b213" candidate_uuid: "f86b3696547b4c40a5d99d3718c23cbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a76fa72468a6474da6e779a74d7f4dec" is_pre_election: true
I20260807 22:44:25.505065 18643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c269c7ee0d64a58ad43329c9911b213" candidate_uuid: "f86b3696547b4c40a5d99d3718c23cbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ff91a6bd2034effa176d3c84f7899da" is_pre_election: true
I20260807 22:44:25.505227 18643 raft_consensus.cc:2454] T 4c269c7ee0d64a58ad43329c9911b213 P 1ff91a6bd2034effa176d3c84f7899da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f86b3696547b4c40a5d99d3718c23cbc in term 0.
I20260807 22:44:25.505227 18254 raft_consensus.cc:2454] T 4c269c7ee0d64a58ad43329c9911b213 P a76fa72468a6474da6e779a74d7f4dec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f86b3696547b4c40a5d99d3718c23cbc in term 0.
I20260807 22:44:25.505492 18353 leader_election.cc:302] T 4c269c7ee0d64a58ad43329c9911b213 P f86b3696547b4c40a5d99d3718c23cbc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ff91a6bd2034effa176d3c84f7899da, f86b3696547b4c40a5d99d3718c23cbc; no voters:
I20260807 22:44:25.505686 18736 raft_consensus.cc:2781] T 4c269c7ee0d64a58ad43329c9911b213 P f86b3696547b4c40a5d99d3718c23cbc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:44:25.505774 18736 raft_consensus.cc:482] T 4c269c7ee0d64a58ad43329c9911b213 P f86b3696547b4c40a5d99d3718c23cbc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:44:25.505810 18736 raft_consensus.cc:3037] T 4c269c7ee0d64a58ad43329c9911b213 P f86b3696547b4c40a5d99d3718c23cbc [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:44:25.506675 18736 raft_consensus.cc:504] T 4c269c7ee0d64a58ad43329c9911b213 P f86b3696547b4c40a5d99d3718c23cbc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f86b3696547b4c40a5d99d3718c23cbc" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 33723 } } peers { permanent_uuid: "1ff91a6bd2034effa176d3c84f7899da" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39641 } } peers { permanent_uuid: "a76fa72468a6474da6e779a74d7f4dec" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 34473 } }
I20260807 22:44:25.506824 18736 leader_election.cc:288] T 4c269c7ee0d64a58ad43329c9911b213 P f86b3696547b4c40a5d99d3718c23cbc [CANDIDATE]: Term 1 election: Requested vote from peers 1ff91a6bd2034effa176d3c84f7899da (127.22.212.67:39641), a76fa72468a6474da6e779a74d7f4dec (127.22.212.65:34473)
I20260807 22:44:25.506987 18643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c269c7ee0d64a58ad43329c9911b213" candidate_uuid: "f86b3696547b4c40a5d99d3718c23cbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ff91a6bd2034effa176d3c84f7899da"
I20260807 22:44:25.507059 18254 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c269c7ee0d64a58ad43329c9911b213" candidate_uuid: "f86b3696547b4c40a5d99d3718c23cbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a76fa72468a6474da6e779a74d7f4dec"
I20260807 22:44:25.507094 18643 raft_consensus.cc:3037] T 4c269c7ee0d64a58ad43329c9911b213 P 1ff91a6bd2034effa176d3c84f7899da [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:44:25.507131 18254 raft_consensus.cc:3037] T 4c269c7ee0d64a58ad43329c9911b213 P a76fa72468a6474da6e779a74d7f4dec [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:44:25.508051 18643 raft_consensus.cc:2454] T 4c269c7ee0d64a58ad43329c9911b213 P 1ff91a6bd2034effa176d3c84f7899da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f86b3696547b4c40a5d99d3718c23cbc in term 1.
I20260807 22:44:25.508051 18254 raft_consensus.cc:2454] T 4c269c7ee0d64a58ad43329c9911b213 P a76fa72468a6474da6e779a74d7f4dec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f86b3696547b4c40a5d99d3718c23cbc in term 1.
I20260807 22:44:25.508297 18353 leader_election.cc:302] T 4c269c7ee0d64a58ad43329c9911b213 P f86b3696547b4c40a5d99d3718c23cbc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ff91a6bd2034effa176d3c84f7899da, f86b3696547b4c40a5d99d3718c23cbc; no voters:
I20260807 22:44:25.508390 18736 raft_consensus.cc:2781] T 4c269c7ee0d64a58ad43329c9911b213 P f86b3696547b4c40a5d99d3718c23cbc [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:44:25.508616 18736 raft_consensus.cc:686] T 4c269c7ee0d64a58ad43329c9911b213 P f86b3696547b4c40a5d99d3718c23cbc [term 1 LEADER]: Becoming Leader. State: Replica: f86b3696547b4c40a5d99d3718c23cbc, State: Running, Role: LEADER
I20260807 22:44:25.508721 18736 consensus_queue.cc:237] T 4c269c7ee0d64a58ad43329c9911b213 P f86b3696547b4c40a5d99d3718c23cbc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f86b3696547b4c40a5d99d3718c23cbc" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 33723 } } peers { permanent_uuid: "1ff91a6bd2034effa176d3c84f7899da" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39641 } } peers { permanent_uuid: "a76fa72468a6474da6e779a74d7f4dec" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 34473 } }
I20260807 22:44:25.509622 18042 catalog_manager.cc:5495] T 4c269c7ee0d64a58ad43329c9911b213 P f86b3696547b4c40a5d99d3718c23cbc reported cstate change: term changed from 0 to 1, leader changed from <none> to f86b3696547b4c40a5d99d3718c23cbc (127.22.212.66). New cstate: current_term: 1 leader_uuid: "f86b3696547b4c40a5d99d3718c23cbc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f86b3696547b4c40a5d99d3718c23cbc" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 33723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ff91a6bd2034effa176d3c84f7899da" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a76fa72468a6474da6e779a74d7f4dec" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 34473 } health_report { overall_health: UNKNOWN } } }
I20260807 22:44:25.514297 18721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:25.512172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51408 (local address 127.22.212.66:33723)
0807 22:44:25.512217 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:25.512218 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:25.512226 (+ 8us) server_negotiation.cc:407] Connection header received
0807 22:44:25.512328 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:25.512329 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:25.512344 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:25.512404 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:44:25.512498 (+ 94us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:25.512940 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:25.513666 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:25.513842 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:25.513892 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:25.514051 (+ 159us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:44:25.514140 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:44:25.514198 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:25.514231 (+ 33us) server_negotiation.cc:299] Negotiation successful
0807 22:44:25.514248 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260807 22:44:25.515893 18254 raft_consensus.cc:1261] T 4c269c7ee0d64a58ad43329c9911b213 P a76fa72468a6474da6e779a74d7f4dec [term 1 FOLLOWER]: Refusing update from remote peer f86b3696547b4c40a5d99d3718c23cbc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:44:25.515898 18643 raft_consensus.cc:1261] T 4c269c7ee0d64a58ad43329c9911b213 P 1ff91a6bd2034effa176d3c84f7899da [term 1 FOLLOWER]: Refusing update from remote peer f86b3696547b4c40a5d99d3718c23cbc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:44:25.516215 18736 consensus_queue.cc:1035] T 4c269c7ee0d64a58ad43329c9911b213 P f86b3696547b4c40a5d99d3718c23cbc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a76fa72468a6474da6e779a74d7f4dec" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 34473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:44:25.516376 18739 consensus_queue.cc:1035] T 4c269c7ee0d64a58ad43329c9911b213 P f86b3696547b4c40a5d99d3718c23cbc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ff91a6bd2034effa176d3c84f7899da" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:44:25.518818 18746 mvcc.cc:205] Tried to move back new op lower bound from 7316040357950566400 to 7316040357924278272. Current Snapshot: MvccSnapshot[applied={T|T < 7316040357950566400}]
I20260807 22:44:25.521703 18047 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45014:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:44:25.521802 18047 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45014:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:44:25.522547 18047 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0db8d8573803418f9c63780efbf9e96a: Sending DeleteTablet for 3 replicas of tablet 4c269c7ee0d64a58ad43329c9911b213
I20260807 22:44:25.522907 18417 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c269c7ee0d64a58ad43329c9911b213 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:44:25 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:51402
I20260807 22:44:25.522953 18608 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c269c7ee0d64a58ad43329c9911b213 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:44:25 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:49286
I20260807 22:44:25.523067 18230 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c269c7ee0d64a58ad43329c9911b213 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:44:25 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:60448
I20260807 22:44:25.523299 18765 tablet_replica.cc:330] T 4c269c7ee0d64a58ad43329c9911b213 P a76fa72468a6474da6e779a74d7f4dec: stopping tablet replica
I20260807 22:44:25.523419 18765 raft_consensus.cc:2229] T 4c269c7ee0d64a58ad43329c9911b213 P a76fa72468a6474da6e779a74d7f4dec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:44:25.523530 18765 raft_consensus.cc:2258] T 4c269c7ee0d64a58ad43329c9911b213 P a76fa72468a6474da6e779a74d7f4dec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:44:25.523595 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 18142
I20260807 22:44:25.538949 18762 tablet_replica.cc:330] T 4c269c7ee0d64a58ad43329c9911b213 P f86b3696547b4c40a5d99d3718c23cbc: stopping tablet replica
I20260807 22:44:25.539113 18762 raft_consensus.cc:2229] T 4c269c7ee0d64a58ad43329c9911b213 P f86b3696547b4c40a5d99d3718c23cbc [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:44:25.539263 18762 raft_consensus.cc:2258] T 4c269c7ee0d64a58ad43329c9911b213 P f86b3696547b4c40a5d99d3718c23cbc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:44:25.539832 18764 tablet_replica.cc:330] T 4c269c7ee0d64a58ad43329c9911b213 P 1ff91a6bd2034effa176d3c84f7899da: stopping tablet replica
I20260807 22:44:25.539954 18764 raft_consensus.cc:2229] T 4c269c7ee0d64a58ad43329c9911b213 P 1ff91a6bd2034effa176d3c84f7899da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:44:25.540062 18764 raft_consensus.cc:2258] T 4c269c7ee0d64a58ad43329c9911b213 P 1ff91a6bd2034effa176d3c84f7899da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:44:25.540393 18762 ts_tablet_manager.cc:1905] T 4c269c7ee0d64a58ad43329c9911b213 P f86b3696547b4c40a5d99d3718c23cbc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:44:25.543298 18762 ts_tablet_manager.cc:1918] T 4c269c7ee0d64a58ad43329c9911b213 P f86b3696547b4c40a5d99d3718c23cbc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:44:25.543394 18762 log.cc:1196] T 4c269c7ee0d64a58ad43329c9911b213 P f86b3696547b4c40a5d99d3718c23cbc: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-1/wal/wals/4c269c7ee0d64a58ad43329c9911b213
I20260807 22:44:25.543689 18762 ts_tablet_manager.cc:1939] T 4c269c7ee0d64a58ad43329c9911b213 P f86b3696547b4c40a5d99d3718c23cbc: Deleting consensus metadata
I20260807 22:44:25.544291 18024 catalog_manager.cc:4841] TS f86b3696547b4c40a5d99d3718c23cbc (127.22.212.66:33723): tablet 4c269c7ee0d64a58ad43329c9911b213 (table test-table [id=172bbbcf258443dc906cc7edc28ed30a]) successfully deleted
I20260807 22:44:25.544332 18764 ts_tablet_manager.cc:1905] T 4c269c7ee0d64a58ad43329c9911b213 P 1ff91a6bd2034effa176d3c84f7899da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:44:25.546013 18764 ts_tablet_manager.cc:1918] T 4c269c7ee0d64a58ad43329c9911b213 P 1ff91a6bd2034effa176d3c84f7899da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:44:25.546100 18764 log.cc:1196] T 4c269c7ee0d64a58ad43329c9911b213 P 1ff91a6bd2034effa176d3c84f7899da: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786142418640232-23377-0/minicluster-data/ts-2/wal/wals/4c269c7ee0d64a58ad43329c9911b213
I20260807 22:44:25.546378 18764 ts_tablet_manager.cc:1939] T 4c269c7ee0d64a58ad43329c9911b213 P 1ff91a6bd2034effa176d3c84f7899da: Deleting consensus metadata
I20260807 22:44:25.546901 18026 catalog_manager.cc:4841] TS 1ff91a6bd2034effa176d3c84f7899da (127.22.212.67:39641): tablet 4c269c7ee0d64a58ad43329c9911b213 (table test-table [id=172bbbcf258443dc906cc7edc28ed30a]) successfully deleted
W20260807 22:44:25.554382 18028 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.212.65:34473 (error 108)
I20260807 22:44:25.555075 18720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:25.554916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:34473 (local address 127.0.0.1:60458)
0807 22:44:25.554989 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:25.555038 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.65:34473: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260807 22:44:25.555123 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 18327
W20260807 22:44:25.561931 18028 catalog_manager.cc:4584] TS a76fa72468a6474da6e779a74d7f4dec (127.22.212.65:34473): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4c269c7ee0d64a58ad43329c9911b213: Network error: Client connection negotiation failed: client connection to 127.22.212.65:34473: connect: Connection refused (error 111)
I20260807 22:44:25.572552 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 18520
I20260807 22:44:25.579537 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 17995
2026-08-07T22:44:25Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2233 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-07T22:44:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:44:25Z Disabled control of system clock
I20260807 22:44:25.615613 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:33437
--webserver_interface=127.22.212.126
--webserver_port=0
--builtin_ntp_servers=127.22.212.84:33597
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:33437
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 22:44:25.699673 18770 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:44:25.699908 18770 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:44:25.699932 18770 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:44:25.701050 18770 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:44:25.701086 18770 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:44:25.701099 18770 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:44:25.701112 18770 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:44:25.701125 18770 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:44:25.702420 18770 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:33597
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:33437
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:33437
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18770
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:44:25.702626 18770 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:44:25.702859 18770 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:44:25.707953 18784 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:25.707962 18782 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:25.707954 18778 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:25.708031 18770 server_base.cc:1034] running on GCE node
I20260807 22:44:25.708650 18770 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:44:25.708973 18770 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:44:25.710188 18770 hybrid_clock.cc:648] HybridClock initialized: now 1786142665710176 us; error 42 us; skew 500 ppm
I20260807 22:44:25.711463 18770 webserver.cc:460] Webserver started at http://127.22.212.126:46515/ using document root <none> and password file <none>
I20260807 22:44:25.711740 18770 fs_manager.cc:359] Metadata directory not provided
I20260807 22:44:25.711788 18770 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:44:25.711957 18770 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:44:25.713136 18770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "a992c41c0e8a4a1e93458d8db23a7b76"
format_stamp: "Formatted at 2026-08-07 22:44:25 on dist-test-slave-2d19"
server_key: "4f3926d874ad26a334db5f42754bcf4b"
server_key_iv: "6eed602c15e8007ab91cb64b0c1d9098"
server_key_version: "encryptionkey@0"
I20260807 22:44:25.713521 18770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "a992c41c0e8a4a1e93458d8db23a7b76"
format_stamp: "Formatted at 2026-08-07 22:44:25 on dist-test-slave-2d19"
server_key: "4f3926d874ad26a334db5f42754bcf4b"
server_key_iv: "6eed602c15e8007ab91cb64b0c1d9098"
server_key_version: "encryptionkey@0"
I20260807 22:44:25.714866 18770 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260807 22:44:25.715648 18791 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:25.715843 18770 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 22:44:25.715955 18770 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "a992c41c0e8a4a1e93458d8db23a7b76"
format_stamp: "Formatted at 2026-08-07 22:44:25 on dist-test-slave-2d19"
server_key: "4f3926d874ad26a334db5f42754bcf4b"
server_key_iv: "6eed602c15e8007ab91cb64b0c1d9098"
server_key_version: "encryptionkey@0"
I20260807 22:44:25.716032 18770 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:44:25.739010 18770 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:44:25.739351 18770 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:44:25.739506 18770 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:44:25.743597 18770 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:33437
I20260807 22:44:25.743633 18865 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:33437 every 8 connection(s)
I20260807 22:44:25.744014 18770 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:44:25.745050 18866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:44:25.747345 18866 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a992c41c0e8a4a1e93458d8db23a7b76: Bootstrap starting.
I20260807 22:44:25.747897 18866 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a992c41c0e8a4a1e93458d8db23a7b76: Neither blocks nor log segments found. Creating new log.
I20260807 22:44:25.748209 18866 log.cc:824] T 00000000000000000000000000000000 P a992c41c0e8a4a1e93458d8db23a7b76: Log is configured to *not* fsync() on all Append() calls
I20260807 22:44:25.748939 18866 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a992c41c0e8a4a1e93458d8db23a7b76: No bootstrap required, opened a new log
I20260807 22:44:25.750353 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 18770
I20260807 22:44:25.750454 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:44:25.750645 23377 external_mini_cluster.cc:1428] Setting key 65130cf25e870c891ef175685f61e561
I20260807 22:44:25.750618 18866 raft_consensus.cc:348] T 00000000000000000000000000000000 P a992c41c0e8a4a1e93458d8db23a7b76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a992c41c0e8a4a1e93458d8db23a7b76" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 33437 } }
I20260807 22:44:25.750801 18866 raft_consensus.cc:374] T 00000000000000000000000000000000 P a992c41c0e8a4a1e93458d8db23a7b76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:44:25.750855 18866 raft_consensus.cc:729] T 00000000000000000000000000000000 P a992c41c0e8a4a1e93458d8db23a7b76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a992c41c0e8a4a1e93458d8db23a7b76, State: Initialized, Role: FOLLOWER
I20260807 22:44:25.751008 18866 consensus_queue.cc:260] T 00000000000000000000000000000000 P a992c41c0e8a4a1e93458d8db23a7b76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a992c41c0e8a4a1e93458d8db23a7b76" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 33437 } }
I20260807 22:44:25.751143 18866 raft_consensus.cc:388] T 00000000000000000000000000000000 P a992c41c0e8a4a1e93458d8db23a7b76 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:44:25.751194 18866 raft_consensus.cc:482] T 00000000000000000000000000000000 P a992c41c0e8a4a1e93458d8db23a7b76 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:44:25.751286 18866 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a992c41c0e8a4a1e93458d8db23a7b76 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:44:25.752010 18866 raft_consensus.cc:504] T 00000000000000000000000000000000 P a992c41c0e8a4a1e93458d8db23a7b76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a992c41c0e8a4a1e93458d8db23a7b76" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 33437 } }
I20260807 22:44:25.752130 18866 leader_election.cc:302] T 00000000000000000000000000000000 P a992c41c0e8a4a1e93458d8db23a7b76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a992c41c0e8a4a1e93458d8db23a7b76; no voters:
I20260807 22:44:25.752326 18866 leader_election.cc:288] T 00000000000000000000000000000000 P a992c41c0e8a4a1e93458d8db23a7b76 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:44:25.752362 18872 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a992c41c0e8a4a1e93458d8db23a7b76 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:44:25.752571 18872 raft_consensus.cc:686] T 00000000000000000000000000000000 P a992c41c0e8a4a1e93458d8db23a7b76 [term 1 LEADER]: Becoming Leader. State: Replica: a992c41c0e8a4a1e93458d8db23a7b76, State: Running, Role: LEADER
I20260807 22:44:25.752619 18866 sys_catalog.cc:564] T 00000000000000000000000000000000 P a992c41c0e8a4a1e93458d8db23a7b76 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:44:25.752718 18872 consensus_queue.cc:237] T 00000000000000000000000000000000 P a992c41c0e8a4a1e93458d8db23a7b76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a992c41c0e8a4a1e93458d8db23a7b76" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 33437 } }
I20260807 22:44:25.753782 18873 sys_catalog.cc:455] T 00000000000000000000000000000000 P a992c41c0e8a4a1e93458d8db23a7b76 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a992c41c0e8a4a1e93458d8db23a7b76. Latest consensus state: current_term: 1 leader_uuid: "a992c41c0e8a4a1e93458d8db23a7b76" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a992c41c0e8a4a1e93458d8db23a7b76" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 33437 } } }
I20260807 22:44:25.753870 18873 sys_catalog.cc:458] T 00000000000000000000000000000000 P a992c41c0e8a4a1e93458d8db23a7b76 [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:25.754297 18876 sys_catalog.cc:455] T 00000000000000000000000000000000 P a992c41c0e8a4a1e93458d8db23a7b76 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a992c41c0e8a4a1e93458d8db23a7b76" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a992c41c0e8a4a1e93458d8db23a7b76" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 33437 } } }
I20260807 22:44:25.754434 18876 sys_catalog.cc:458] T 00000000000000000000000000000000 P a992c41c0e8a4a1e93458d8db23a7b76 [sys.catalog]: This master's current role is: LEADER
W20260807 22:44:25.754776 18904 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a992c41c0e8a4a1e93458d8db23a7b76: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:44:25.754844 18904 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:44:25.754941 18900 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:44:25.755132 18900 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:44:25.756955 18900 catalog_manager.cc:1347] Generated new cluster ID: d19095a396464947aa0fe3bb87db817c
I20260807 22:44:25.757014 18900 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:44:25.757472 18871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:25.751160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52908 (local address 127.22.212.126:33437)
0807 22:44:25.751386 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:25.751395 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:25.751429 (+ 34us) server_negotiation.cc:407] Connection header received
0807 22:44:25.751555 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:25.751562 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:25.751639 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:25.751805 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:25.751978 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:25.753968 (+ 1990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:25.755205 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:25.755807 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:25.755933 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:25.756750 (+ 817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:25.756754 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:25.756754 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:44:25.756984 (+ 230us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:25.757030 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:44:25.757047 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:25.757113 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:25.757199 (+ 86us) server_negotiation.cc:299] Negotiation successful
0807 22:44:25.757275 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":96,"threads_started":1}
I20260807 22:44:25.769469 18900 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:44:25.770011 18900 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:44:25.774462 18900 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a992c41c0e8a4a1e93458d8db23a7b76: Generated new TSK 0
I20260807 22:44:25.774654 18900 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:44:25.779799 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.65:0
--local_ip_for_outbound_sockets=127.22.212.65
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:33437
--builtin_ntp_servers=127.22.212.84:33597
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 22:44:25.866132 18908 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:44:25.866343 18908 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:44:25.866364 18908 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:44:25.867589 18908 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:44:25.867631 18908 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:44:25.867657 18908 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.65
I20260807 22:44:25.869536 18908 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:33597
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:33437
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18908
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.65
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:44:25.869845 18908 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:44:25.870232 18908 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:44:25.876437 18917 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:25.876503 18916 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:25.876691 18908 server_base.cc:1034] running on GCE node
W20260807 22:44:25.876469 18920 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:25.876987 18908 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:44:25.877285 18908 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:44:25.878456 18908 hybrid_clock.cc:648] HybridClock initialized: now 1786142665878442 us; error 26 us; skew 500 ppm
I20260807 22:44:25.880012 18908 webserver.cc:460] Webserver started at http://127.22.212.65:34809/ using document root <none> and password file <none>
I20260807 22:44:25.880497 18908 fs_manager.cc:359] Metadata directory not provided
I20260807 22:44:25.880560 18908 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:44:25.880697 18908 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:44:25.882001 18908 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-0/data/instance:
uuid: "c538bc8a890f45fbb0f1b412fed7b138"
format_stamp: "Formatted at 2026-08-07 22:44:25 on dist-test-slave-2d19"
server_key: "5e1fab42ab13212725b94f4bb0400459"
server_key_iv: "5b4f363df5d69a946012f9eec1abc4df"
server_key_version: "encryptionkey@0"
I20260807 22:44:25.882380 18908 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance:
uuid: "c538bc8a890f45fbb0f1b412fed7b138"
format_stamp: "Formatted at 2026-08-07 22:44:25 on dist-test-slave-2d19"
server_key: "5e1fab42ab13212725b94f4bb0400459"
server_key_iv: "5b4f363df5d69a946012f9eec1abc4df"
server_key_version: "encryptionkey@0"
I20260807 22:44:25.883796 18908 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 22:44:25.884677 18928 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:25.884865 18908 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260807 22:44:25.884979 18908 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-0/wal
uuid: "c538bc8a890f45fbb0f1b412fed7b138"
format_stamp: "Formatted at 2026-08-07 22:44:25 on dist-test-slave-2d19"
server_key: "5e1fab42ab13212725b94f4bb0400459"
server_key_iv: "5b4f363df5d69a946012f9eec1abc4df"
server_key_version: "encryptionkey@0"
I20260807 22:44:25.885053 18908 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:44:25.903175 18908 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:44:25.903473 18908 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:44:25.903589 18908 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:44:25.903788 18908 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:44:25.904165 18908 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:44:25.904203 18908 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:25.904227 18908 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:44:25.904238 18908 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:25.910301 18908 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.65:33811
I20260807 22:44:25.910353 19098 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.65:33811 every 8 connection(s)
I20260807 22:44:25.910696 18908 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
I20260807 22:44:25.916217 19101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:25.911396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:33437 (local address 127.22.212.65:56327)
0807 22:44:25.911609 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:25.911646 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:25.912170 (+ 524us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:25.912460 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:25.912463 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:25.912472 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:44:25.912982 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:25.912986 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:25.913834 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:25.913835 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:25.914664 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:25.914667 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:25.915058 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:25.915059 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:25.915177 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:25.915689 (+ 512us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:44:25.915689 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:44:25.915721 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:44:25.915745 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:44:25.915912 (+ 167us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:44:25.915917 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:44:25.915919 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 22:44:25.915972 (+ 53us) client_negotiation.cc:240] Negotiation successful
0807 22:44:25.916055 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":105,"threads_started":1}
I20260807 22:44:25.916244 18871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:25.911405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:56327 (local address 127.22.212.126:33437)
0807 22:44:25.911479 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:25.911481 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:25.911737 (+ 256us) server_negotiation.cc:407] Connection header received
0807 22:44:25.912291 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:25.912292 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:25.912309 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:25.912378 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:25.913153 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:25.913719 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:25.914752 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:25.914978 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:25.915042 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:25.915833 (+ 791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:25.915834 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:25.915835 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:44:25.915839 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:25.915854 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:44:25.915858 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:25.915903 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:25.916106 (+ 203us) server_negotiation.cc:299] Negotiation successful
0807 22:44:25.916146 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 22:44:25.916298 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 18908
I20260807 22:44:25.916388 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance
I20260807 22:44:25.916621 23377 external_mini_cluster.cc:1428] Setting key 7435816881390b0d0f9365619a6a2e73
I20260807 22:44:25.916851 19099 heartbeater.cc:347] Connected to a master server at 127.22.212.126:33437
I20260807 22:44:25.916963 19099 heartbeater.cc:464] Registering TS with master...
I20260807 22:44:25.917146 19099 heartbeater.cc:511] Master 127.22.212.126:33437 requested a full tablet report, sending...
I20260807 22:44:25.917639 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.66:0
--local_ip_for_outbound_sockets=127.22.212.66
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:33437
--builtin_ntp_servers=127.22.212.84:33597
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 22:44:25.917673 18814 ts_manager.cc:194] Registered new tserver with Master: c538bc8a890f45fbb0f1b412fed7b138 (127.22.212.65:33811)
I20260807 22:44:25.918324 18814 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.212.65:56327
W20260807 22:44:26.007043 19102 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:44:26.007266 19102 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:44:26.007289 19102 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:44:26.008630 19102 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:44:26.008675 19102 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:44:26.008701 19102 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.66
I20260807 22:44:26.010078 19102 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:33597
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:33437
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19102
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.66
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:44:26.010291 19102 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:44:26.010565 19102 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:44:26.015735 19112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:26.015764 19109 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:26.015758 19108 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:26.015915 19102 server_base.cc:1034] running on GCE node
I20260807 22:44:26.016170 19102 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:44:26.016455 19102 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:44:26.017611 19102 hybrid_clock.cc:648] HybridClock initialized: now 1786142666017598 us; error 29 us; skew 500 ppm
I20260807 22:44:26.018916 19102 webserver.cc:460] Webserver started at http://127.22.212.66:36025/ using document root <none> and password file <none>
I20260807 22:44:26.019207 19102 fs_manager.cc:359] Metadata directory not provided
I20260807 22:44:26.019256 19102 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:44:26.019418 19102 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:44:26.020566 19102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-1/data/instance:
uuid: "a1897285e3e24e65aedccd06a0c536f7"
format_stamp: "Formatted at 2026-08-07 22:44:26 on dist-test-slave-2d19"
server_key: "fddcd49334671303ffe87d9206c240e0"
server_key_iv: "d9e7551a1e5fc88ae86a5abcb274a25d"
server_key_version: "encryptionkey@0"
I20260807 22:44:26.020924 19102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance:
uuid: "a1897285e3e24e65aedccd06a0c536f7"
format_stamp: "Formatted at 2026-08-07 22:44:26 on dist-test-slave-2d19"
server_key: "fddcd49334671303ffe87d9206c240e0"
server_key_iv: "d9e7551a1e5fc88ae86a5abcb274a25d"
server_key_version: "encryptionkey@0"
I20260807 22:44:26.022260 19102 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 22:44:26.023022 19119 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:26.023192 19102 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 22:44:26.023289 19102 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-1/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-1/wal
uuid: "a1897285e3e24e65aedccd06a0c536f7"
format_stamp: "Formatted at 2026-08-07 22:44:26 on dist-test-slave-2d19"
server_key: "fddcd49334671303ffe87d9206c240e0"
server_key_iv: "d9e7551a1e5fc88ae86a5abcb274a25d"
server_key_version: "encryptionkey@0"
I20260807 22:44:26.023367 19102 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:44:26.039192 19102 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:44:26.039528 19102 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:44:26.039687 19102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:44:26.039929 19102 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:44:26.040359 19102 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:44:26.040412 19102 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:26.040457 19102 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:44:26.040483 19102 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:26.046182 19102 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.66:42681
I20260807 22:44:26.046260 19289 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.66:42681 every 8 connection(s)
I20260807 22:44:26.046595 19102 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
I20260807 22:44:26.051852 18871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:26.047342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:54257 (local address 127.22.212.126:33437)
0807 22:44:26.047431 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:26.047434 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:26.047676 (+ 242us) server_negotiation.cc:407] Connection header received
0807 22:44:26.048227 (+ 551us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:26.048228 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:26.048241 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:26.048317 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:26.049005 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:26.049503 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:26.050473 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:26.050696 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:26.050760 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:26.051596 (+ 836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:26.051598 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:26.051598 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:44:26.051603 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:26.051619 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:44:26.051624 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:26.051677 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:26.051759 (+ 82us) server_negotiation.cc:299] Negotiation successful
0807 22:44:26.051787 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 22:44:26.052080 19293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:26.047308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:33437 (local address 127.22.212.66:54257)
0807 22:44:26.047514 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:26.047569 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:26.048106 (+ 537us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:26.048394 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:26.048398 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:26.048407 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:44:26.048914 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:26.048919 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:26.049579 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:26.049580 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:26.050367 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:26.050369 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:26.050774 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:26.050774 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:26.050882 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:26.051450 (+ 568us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:44:26.051451 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:44:26.051479 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:44:26.051501 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:44:26.051684 (+ 183us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:44:26.051688 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:44:26.051691 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:44:26.051743 (+ 52us) client_negotiation.cc:240] Negotiation successful
0807 22:44:26.051821 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":103,"threads_started":1}
I20260807 22:44:26.052618 19291 heartbeater.cc:347] Connected to a master server at 127.22.212.126:33437
I20260807 22:44:26.052735 19291 heartbeater.cc:464] Registering TS with master...
I20260807 22:44:26.053020 19291 heartbeater.cc:511] Master 127.22.212.126:33437 requested a full tablet report, sending...
I20260807 22:44:26.053476 18814 ts_manager.cc:194] Registered new tserver with Master: a1897285e3e24e65aedccd06a0c536f7 (127.22.212.66:42681)
I20260807 22:44:26.053506 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 19102
I20260807 22:44:26.053591 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance
I20260807 22:44:26.053790 23377 external_mini_cluster.cc:1428] Setting key d7f6feb91e4d3929d5c257b82ce86aca
I20260807 22:44:26.053994 18814 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.212.66:54257
I20260807 22:44:26.054934 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.67:0
--local_ip_for_outbound_sockets=127.22.212.67
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:33437
--builtin_ntp_servers=127.22.212.84:33597
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 22:44:26.142371 19294 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:44:26.142601 19294 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:44:26.142625 19294 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:44:26.143886 19294 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:44:26.143934 19294 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:44:26.143961 19294 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.67
I20260807 22:44:26.145489 19294 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:33597
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:33437
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19294
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.67
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:44:26.145769 19294 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:44:26.146090 19294 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:44:26.151578 19302 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:26.151593 19301 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:26.151593 19304 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:26.151860 19294 server_base.cc:1034] running on GCE node
I20260807 22:44:26.152153 19294 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:44:26.152448 19294 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:44:26.153605 19294 hybrid_clock.cc:648] HybridClock initialized: now 1786142666153580 us; error 41 us; skew 500 ppm
I20260807 22:44:26.154997 19294 webserver.cc:460] Webserver started at http://127.22.212.67:33501/ using document root <none> and password file <none>
I20260807 22:44:26.155265 19294 fs_manager.cc:359] Metadata directory not provided
I20260807 22:44:26.155335 19294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:44:26.155476 19294 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:44:26.156658 19294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-2/data/instance:
uuid: "c133c3b7119f40e7ba612277b9a6c8c3"
format_stamp: "Formatted at 2026-08-07 22:44:26 on dist-test-slave-2d19"
server_key: "a5226e2e2be759595d09010392bb05e3"
server_key_iv: "c17a8c186c313d7af5f4a95f8bc57d2d"
server_key_version: "encryptionkey@0"
I20260807 22:44:26.157025 19294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance:
uuid: "c133c3b7119f40e7ba612277b9a6c8c3"
format_stamp: "Formatted at 2026-08-07 22:44:26 on dist-test-slave-2d19"
server_key: "a5226e2e2be759595d09010392bb05e3"
server_key_iv: "c17a8c186c313d7af5f4a95f8bc57d2d"
server_key_version: "encryptionkey@0"
I20260807 22:44:26.158345 19294 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 22:44:26.159107 19312 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:26.159318 19294 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:44:26.159420 19294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-2/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-2/wal
uuid: "c133c3b7119f40e7ba612277b9a6c8c3"
format_stamp: "Formatted at 2026-08-07 22:44:26 on dist-test-slave-2d19"
server_key: "a5226e2e2be759595d09010392bb05e3"
server_key_iv: "c17a8c186c313d7af5f4a95f8bc57d2d"
server_key_version: "encryptionkey@0"
I20260807 22:44:26.159498 19294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:44:26.181459 19294 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:44:26.181792 19294 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:44:26.181945 19294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:44:26.182188 19294 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:44:26.182533 19294 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:44:26.182585 19294 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:26.182627 19294 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:44:26.182657 19294 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:26.188524 19294 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.67:43281
I20260807 22:44:26.188602 19495 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.67:43281 every 8 connection(s)
I20260807 22:44:26.188969 19294 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
I20260807 22:44:26.190922 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 19294
I20260807 22:44:26.191025 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance
I20260807 22:44:26.191203 23377 external_mini_cluster.cc:1428] Setting key 8f08440401cd737377232b29b8912fc9
I20260807 22:44:26.194494 18871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:26.189765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:57295 (local address 127.22.212.126:33437)
0807 22:44:26.189831 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:26.189833 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:26.190042 (+ 209us) server_negotiation.cc:407] Connection header received
0807 22:44:26.190539 (+ 497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:26.190540 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:26.190552 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:26.190606 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:26.191450 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:26.192201 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:26.193224 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:26.193411 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:26.193474 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:26.194272 (+ 798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:26.194273 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:26.194274 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:44:26.194278 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:26.194291 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:44:26.194295 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:26.194339 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:26.194403 (+ 64us) server_negotiation.cc:299] Negotiation successful
0807 22:44:26.194426 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 22:44:26.194869 19499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:26.189753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:33437 (local address 127.22.212.67:57295)
0807 22:44:26.189932 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:26.189972 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:26.190444 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:26.190664 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:26.190668 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:26.190676 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:44:26.191342 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:26.191349 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:26.192317 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:26.192318 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:26.193143 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:26.193146 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:26.193489 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:26.193490 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:26.193598 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:26.194143 (+ 545us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:44:26.194144 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:44:26.194173 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:44:26.194197 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:44:26.194348 (+ 151us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:44:26.194351 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:44:26.194354 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:44:26.194407 (+ 53us) client_negotiation.cc:240] Negotiation successful
0807 22:44:26.194505 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":90,"threads_started":1}
I20260807 22:44:26.195386 19496 heartbeater.cc:347] Connected to a master server at 127.22.212.126:33437
I20260807 22:44:26.195492 19496 heartbeater.cc:464] Registering TS with master...
I20260807 22:44:26.195677 19496 heartbeater.cc:511] Master 127.22.212.126:33437 requested a full tablet report, sending...
I20260807 22:44:26.196103 18813 ts_manager.cc:194] Registered new tserver with Master: c133c3b7119f40e7ba612277b9a6c8c3 (127.22.212.67:43281)
I20260807 22:44:26.196540 18813 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.212.67:57295
I20260807 22:44:26.202952 23377 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:44:26.207312 18871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:26.204556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52914 (local address 127.22.212.126:33437)
0807 22:44:26.204608 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:26.204610 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:26.204707 (+ 97us) server_negotiation.cc:407] Connection header received
0807 22:44:26.204763 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:26.204764 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:26.204775 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:26.204828 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:26.204947 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:26.205420 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:26.206163 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:26.206348 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:26.206398 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:26.207068 (+ 670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:26.207069 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:26.207070 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:44:26.207090 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:26.207103 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:44:26.207107 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:26.207155 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:26.207193 (+ 38us) server_negotiation.cc:299] Negotiation successful
0807 22:44:26.207215 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 22:44:26.209053 18813 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52914:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:44:26.210758 18813 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:44:26.217108 19515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:26.213284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47112 (local address 127.22.212.65:33811)
0807 22:44:26.213583 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:26.213587 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:26.213611 (+ 24us) server_negotiation.cc:407] Connection header received
0807 22:44:26.213680 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:26.213683 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:26.213700 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:26.213781 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:44:26.213984 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:26.214711 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:26.216164 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:26.216719 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:26.216806 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:26.216901 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:26.216983 (+ 82us) server_negotiation.cc:299] Negotiation successful
0807 22:44:26.217019 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":263,"thread_start_us":87,"threads_started":1}
I20260807 22:44:26.217094 19509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:26.213044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:33811 (local address 127.0.0.1:47112)
0807 22:44:26.213554 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:26.213563 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:26.213603 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:26.213853 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:26.213854 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:26.213857 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:44:26.213908 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:26.213910 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:26.214797 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:26.214798 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:26.216068 (+ 1270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:26.216071 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:26.216806 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:26.216807 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:26.216883 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:26.216897 (+ 14us) client_negotiation.cc:769] Sending connection context
0807 22:44:26.216970 (+ 73us) client_negotiation.cc:240] Negotiation successful
0807 22:44:26.217023 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":494,"mutex_wait_us":5,"thread_start_us":97,"threads_started":1}
I20260807 22:44:26.217295 19510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:26.213011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.66:42681 (local address 127.0.0.1:47938)
0807 22:44:26.213310 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:26.213349 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:26.213436 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:26.213679 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:26.213682 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:26.213685 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:44:26.213753 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:26.213754 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:26.215067 (+ 1313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:26.215068 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:26.216099 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:26.216101 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:26.217054 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:26.217055 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:26.217119 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:26.217123 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 22:44:26.217154 (+ 31us) client_negotiation.cc:240] Negotiation successful
0807 22:44:26.217193 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":69,"threads_started":1}
I20260807 22:44:26.217418 19513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:26.213115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34184 (local address 127.22.212.67:43281)
0807 22:44:26.213488 (+ 373us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:26.213493 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:26.213504 (+ 11us) server_negotiation.cc:407] Connection header received
0807 22:44:26.213838 (+ 334us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:26.213841 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:26.213856 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:26.213907 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:44:26.214123 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:26.215148 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:26.216296 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:26.216955 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:26.217017 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:26.217104 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:26.217275 (+ 171us) server_negotiation.cc:299] Negotiation successful
0807 22:44:26.217324 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":325,"thread_start_us":83,"threads_started":1}
I20260807 22:44:26.217650 19506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:26.213031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.67:43281 (local address 127.0.0.1:34184)
0807 22:44:26.213447 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:26.213459 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:26.213732 (+ 273us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:26.213997 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:26.213997 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:26.213999 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:44:26.214044 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:26.214045 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:26.215232 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:26.215234 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:26.216179 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:26.216182 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:26.217136 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:26.217137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:26.217189 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:26.217192 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:44:26.217542 (+ 350us) client_negotiation.cc:240] Negotiation successful
0807 22:44:26.217585 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":91,"threads_started":1}
I20260807 22:44:26.217734 19514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:26.213262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47938 (local address 127.22.212.66:42681)
0807 22:44:26.213481 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:26.213486 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:26.213498 (+ 12us) server_negotiation.cc:407] Connection header received
0807 22:44:26.213542 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:26.213544 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:26.213564 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:26.213833 (+ 269us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:44:26.213894 (+ 61us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:26.214975 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:26.216190 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:26.216930 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:26.217483 (+ 553us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:26.217582 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:26.217608 (+ 26us) server_negotiation.cc:299] Negotiation successful
0807 22:44:26.217644 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":94,"threads_started":1}
I20260807 22:44:26.218256 19001 tablet_service.cc:1467] Processing CreateTablet for tablet 91ded959a6a74772a1dfe23243fb1b50 (DEFAULT_TABLE table=test-table [id=ffb2e48507b54b5c8bc4aa6657f94d20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:44:26.218338 19386 tablet_service.cc:1467] Processing CreateTablet for tablet 91ded959a6a74772a1dfe23243fb1b50 (DEFAULT_TABLE table=test-table [id=ffb2e48507b54b5c8bc4aa6657f94d20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:44:26.218340 19194 tablet_service.cc:1467] Processing CreateTablet for tablet 91ded959a6a74772a1dfe23243fb1b50 (DEFAULT_TABLE table=test-table [id=ffb2e48507b54b5c8bc4aa6657f94d20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:44:26.218716 19001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91ded959a6a74772a1dfe23243fb1b50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:44:26.218719 19386 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91ded959a6a74772a1dfe23243fb1b50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:44:26.218719 19194 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91ded959a6a74772a1dfe23243fb1b50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:44:26.221626 19517 tablet_bootstrap.cc:492] T 91ded959a6a74772a1dfe23243fb1b50 P c538bc8a890f45fbb0f1b412fed7b138: Bootstrap starting.
I20260807 22:44:26.222029 19519 tablet_bootstrap.cc:492] T 91ded959a6a74772a1dfe23243fb1b50 P a1897285e3e24e65aedccd06a0c536f7: Bootstrap starting.
I20260807 22:44:26.222416 19517 tablet_bootstrap.cc:654] T 91ded959a6a74772a1dfe23243fb1b50 P c538bc8a890f45fbb0f1b412fed7b138: Neither blocks nor log segments found. Creating new log.
I20260807 22:44:26.222769 19519 tablet_bootstrap.cc:654] T 91ded959a6a74772a1dfe23243fb1b50 P a1897285e3e24e65aedccd06a0c536f7: Neither blocks nor log segments found. Creating new log.
I20260807 22:44:26.222762 19517 log.cc:824] T 91ded959a6a74772a1dfe23243fb1b50 P c538bc8a890f45fbb0f1b412fed7b138: Log is configured to *not* fsync() on all Append() calls
I20260807 22:44:26.223093 19519 log.cc:824] T 91ded959a6a74772a1dfe23243fb1b50 P a1897285e3e24e65aedccd06a0c536f7: Log is configured to *not* fsync() on all Append() calls
I20260807 22:44:26.223407 19518 tablet_bootstrap.cc:492] T 91ded959a6a74772a1dfe23243fb1b50 P c133c3b7119f40e7ba612277b9a6c8c3: Bootstrap starting.
I20260807 22:44:26.223523 19517 tablet_bootstrap.cc:492] T 91ded959a6a74772a1dfe23243fb1b50 P c538bc8a890f45fbb0f1b412fed7b138: No bootstrap required, opened a new log
I20260807 22:44:26.223611 19517 ts_tablet_manager.cc:1397] T 91ded959a6a74772a1dfe23243fb1b50 P c538bc8a890f45fbb0f1b412fed7b138: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 22:44:26.223814 19519 tablet_bootstrap.cc:492] T 91ded959a6a74772a1dfe23243fb1b50 P a1897285e3e24e65aedccd06a0c536f7: No bootstrap required, opened a new log
I20260807 22:44:26.223886 19519 ts_tablet_manager.cc:1397] T 91ded959a6a74772a1dfe23243fb1b50 P a1897285e3e24e65aedccd06a0c536f7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 22:44:26.224067 19518 tablet_bootstrap.cc:654] T 91ded959a6a74772a1dfe23243fb1b50 P c133c3b7119f40e7ba612277b9a6c8c3: Neither blocks nor log segments found. Creating new log.
I20260807 22:44:26.224417 19518 log.cc:824] T 91ded959a6a74772a1dfe23243fb1b50 P c133c3b7119f40e7ba612277b9a6c8c3: Log is configured to *not* fsync() on all Append() calls
I20260807 22:44:26.225260 19518 tablet_bootstrap.cc:492] T 91ded959a6a74772a1dfe23243fb1b50 P c133c3b7119f40e7ba612277b9a6c8c3: No bootstrap required, opened a new log
I20260807 22:44:26.225332 19518 ts_tablet_manager.cc:1397] T 91ded959a6a74772a1dfe23243fb1b50 P c133c3b7119f40e7ba612277b9a6c8c3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260807 22:44:26.225932 19517 raft_consensus.cc:348] T 91ded959a6a74772a1dfe23243fb1b50 P c538bc8a890f45fbb0f1b412fed7b138 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c133c3b7119f40e7ba612277b9a6c8c3" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 43281 } } peers { permanent_uuid: "a1897285e3e24e65aedccd06a0c536f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 42681 } } peers { permanent_uuid: "c538bc8a890f45fbb0f1b412fed7b138" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 33811 } }
I20260807 22:44:26.226094 19517 raft_consensus.cc:374] T 91ded959a6a74772a1dfe23243fb1b50 P c538bc8a890f45fbb0f1b412fed7b138 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:44:26.226193 19517 raft_consensus.cc:729] T 91ded959a6a74772a1dfe23243fb1b50 P c538bc8a890f45fbb0f1b412fed7b138 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c538bc8a890f45fbb0f1b412fed7b138, State: Initialized, Role: FOLLOWER
I20260807 22:44:26.226347 19517 consensus_queue.cc:260] T 91ded959a6a74772a1dfe23243fb1b50 P c538bc8a890f45fbb0f1b412fed7b138 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c133c3b7119f40e7ba612277b9a6c8c3" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 43281 } } peers { permanent_uuid: "a1897285e3e24e65aedccd06a0c536f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 42681 } } peers { permanent_uuid: "c538bc8a890f45fbb0f1b412fed7b138" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 33811 } }
I20260807 22:44:26.226616 19517 ts_tablet_manager.cc:1428] T 91ded959a6a74772a1dfe23243fb1b50 P c538bc8a890f45fbb0f1b412fed7b138: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 22:44:26.226747 19099 heartbeater.cc:503] Master 127.22.212.126:33437 was elected leader, sending a full tablet report...
I20260807 22:44:26.226769 19519 raft_consensus.cc:348] T 91ded959a6a74772a1dfe23243fb1b50 P a1897285e3e24e65aedccd06a0c536f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c133c3b7119f40e7ba612277b9a6c8c3" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 43281 } } peers { permanent_uuid: "a1897285e3e24e65aedccd06a0c536f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 42681 } } peers { permanent_uuid: "c538bc8a890f45fbb0f1b412fed7b138" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 33811 } }
I20260807 22:44:26.226936 19519 raft_consensus.cc:374] T 91ded959a6a74772a1dfe23243fb1b50 P a1897285e3e24e65aedccd06a0c536f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:44:26.227037 19519 raft_consensus.cc:729] T 91ded959a6a74772a1dfe23243fb1b50 P a1897285e3e24e65aedccd06a0c536f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1897285e3e24e65aedccd06a0c536f7, State: Initialized, Role: FOLLOWER
I20260807 22:44:26.227208 19519 consensus_queue.cc:260] T 91ded959a6a74772a1dfe23243fb1b50 P a1897285e3e24e65aedccd06a0c536f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c133c3b7119f40e7ba612277b9a6c8c3" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 43281 } } peers { permanent_uuid: "a1897285e3e24e65aedccd06a0c536f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 42681 } } peers { permanent_uuid: "c538bc8a890f45fbb0f1b412fed7b138" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 33811 } }
I20260807 22:44:26.227463 19519 ts_tablet_manager.cc:1428] T 91ded959a6a74772a1dfe23243fb1b50 P a1897285e3e24e65aedccd06a0c536f7: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 22:44:26.227569 19291 heartbeater.cc:503] Master 127.22.212.126:33437 was elected leader, sending a full tablet report...
I20260807 22:44:26.228012 19518 raft_consensus.cc:348] T 91ded959a6a74772a1dfe23243fb1b50 P c133c3b7119f40e7ba612277b9a6c8c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c133c3b7119f40e7ba612277b9a6c8c3" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 43281 } } peers { permanent_uuid: "a1897285e3e24e65aedccd06a0c536f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 42681 } } peers { permanent_uuid: "c538bc8a890f45fbb0f1b412fed7b138" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 33811 } }
I20260807 22:44:26.228156 19518 raft_consensus.cc:374] T 91ded959a6a74772a1dfe23243fb1b50 P c133c3b7119f40e7ba612277b9a6c8c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:44:26.228204 19518 raft_consensus.cc:729] T 91ded959a6a74772a1dfe23243fb1b50 P c133c3b7119f40e7ba612277b9a6c8c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c133c3b7119f40e7ba612277b9a6c8c3, State: Initialized, Role: FOLLOWER
I20260807 22:44:26.228344 19518 consensus_queue.cc:260] T 91ded959a6a74772a1dfe23243fb1b50 P c133c3b7119f40e7ba612277b9a6c8c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c133c3b7119f40e7ba612277b9a6c8c3" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 43281 } } peers { permanent_uuid: "a1897285e3e24e65aedccd06a0c536f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 42681 } } peers { permanent_uuid: "c538bc8a890f45fbb0f1b412fed7b138" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 33811 } }
I20260807 22:44:26.228621 19518 ts_tablet_manager.cc:1428] T 91ded959a6a74772a1dfe23243fb1b50 P c133c3b7119f40e7ba612277b9a6c8c3: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260807 22:44:26.228716 19496 heartbeater.cc:503] Master 127.22.212.126:33437 was elected leader, sending a full tablet report...
I20260807 22:44:26.250669 19529 raft_consensus.cc:482] T 91ded959a6a74772a1dfe23243fb1b50 P c133c3b7119f40e7ba612277b9a6c8c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:44:26.250814 19529 raft_consensus.cc:504] T 91ded959a6a74772a1dfe23243fb1b50 P c133c3b7119f40e7ba612277b9a6c8c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c133c3b7119f40e7ba612277b9a6c8c3" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 43281 } } peers { permanent_uuid: "a1897285e3e24e65aedccd06a0c536f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 42681 } } peers { permanent_uuid: "c538bc8a890f45fbb0f1b412fed7b138" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 33811 } }
I20260807 22:44:26.251192 19529 leader_election.cc:288] T 91ded959a6a74772a1dfe23243fb1b50 P c133c3b7119f40e7ba612277b9a6c8c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1897285e3e24e65aedccd06a0c536f7 (127.22.212.66:42681), c538bc8a890f45fbb0f1b412fed7b138 (127.22.212.65:33811)
I20260807 22:44:26.254724 19515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:26.251440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:51993 (local address 127.22.212.65:33811)
0807 22:44:26.251499 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:26.251501 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:26.251655 (+ 154us) server_negotiation.cc:407] Connection header received
0807 22:44:26.251691 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:26.251692 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:26.251705 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:26.251770 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:44:26.251956 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:26.252512 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:26.253764 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:26.254347 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:26.254437 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:26.254445 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:26.254609 (+ 164us) server_negotiation.cc:299] Negotiation successful
0807 22:44:26.254652 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260807 22:44:26.254724 19514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:26.251404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:48301 (local address 127.22.212.66:42681)
0807 22:44:26.251487 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:26.251489 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:26.251497 (+ 8us) server_negotiation.cc:407] Connection header received
0807 22:44:26.251524 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:26.251525 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:26.251537 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:26.251598 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:44:26.251787 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:26.252348 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:26.253764 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:26.254367 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:26.254437 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:26.254445 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:26.254628 (+ 183us) server_negotiation.cc:299] Negotiation successful
0807 22:44:26.254667 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 22:44:26.254747 19499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:26.251330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.66:42681 (local address 127.22.212.67:48301)
0807 22:44:26.251383 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:26.251395 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:26.251440 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:26.251612 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:26.251613 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:26.251615 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:44:26.251701 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:26.251703 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:26.252434 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:26.252435 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:26.253633 (+ 1198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:26.253635 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:26.254461 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:26.254462 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:26.254526 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:26.254530 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 22:44:26.254593 (+ 63us) client_negotiation.cc:240] Negotiation successful
0807 22:44:26.254635 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260807 22:44:26.254768 19530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:26.251390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:33811 (local address 127.22.212.67:51993)
0807 22:44:26.251587 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:26.251596 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:26.251651 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:26.251779 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:26.251779 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:26.251781 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:44:26.251844 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:26.251846 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:26.252580 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:26.252580 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:26.253663 (+ 1083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:26.253665 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:26.254438 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:26.254439 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:26.254528 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:26.254530 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 22:44:26.254593 (+ 63us) client_negotiation.cc:240] Negotiation successful
0807 22:44:26.254635 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"mutex_wait_us":12,"thread_start_us":122,"threads_started":1}
I20260807 22:44:26.255184 19029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91ded959a6a74772a1dfe23243fb1b50" candidate_uuid: "c133c3b7119f40e7ba612277b9a6c8c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538bc8a890f45fbb0f1b412fed7b138" is_pre_election: true
I20260807 22:44:26.255260 19221 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91ded959a6a74772a1dfe23243fb1b50" candidate_uuid: "c133c3b7119f40e7ba612277b9a6c8c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1897285e3e24e65aedccd06a0c536f7" is_pre_election: true
I20260807 22:44:26.255347 19029 raft_consensus.cc:2454] T 91ded959a6a74772a1dfe23243fb1b50 P c538bc8a890f45fbb0f1b412fed7b138 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c133c3b7119f40e7ba612277b9a6c8c3 in term 0.
I20260807 22:44:26.255439 19221 raft_consensus.cc:2454] T 91ded959a6a74772a1dfe23243fb1b50 P a1897285e3e24e65aedccd06a0c536f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c133c3b7119f40e7ba612277b9a6c8c3 in term 0.
I20260807 22:44:26.255571 19322 leader_election.cc:302] T 91ded959a6a74772a1dfe23243fb1b50 P c133c3b7119f40e7ba612277b9a6c8c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c133c3b7119f40e7ba612277b9a6c8c3, c538bc8a890f45fbb0f1b412fed7b138; no voters:
I20260807 22:44:26.255700 19529 raft_consensus.cc:2781] T 91ded959a6a74772a1dfe23243fb1b50 P c133c3b7119f40e7ba612277b9a6c8c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:44:26.255766 19529 raft_consensus.cc:482] T 91ded959a6a74772a1dfe23243fb1b50 P c133c3b7119f40e7ba612277b9a6c8c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:44:26.255784 19529 raft_consensus.cc:3037] T 91ded959a6a74772a1dfe23243fb1b50 P c133c3b7119f40e7ba612277b9a6c8c3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:44:26.256544 19529 raft_consensus.cc:504] T 91ded959a6a74772a1dfe23243fb1b50 P c133c3b7119f40e7ba612277b9a6c8c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c133c3b7119f40e7ba612277b9a6c8c3" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 43281 } } peers { permanent_uuid: "a1897285e3e24e65aedccd06a0c536f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 42681 } } peers { permanent_uuid: "c538bc8a890f45fbb0f1b412fed7b138" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 33811 } }
I20260807 22:44:26.256695 19529 leader_election.cc:288] T 91ded959a6a74772a1dfe23243fb1b50 P c133c3b7119f40e7ba612277b9a6c8c3 [CANDIDATE]: Term 1 election: Requested vote from peers a1897285e3e24e65aedccd06a0c536f7 (127.22.212.66:42681), c538bc8a890f45fbb0f1b412fed7b138 (127.22.212.65:33811)
I20260807 22:44:26.256842 19221 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91ded959a6a74772a1dfe23243fb1b50" candidate_uuid: "c133c3b7119f40e7ba612277b9a6c8c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1897285e3e24e65aedccd06a0c536f7"
I20260807 22:44:26.256891 19029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91ded959a6a74772a1dfe23243fb1b50" candidate_uuid: "c133c3b7119f40e7ba612277b9a6c8c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c538bc8a890f45fbb0f1b412fed7b138"
I20260807 22:44:26.256950 19029 raft_consensus.cc:3037] T 91ded959a6a74772a1dfe23243fb1b50 P c538bc8a890f45fbb0f1b412fed7b138 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:44:26.256932 19221 raft_consensus.cc:3037] T 91ded959a6a74772a1dfe23243fb1b50 P a1897285e3e24e65aedccd06a0c536f7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:44:26.257704 19029 raft_consensus.cc:2454] T 91ded959a6a74772a1dfe23243fb1b50 P c538bc8a890f45fbb0f1b412fed7b138 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c133c3b7119f40e7ba612277b9a6c8c3 in term 1.
I20260807 22:44:26.257874 19221 raft_consensus.cc:2454] T 91ded959a6a74772a1dfe23243fb1b50 P a1897285e3e24e65aedccd06a0c536f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c133c3b7119f40e7ba612277b9a6c8c3 in term 1.
I20260807 22:44:26.257874 19322 leader_election.cc:302] T 91ded959a6a74772a1dfe23243fb1b50 P c133c3b7119f40e7ba612277b9a6c8c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c133c3b7119f40e7ba612277b9a6c8c3, c538bc8a890f45fbb0f1b412fed7b138; no voters:
I20260807 22:44:26.258009 19529 raft_consensus.cc:2781] T 91ded959a6a74772a1dfe23243fb1b50 P c133c3b7119f40e7ba612277b9a6c8c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:44:26.258177 19529 raft_consensus.cc:686] T 91ded959a6a74772a1dfe23243fb1b50 P c133c3b7119f40e7ba612277b9a6c8c3 [term 1 LEADER]: Becoming Leader. State: Replica: c133c3b7119f40e7ba612277b9a6c8c3, State: Running, Role: LEADER
I20260807 22:44:26.258266 19529 consensus_queue.cc:237] T 91ded959a6a74772a1dfe23243fb1b50 P c133c3b7119f40e7ba612277b9a6c8c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c133c3b7119f40e7ba612277b9a6c8c3" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 43281 } } peers { permanent_uuid: "a1897285e3e24e65aedccd06a0c536f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 42681 } } peers { permanent_uuid: "c538bc8a890f45fbb0f1b412fed7b138" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 33811 } }
I20260807 22:44:26.259152 18813 catalog_manager.cc:5495] T 91ded959a6a74772a1dfe23243fb1b50 P c133c3b7119f40e7ba612277b9a6c8c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to c133c3b7119f40e7ba612277b9a6c8c3 (127.22.212.67). New cstate: current_term: 1 leader_uuid: "c133c3b7119f40e7ba612277b9a6c8c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c133c3b7119f40e7ba612277b9a6c8c3" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 43281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1897285e3e24e65aedccd06a0c536f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 42681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c538bc8a890f45fbb0f1b412fed7b138" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 33811 } health_report { overall_health: UNKNOWN } } }
I20260807 22:44:26.274724 19513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:26.272592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33074 (local address 127.22.212.67:43281)
0807 22:44:26.272674 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:26.272675 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:26.272685 (+ 10us) server_negotiation.cc:407] Connection header received
0807 22:44:26.272718 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:26.272719 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:26.272735 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:26.272807 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:44:26.272904 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:26.273360 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:26.274076 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:26.274267 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:26.274333 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:26.274442 (+ 109us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:44:26.274544 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:44:26.274600 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:26.274630 (+ 30us) server_negotiation.cc:299] Negotiation successful
0807 22:44:26.274650 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 22:44:26.276579 19029 raft_consensus.cc:1261] T 91ded959a6a74772a1dfe23243fb1b50 P c538bc8a890f45fbb0f1b412fed7b138 [term 1 FOLLOWER]: Refusing update from remote peer c133c3b7119f40e7ba612277b9a6c8c3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:44:26.276604 19221 raft_consensus.cc:1261] T 91ded959a6a74772a1dfe23243fb1b50 P a1897285e3e24e65aedccd06a0c536f7 [term 1 FOLLOWER]: Refusing update from remote peer c133c3b7119f40e7ba612277b9a6c8c3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:44:26.276918 19529 consensus_queue.cc:1035] T 91ded959a6a74772a1dfe23243fb1b50 P c133c3b7119f40e7ba612277b9a6c8c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c538bc8a890f45fbb0f1b412fed7b138" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 33811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:44:26.277042 19533 consensus_queue.cc:1035] T 91ded959a6a74772a1dfe23243fb1b50 P c133c3b7119f40e7ba612277b9a6c8c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1897285e3e24e65aedccd06a0c536f7" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 42681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:44:26.282065 18813 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52914:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:44:26.282155 18813 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52914:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:44:26.282872 18813 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a992c41c0e8a4a1e93458d8db23a7b76: Sending DeleteTablet for 3 replicas of tablet 91ded959a6a74772a1dfe23243fb1b50
I20260807 22:44:26.283202 19001 tablet_service.cc:1514] Processing DeleteTablet for tablet 91ded959a6a74772a1dfe23243fb1b50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:44:26 UTC) from {username='slave'} at 127.0.0.1:47112
I20260807 22:44:26.283207 19386 tablet_service.cc:1514] Processing DeleteTablet for tablet 91ded959a6a74772a1dfe23243fb1b50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:44:26 UTC) from {username='slave'} at 127.0.0.1:34184
I20260807 22:44:26.283496 19194 tablet_service.cc:1514] Processing DeleteTablet for tablet 91ded959a6a74772a1dfe23243fb1b50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:44:26 UTC) from {username='slave'} at 127.0.0.1:47938
I20260807 22:44:26.283577 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 18908
I20260807 22:44:26.292891 19555 tablet_replica.cc:330] T 91ded959a6a74772a1dfe23243fb1b50 P c133c3b7119f40e7ba612277b9a6c8c3: stopping tablet replica
I20260807 22:44:26.293099 19555 raft_consensus.cc:2229] T 91ded959a6a74772a1dfe23243fb1b50 P c133c3b7119f40e7ba612277b9a6c8c3 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:44:26.293274 19555 raft_consensus.cc:2258] T 91ded959a6a74772a1dfe23243fb1b50 P c133c3b7119f40e7ba612277b9a6c8c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:44:26.293471 19557 tablet_replica.cc:330] T 91ded959a6a74772a1dfe23243fb1b50 P a1897285e3e24e65aedccd06a0c536f7: stopping tablet replica
I20260807 22:44:26.293599 19557 raft_consensus.cc:2229] T 91ded959a6a74772a1dfe23243fb1b50 P a1897285e3e24e65aedccd06a0c536f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:44:26.293727 19557 raft_consensus.cc:2258] T 91ded959a6a74772a1dfe23243fb1b50 P a1897285e3e24e65aedccd06a0c536f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:44:26.294600 19555 ts_tablet_manager.cc:1905] T 91ded959a6a74772a1dfe23243fb1b50 P c133c3b7119f40e7ba612277b9a6c8c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:44:26.295819 19557 ts_tablet_manager.cc:1905] T 91ded959a6a74772a1dfe23243fb1b50 P a1897285e3e24e65aedccd06a0c536f7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:44:26.296550 19555 ts_tablet_manager.cc:1918] T 91ded959a6a74772a1dfe23243fb1b50 P c133c3b7119f40e7ba612277b9a6c8c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:44:26.296628 19555 log.cc:1196] T 91ded959a6a74772a1dfe23243fb1b50 P c133c3b7119f40e7ba612277b9a6c8c3: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-2/wal/wals/91ded959a6a74772a1dfe23243fb1b50
I20260807 22:44:26.296922 19555 ts_tablet_manager.cc:1939] T 91ded959a6a74772a1dfe23243fb1b50 P c133c3b7119f40e7ba612277b9a6c8c3: Deleting consensus metadata
I20260807 22:44:26.297240 19557 ts_tablet_manager.cc:1918] T 91ded959a6a74772a1dfe23243fb1b50 P a1897285e3e24e65aedccd06a0c536f7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:44:26.297330 19557 log.cc:1196] T 91ded959a6a74772a1dfe23243fb1b50 P a1897285e3e24e65aedccd06a0c536f7: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786142418640232-23377-0/minicluster-data/ts-1/wal/wals/91ded959a6a74772a1dfe23243fb1b50
I20260807 22:44:26.297441 18793 catalog_manager.cc:4841] TS c133c3b7119f40e7ba612277b9a6c8c3 (127.22.212.67:43281): tablet 91ded959a6a74772a1dfe23243fb1b50 (table test-table [id=ffb2e48507b54b5c8bc4aa6657f94d20]) successfully deleted
I20260807 22:44:26.297585 19557 ts_tablet_manager.cc:1939] T 91ded959a6a74772a1dfe23243fb1b50 P a1897285e3e24e65aedccd06a0c536f7: Deleting consensus metadata
I20260807 22:44:26.297997 18792 catalog_manager.cc:4841] TS a1897285e3e24e65aedccd06a0c536f7 (127.22.212.66:42681): tablet 91ded959a6a74772a1dfe23243fb1b50 (table test-table [id=ffb2e48507b54b5c8bc4aa6657f94d20]) successfully deleted
W20260807 22:44:26.302093 18797 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.212.65:33811 (error 108)
I20260807 22:44:26.302641 19506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:26.302488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:33811 (local address 127.0.0.1:60568)
0807 22:44:26.302551 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:26.302600 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.65:33811: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260807 22:44:26.302721 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 19102
W20260807 22:44:26.309759 18797 catalog_manager.cc:4584] TS c538bc8a890f45fbb0f1b412fed7b138 (127.22.212.65:33811): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 91ded959a6a74772a1dfe23243fb1b50: Network error: Client connection negotiation failed: client connection to 127.22.212.65:33811: connect: Connection refused (error 111)
I20260807 22:44:26.324155 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 19294
I20260807 22:44:26.334625 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 18770
2026-08-07T22:44:26Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (752 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:44:26 dist-test-slave-2d19 krb5kdc[19567](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:44:26 dist-test-slave-2d19 krb5kdc[19567](info): set up 2 sockets
Aug 07 22:44:26 dist-test-slave-2d19 krb5kdc[19567](info): commencing operation
krb5kdc: starting...
W20260807 22:44:27.607601 23377 mini_kdc.cc:121] Time spent starting KDC: real 1.248s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Aug 07 22:44:27 dist-test-slave-2d19 krb5kdc[19567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142667, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:44:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:44:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.212.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
I20260807 22:44:27.736948 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:34609
--webserver_interface=127.22.212.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:43937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:34609
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:44:27.821292 19585 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:44:27.821502 19585 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:44:27.821530 19585 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:44:27.822609 19585 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:44:27.822644 19585 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:44:27.822659 19585 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:44:27.822671 19585 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:44:27.822683 19585 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:44:27.824111 19585 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:43937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:34609
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:34609
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19585
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:44:27.824371 19585 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:44:27.824559 19585 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:44:27.829422 19597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:27.829416 19604 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:27.829540 19585 server_base.cc:1034] running on GCE node
W20260807 22:44:27.829417 19594 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:27.829825 19585 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:44:27.830078 19585 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:44:27.831216 19585 hybrid_clock.cc:648] HybridClock initialized: now 1786142667831198 us; error 35 us; skew 500 ppm
Aug 07 22:44:27 dist-test-slave-2d19 krb5kdc[19567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142667, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:44:27.833716 19585 init.cc:377] Logged in from keytab as kudu/127.22.212.126@KRBTEST.COM (short username kudu)
I20260807 22:44:27.834163 19585 webserver.cc:460] Webserver started at http://127.22.212.126:37981/ using document root <none> and password file <none>
I20260807 22:44:27.834347 19585 fs_manager.cc:359] Metadata directory not provided
I20260807 22:44:27.834391 19585 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:44:27.834492 19585 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:44:27.835518 19585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "a2a1b3b8a5ff4526abe9f94ebcfa18aa"
format_stamp: "Formatted at 2026-08-07 22:44:27 on dist-test-slave-2d19"
server_key: "ebf8d0ffb0243febaacae7c8f87fc6c9"
server_key_iv: "a42090200586a20205deec236e0feca3"
server_key_version: "encryptionkey@0"
I20260807 22:44:27.835825 19585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "a2a1b3b8a5ff4526abe9f94ebcfa18aa"
format_stamp: "Formatted at 2026-08-07 22:44:27 on dist-test-slave-2d19"
server_key: "ebf8d0ffb0243febaacae7c8f87fc6c9"
server_key_iv: "a42090200586a20205deec236e0feca3"
server_key_version: "encryptionkey@0"
I20260807 22:44:27.837205 19585 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 22:44:27.837901 19615 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:27.838088 19585 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:27.838174 19585 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "a2a1b3b8a5ff4526abe9f94ebcfa18aa"
format_stamp: "Formatted at 2026-08-07 22:44:27 on dist-test-slave-2d19"
server_key: "ebf8d0ffb0243febaacae7c8f87fc6c9"
server_key_iv: "a42090200586a20205deec236e0feca3"
server_key_version: "encryptionkey@0"
I20260807 22:44:27.838230 19585 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:44:27.857314 19585 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:44:27.859704 19585 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:44:27.859818 19585 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:44:27.863909 19585 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:34609
I20260807 22:44:27.864007 19696 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:34609 every 8 connection(s)
I20260807 22:44:27.864360 19585 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:44:27.865358 19698 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:44:27.867694 19698 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2a1b3b8a5ff4526abe9f94ebcfa18aa: Bootstrap starting.
I20260807 22:44:27.868358 19698 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a2a1b3b8a5ff4526abe9f94ebcfa18aa: Neither blocks nor log segments found. Creating new log.
I20260807 22:44:27.868651 19698 log.cc:824] T 00000000000000000000000000000000 P a2a1b3b8a5ff4526abe9f94ebcfa18aa: Log is configured to *not* fsync() on all Append() calls
I20260807 22:44:27.869359 19698 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2a1b3b8a5ff4526abe9f94ebcfa18aa: No bootstrap required, opened a new log
I20260807 22:44:27.870926 19698 raft_consensus.cc:348] T 00000000000000000000000000000000 P a2a1b3b8a5ff4526abe9f94ebcfa18aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2a1b3b8a5ff4526abe9f94ebcfa18aa" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 34609 } }
I20260807 22:44:27.871125 19698 raft_consensus.cc:374] T 00000000000000000000000000000000 P a2a1b3b8a5ff4526abe9f94ebcfa18aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:44:27.871178 19698 raft_consensus.cc:729] T 00000000000000000000000000000000 P a2a1b3b8a5ff4526abe9f94ebcfa18aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a1b3b8a5ff4526abe9f94ebcfa18aa, State: Initialized, Role: FOLLOWER
I20260807 22:44:27.871337 19698 consensus_queue.cc:260] T 00000000000000000000000000000000 P a2a1b3b8a5ff4526abe9f94ebcfa18aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2a1b3b8a5ff4526abe9f94ebcfa18aa" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 34609 } }
I20260807 22:44:27.871435 19698 raft_consensus.cc:388] T 00000000000000000000000000000000 P a2a1b3b8a5ff4526abe9f94ebcfa18aa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:44:27.871476 19698 raft_consensus.cc:482] T 00000000000000000000000000000000 P a2a1b3b8a5ff4526abe9f94ebcfa18aa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:44:27.871529 19698 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a2a1b3b8a5ff4526abe9f94ebcfa18aa [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:44:27.872059 19698 raft_consensus.cc:504] T 00000000000000000000000000000000 P a2a1b3b8a5ff4526abe9f94ebcfa18aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2a1b3b8a5ff4526abe9f94ebcfa18aa" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 34609 } }
I20260807 22:44:27.872177 19698 leader_election.cc:302] T 00000000000000000000000000000000 P a2a1b3b8a5ff4526abe9f94ebcfa18aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a2a1b3b8a5ff4526abe9f94ebcfa18aa; no voters:
I20260807 22:44:27.872391 19698 leader_election.cc:288] T 00000000000000000000000000000000 P a2a1b3b8a5ff4526abe9f94ebcfa18aa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:44:27.872448 19709 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a2a1b3b8a5ff4526abe9f94ebcfa18aa [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:44:27.872654 19709 raft_consensus.cc:686] T 00000000000000000000000000000000 P a2a1b3b8a5ff4526abe9f94ebcfa18aa [term 1 LEADER]: Becoming Leader. State: Replica: a2a1b3b8a5ff4526abe9f94ebcfa18aa, State: Running, Role: LEADER
I20260807 22:44:27.872659 19698 sys_catalog.cc:564] T 00000000000000000000000000000000 P a2a1b3b8a5ff4526abe9f94ebcfa18aa [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:44:27.872793 19709 consensus_queue.cc:237] T 00000000000000000000000000000000 P a2a1b3b8a5ff4526abe9f94ebcfa18aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2a1b3b8a5ff4526abe9f94ebcfa18aa" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 34609 } }
I20260807 22:44:27.873358 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 19585
I20260807 22:44:27.873494 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:44:27.873503 19712 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2a1b3b8a5ff4526abe9f94ebcfa18aa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a2a1b3b8a5ff4526abe9f94ebcfa18aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2a1b3b8a5ff4526abe9f94ebcfa18aa" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 34609 } } }
I20260807 22:44:27.873528 19714 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2a1b3b8a5ff4526abe9f94ebcfa18aa [sys.catalog]: SysCatalogTable state changed. Reason: New leader a2a1b3b8a5ff4526abe9f94ebcfa18aa. Latest consensus state: current_term: 1 leader_uuid: "a2a1b3b8a5ff4526abe9f94ebcfa18aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2a1b3b8a5ff4526abe9f94ebcfa18aa" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 34609 } } }
I20260807 22:44:27.873610 19712 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2a1b3b8a5ff4526abe9f94ebcfa18aa [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:27.873631 19714 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2a1b3b8a5ff4526abe9f94ebcfa18aa [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:27.873706 23377 external_mini_cluster.cc:1428] Setting key c1d2fad59a0e15c180e0cde2d255ece3
I20260807 22:44:27.873821 19727 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:44:27.874827 19727 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:44:27.876423 19727 catalog_manager.cc:1347] Generated new cluster ID: 6c5f8541ca4f4a4fa93ff917bfcb72c2
I20260807 22:44:27.876471 19727 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 22:44:27 dist-test-slave-2d19 krb5kdc[19567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142667, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:44:27.885847 19740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:27.874243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39246 (local address 127.22.212.126:34609)
0807 22:44:27.874416 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:27.874425 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:27.874462 (+ 37us) server_negotiation.cc:407] Connection header received
0807 22:44:27.874588 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:27.874595 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:27.874653 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:27.875548 (+ 895us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:27.875641 (+ 93us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:27.876969 (+ 1328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:27.878090 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:27.878695 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:27.878791 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:27.882083 (+ 3292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:27.882087 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:27.882088 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:44:27.882100 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:27.884065 (+ 1965us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:27.884515 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:27.884518 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:27.884518 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:27.884647 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:27.884862 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:27.884863 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:27.884863 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:27.885173 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:27.885326 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:27.885446 (+ 120us) server_negotiation.cc:299] Negotiation successful
0807 22:44:27.885582 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":74,"threads_started":1}
I20260807 22:44:27.889081 19727 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:44:27.889607 19727 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:44:27.891886 19727 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a2a1b3b8a5ff4526abe9f94ebcfa18aa: Generated new TSK 0
I20260807 22:44:27.892061 19727 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.212.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab.
Entry for principal kudu/127.22.212.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab.
I20260807 22:44:27.923619 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.65:0
--local_ip_for_outbound_sockets=127.22.212.65
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:34609
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:43937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:44:28.009498 19749 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:44:28.009712 19749 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:44:28.009738 19749 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:44:28.010840 19749 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:44:28.010876 19749 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:44:28.010902 19749 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.65
I20260807 22:44:28.012362 19749 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:43937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:34609
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19749
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.65
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:44:28.012548 19749 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:44:28.012739 19749 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:44:28.017974 19760 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:28.017987 19758 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:28.017997 19763 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:28.018038 19749 server_base.cc:1034] running on GCE node
I20260807 22:44:28.018455 19749 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:44:28.018736 19749 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:44:28.019902 19749 hybrid_clock.cc:648] HybridClock initialized: now 1786142668019882 us; error 36 us; skew 500 ppm
Aug 07 22:44:28 dist-test-slave-2d19 krb5kdc[19567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142668, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:44:28.022709 19749 init.cc:377] Logged in from keytab as kudu/127.22.212.65@KRBTEST.COM (short username kudu)
I20260807 22:44:28.023290 19749 webserver.cc:460] Webserver started at http://127.22.212.65:33309/ using document root <none> and password file <none>
I20260807 22:44:28.023571 19749 fs_manager.cc:359] Metadata directory not provided
I20260807 22:44:28.023649 19749 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:44:28.023815 19749 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:44:28.025118 19749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-0/data/instance:
uuid: "d71d3896ecdb4bb5b9b9000a2db42539"
format_stamp: "Formatted at 2026-08-07 22:44:28 on dist-test-slave-2d19"
server_key: "12a38033f1778d188b0b96f5a456dd7c"
server_key_iv: "e32d358dee4c9486198f2b4215adc90a"
server_key_version: "encryptionkey@0"
I20260807 22:44:28.025534 19749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance:
uuid: "d71d3896ecdb4bb5b9b9000a2db42539"
format_stamp: "Formatted at 2026-08-07 22:44:28 on dist-test-slave-2d19"
server_key: "12a38033f1778d188b0b96f5a456dd7c"
server_key_iv: "e32d358dee4c9486198f2b4215adc90a"
server_key_version: "encryptionkey@0"
I20260807 22:44:28.027040 19749 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 22:44:28.027922 19776 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:28.028142 19749 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:44:28.028285 19749 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-0/wal
uuid: "d71d3896ecdb4bb5b9b9000a2db42539"
format_stamp: "Formatted at 2026-08-07 22:44:28 on dist-test-slave-2d19"
server_key: "12a38033f1778d188b0b96f5a456dd7c"
server_key_iv: "e32d358dee4c9486198f2b4215adc90a"
server_key_version: "encryptionkey@0"
I20260807 22:44:28.028369 19749 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:44:28.049669 19749 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:44:28.051642 19749 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:44:28.051826 19749 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:44:28.052083 19749 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:44:28.052448 19749 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:44:28.052510 19749 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:28.052547 19749 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:44:28.052589 19749 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:28.058434 19749 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.65:33995
I20260807 22:44:28.058475 19953 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.65:33995 every 8 connection(s)
I20260807 22:44:28.058885 19749 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
I20260807 22:44:28.059816 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 19749
I20260807 22:44:28.059943 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance
I20260807 22:44:28.060201 23377 external_mini_cluster.cc:1428] Setting key 3889aa19db5da732a121bcdf8e7cf756
Aug 07 22:44:28 dist-test-slave-2d19 krb5kdc[19567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142668, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:44:28.069881 19740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:28.059688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:50733 (local address 127.22.212.126:34609)
0807 22:44:28.059765 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:28.059767 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:28.059981 (+ 214us) server_negotiation.cc:407] Connection header received
0807 22:44:28.060737 (+ 756us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:28.060738 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:28.060752 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:28.060812 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:28.062255 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:28.062812 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:28.063869 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:28.064216 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:28.064321 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:28.066564 (+ 2243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:28.066566 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:28.066567 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:44:28.066576 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:28.068331 (+ 1755us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:28.068802 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:28.068804 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:28.068804 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:28.068868 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:28.069157 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:28.069158 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:28.069158 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:28.069319 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:28.069399 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:28.069673 (+ 274us) server_negotiation.cc:299] Negotiation successful
0807 22:44:28.069784 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 22:44:28.069962 19962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:28.059635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:34609 (local address 127.22.212.65:50733)
0807 22:44:28.059825 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:28.059878 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:28.060630 (+ 752us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:28.060902 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:28.060907 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:28.061836 (+ 929us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:44:28.062149 (+ 313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:28.062156 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:28.062929 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:28.062930 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:28.063764 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:28.063767 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:28.064331 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:28.064332 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:28.064442 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:28.064996 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:44:28.065005 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:44:28.066447 (+ 1442us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:44:28.068436 (+ 1989us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:44:28.068444 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:44:28.068447 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:44:28.068716 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:44:28.068960 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:44:28.068961 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:44:28.068961 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:44:28.069082 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:44:28.069395 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:44:28.069400 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:44:28.069530 (+ 130us) client_negotiation.cc:769] Sending connection context
0807 22:44:28.069624 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 22:44:28.069762 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":103,"threads_started":1}
WARNING: no policy specified for kudu/127.22.212.66@KRBTEST.COM; defaulting to no policy
I20260807 22:44:28.070904 19956 heartbeater.cc:347] Connected to a master server at 127.22.212.126:34609
I20260807 22:44:28.071054 19956 heartbeater.cc:464] Registering TS with master...
I20260807 22:44:28.071266 19956 heartbeater.cc:511] Master 127.22.212.126:34609 requested a full tablet report, sending...
I20260807 22:44:28.071841 19643 ts_manager.cc:194] Registered new tserver with Master: d71d3896ecdb4bb5b9b9000a2db42539 (127.22.212.65:33995)
I20260807 22:44:28.072623 19643 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.65@KRBTEST.COM'} at 127.22.212.65:50733
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab.
Entry for principal kudu/127.22.212.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab.
I20260807 22:44:28.091027 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.66:0
--local_ip_for_outbound_sockets=127.22.212.66
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:34609
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:43937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:44:28.178776 19966 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:44:28.179097 19966 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:44:28.179126 19966 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:44:28.180442 19966 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:44:28.180487 19966 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:44:28.180516 19966 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.66
I20260807 22:44:28.182153 19966 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:43937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:34609
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19966
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.66
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:44:28.182430 19966 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:44:28.182695 19966 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:44:28.188588 19972 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:28.188627 19966 server_base.cc:1034] running on GCE node
W20260807 22:44:28.188588 19975 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:28.188618 19973 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:28.189117 19966 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:44:28.189421 19966 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:44:28.190594 19966 hybrid_clock.cc:648] HybridClock initialized: now 1786142668190576 us; error 38 us; skew 500 ppm
Aug 07 22:44:28 dist-test-slave-2d19 krb5kdc[19567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142668, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:44:28.193347 19966 init.cc:377] Logged in from keytab as kudu/127.22.212.66@KRBTEST.COM (short username kudu)
I20260807 22:44:28.193859 19966 webserver.cc:460] Webserver started at http://127.22.212.66:43833/ using document root <none> and password file <none>
I20260807 22:44:28.194095 19966 fs_manager.cc:359] Metadata directory not provided
I20260807 22:44:28.194162 19966 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:44:28.194314 19966 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:44:28.195406 19966 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-1/data/instance:
uuid: "4eb446910cf6470ba0f07a00a299279b"
format_stamp: "Formatted at 2026-08-07 22:44:28 on dist-test-slave-2d19"
server_key: "df6258eda953d0ba036b12200fb5db35"
server_key_iv: "679b06d19e2298a2658c1f28e696e327"
server_key_version: "encryptionkey@0"
I20260807 22:44:28.195799 19966 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance:
uuid: "4eb446910cf6470ba0f07a00a299279b"
format_stamp: "Formatted at 2026-08-07 22:44:28 on dist-test-slave-2d19"
server_key: "df6258eda953d0ba036b12200fb5db35"
server_key_iv: "679b06d19e2298a2658c1f28e696e327"
server_key_version: "encryptionkey@0"
I20260807 22:44:28.197325 19966 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 22:44:28.198135 19985 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:28.198307 19966 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 22:44:28.198424 19966 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-1/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-1/wal
uuid: "4eb446910cf6470ba0f07a00a299279b"
format_stamp: "Formatted at 2026-08-07 22:44:28 on dist-test-slave-2d19"
server_key: "df6258eda953d0ba036b12200fb5db35"
server_key_iv: "679b06d19e2298a2658c1f28e696e327"
server_key_version: "encryptionkey@0"
I20260807 22:44:28.198515 19966 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:44:28.219790 19966 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:44:28.222091 19966 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:44:28.222258 19966 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:44:28.222515 19966 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:44:28.222837 19966 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:44:28.222888 19966 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:28.222932 19966 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:44:28.222976 19966 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:28.229156 19966 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.66:44829
I20260807 22:44:28.229209 20158 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.66:44829 every 8 connection(s)
I20260807 22:44:28.229578 19966 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
Aug 07 22:44:28 dist-test-slave-2d19 krb5kdc[19567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142668, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:44:28.237577 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 19966
I20260807 22:44:28.237668 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance
I20260807 22:44:28.237895 23377 external_mini_cluster.cc:1428] Setting key f54872c78379fa902941380a259ff11f
I20260807 22:44:28.239262 20164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:28.230351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:34609 (local address 127.22.212.66:53919)
0807 22:44:28.230532 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:28.230575 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:28.231143 (+ 568us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:28.231368 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:28.231371 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:28.231976 (+ 605us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:44:28.232220 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:28.232225 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:28.233042 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:28.233043 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:28.233832 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:28.233835 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:28.234169 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:28.234170 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:28.234272 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:28.234769 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:44:28.234778 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:44:28.236341 (+ 1563us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:44:28.237814 (+ 1473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:44:28.237821 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:44:28.237824 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:44:28.238117 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:44:28.238349 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:44:28.238350 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:44:28.238350 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:44:28.238483 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:44:28.238776 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:44:28.238781 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:44:28.238895 (+ 114us) client_negotiation.cc:769] Sending connection context
0807 22:44:28.238986 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 22:44:28.239103 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":108,"threads_started":1}
I20260807 22:44:28.239262 19740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:28.230364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:53919 (local address 127.22.212.126:34609)
0807 22:44:28.230431 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:28.230433 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:28.230666 (+ 233us) server_negotiation.cc:407] Connection header received
0807 22:44:28.231233 (+ 567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:28.231234 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:28.231245 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:28.231309 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:28.232455 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:28.232965 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:28.233905 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:28.234098 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:28.234148 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:28.236464 (+ 2316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:28.236465 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:28.236465 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:44:28.236472 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:28.237738 (+ 1266us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:28.238201 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:28.238202 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:28.238203 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:28.238274 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:28.238553 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:28.238554 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:28.238554 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:28.238704 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:28.238781 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:28.239033 (+ 252us) server_negotiation.cc:299] Negotiation successful
0807 22:44:28.239131 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260807 22:44:28.239954 20160 heartbeater.cc:347] Connected to a master server at 127.22.212.126:34609
I20260807 22:44:28.240060 20160 heartbeater.cc:464] Registering TS with master...
I20260807 22:44:28.240290 20160 heartbeater.cc:511] Master 127.22.212.126:34609 requested a full tablet report, sending...
I20260807 22:44:28.240787 19643 ts_manager.cc:194] Registered new tserver with Master: 4eb446910cf6470ba0f07a00a299279b (127.22.212.66:44829)
I20260807 22:44:28.241406 19643 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.66@KRBTEST.COM'} at 127.22.212.66:53919
WARNING: no policy specified for kudu/127.22.212.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab.
Entry for principal kudu/127.22.212.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab.
I20260807 22:44:28.267274 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.67:0
--local_ip_for_outbound_sockets=127.22.212.67
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:34609
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:43937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:44:28.350992 20169 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:44:28.351238 20169 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:44:28.351279 20169 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:44:28.352564 20169 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:44:28.352620 20169 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:44:28.352666 20169 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.67
I20260807 22:44:28.354123 20169 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:43937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:34609
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20169
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.67
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:44:28.354386 20169 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:44:28.354620 20169 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:44:28.359802 20178 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:28.359975 20169 server_base.cc:1034] running on GCE node
W20260807 22:44:28.359781 20183 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:28.359783 20179 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:28.360394 20169 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:44:28.360664 20169 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:44:28.361827 20169 hybrid_clock.cc:648] HybridClock initialized: now 1786142668361810 us; error 39 us; skew 500 ppm
Aug 07 22:44:28 dist-test-slave-2d19 krb5kdc[19567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142668, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:44:28.364607 20169 init.cc:377] Logged in from keytab as kudu/127.22.212.67@KRBTEST.COM (short username kudu)
I20260807 22:44:28.365057 20169 webserver.cc:460] Webserver started at http://127.22.212.67:36459/ using document root <none> and password file <none>
I20260807 22:44:28.365249 20169 fs_manager.cc:359] Metadata directory not provided
I20260807 22:44:28.365291 20169 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:44:28.365389 20169 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:44:28.366564 20169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-2/data/instance:
uuid: "5a6d78ab3f5949e2b09fdd7168d1acd3"
format_stamp: "Formatted at 2026-08-07 22:44:28 on dist-test-slave-2d19"
server_key: "8d3ee740787de78155e1f04d3bdc423c"
server_key_iv: "1c24ded37abb4de0dbc0dad2a0d7b629"
server_key_version: "encryptionkey@0"
I20260807 22:44:28.366884 20169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance:
uuid: "5a6d78ab3f5949e2b09fdd7168d1acd3"
format_stamp: "Formatted at 2026-08-07 22:44:28 on dist-test-slave-2d19"
server_key: "8d3ee740787de78155e1f04d3bdc423c"
server_key_iv: "1c24ded37abb4de0dbc0dad2a0d7b629"
server_key_version: "encryptionkey@0"
I20260807 22:44:28.368222 20169 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 22:44:28.369050 20195 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:28.369258 20169 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 22:44:28.369352 20169 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-2/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-2/wal
uuid: "5a6d78ab3f5949e2b09fdd7168d1acd3"
format_stamp: "Formatted at 2026-08-07 22:44:28 on dist-test-slave-2d19"
server_key: "8d3ee740787de78155e1f04d3bdc423c"
server_key_iv: "1c24ded37abb4de0dbc0dad2a0d7b629"
server_key_version: "encryptionkey@0"
I20260807 22:44:28.369413 20169 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:44:28.386205 20169 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:44:28.388311 20169 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:44:28.388444 20169 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:44:28.388677 20169 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:44:28.389030 20169 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:44:28.389087 20169 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:28.389134 20169 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:44:28.389168 20169 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:28.395648 20169 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.67:39223
I20260807 22:44:28.395689 20372 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.67:39223 every 8 connection(s)
I20260807 22:44:28.396118 20169 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
Aug 07 22:44:28 dist-test-slave-2d19 krb5kdc[19567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142668, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:44:28.402873 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 20169
I20260807 22:44:28.402983 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance
I20260807 22:44:28.403182 23377 external_mini_cluster.cc:1428] Setting key a714cd6a5257cdab7fcbda6711f66816
I20260807 22:44:28.412566 19740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:28.396940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:35517 (local address 127.22.212.126:34609)
0807 22:44:28.397001 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:28.397004 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:28.397201 (+ 197us) server_negotiation.cc:407] Connection header received
0807 22:44:28.397730 (+ 529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:28.397731 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:28.397745 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:28.397833 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:28.398847 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:28.399350 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:28.400424 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:28.400627 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:28.400709 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:28.403294 (+ 2585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:28.403296 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:28.403297 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:44:28.403304 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:28.411044 (+ 7740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:28.411487 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:28.411488 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:28.411489 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:28.411557 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:28.411819 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:28.411820 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:28.411820 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:28.411949 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:28.412068 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:28.412387 (+ 319us) server_negotiation.cc:299] Negotiation successful
0807 22:44:28.412472 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260807 22:44:28.412774 20378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:28.396904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:34609 (local address 127.22.212.67:35517)
0807 22:44:28.397061 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:28.397099 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:28.397622 (+ 523us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:28.397918 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:28.397922 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:28.398543 (+ 621us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:44:28.398737 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:28.398742 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:28.399456 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:28.399457 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:28.400336 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:28.400339 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:28.400720 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:28.400721 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:28.400846 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:28.401413 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:44:28.401422 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:44:28.403127 (+ 1705us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:44:28.411155 (+ 8028us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:44:28.411163 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:44:28.411166 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:44:28.411407 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:44:28.411629 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:44:28.411630 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:44:28.411630 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:44:28.411744 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:44:28.412061 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:44:28.412068 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:44:28.412212 (+ 144us) client_negotiation.cc:769] Sending connection context
0807 22:44:28.412346 (+ 134us) client_negotiation.cc:240] Negotiation successful
0807 22:44:28.412524 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":75,"threads_started":1}
I20260807 22:44:28.413265 20373 heartbeater.cc:347] Connected to a master server at 127.22.212.126:34609
I20260807 22:44:28.413368 20373 heartbeater.cc:464] Registering TS with master...
I20260807 22:44:28.413564 20373 heartbeater.cc:511] Master 127.22.212.126:34609 requested a full tablet report, sending...
I20260807 22:44:28.413936 19643 ts_manager.cc:194] Registered new tserver with Master: 5a6d78ab3f5949e2b09fdd7168d1acd3 (127.22.212.67:39223)
I20260807 22:44:28.414278 19643 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.67@KRBTEST.COM'} at 127.22.212.67:35517
I20260807 22:44:28.415205 23377 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:44:28.422459 19740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:28.416550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39254 (local address 127.22.212.126:34609)
0807 22:44:28.416585 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:28.416587 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:28.416699 (+ 112us) server_negotiation.cc:407] Connection header received
0807 22:44:28.416745 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:28.416745 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:28.416753 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:28.416802 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:28.417300 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:28.417757 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:28.418446 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:28.418623 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:28.418671 (+ 48us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:28.419916 (+ 1245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:28.419917 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:28.419918 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:44:28.419922 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:28.421170 (+ 1248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:28.421541 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:28.421542 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:28.421542 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:28.421593 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:28.421878 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:28.421879 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:28.421879 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:28.422080 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:28.422192 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:28.422329 (+ 137us) server_negotiation.cc:299] Negotiation successful
0807 22:44:28.422385 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260807 22:44:28.424134 19643 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39254:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:44:28.425823 19643 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:44:28.432713 20406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:28.428410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54280 (local address 127.22.212.67:39223)
0807 22:44:28.428577 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:28.428582 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:28.428715 (+ 133us) server_negotiation.cc:407] Connection header received
0807 22:44:28.428840 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:28.428843 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:28.428861 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:28.428920 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:44:28.429246 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:28.429983 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:28.431425 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:28.432175 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:28.432242 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:28.432338 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:28.432561 (+ 223us) server_negotiation.cc:299] Negotiation successful
0807 22:44:28.432607 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":95,"threads_started":1}
I20260807 22:44:28.432734 20404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:28.428352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.66:44829 (local address 127.0.0.1:46212)
0807 22:44:28.428624 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:28.428657 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:28.428725 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:28.429109 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:28.429110 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:28.429112 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:44:28.429170 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:28.429172 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:28.430516 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:28.430517 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:28.431626 (+ 1109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:28.431629 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:28.432453 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:28.432454 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:28.432520 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:28.432525 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 22:44:28.432577 (+ 52us) client_negotiation.cc:240] Negotiation successful
0807 22:44:28.432641 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":60,"threads_started":1}
I20260807 22:44:28.432832 20411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:28.428829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53014 (local address 127.22.212.65:33995)
0807 22:44:28.429005 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:28.429010 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:28.429019 (+ 9us) server_negotiation.cc:407] Connection header received
0807 22:44:28.429058 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:28.429060 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:28.429073 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:28.429281 (+ 208us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:44:28.429352 (+ 71us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:28.430462 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:28.431690 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:28.432484 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:28.432558 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:28.432613 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:28.432699 (+ 86us) server_negotiation.cc:299] Negotiation successful
0807 22:44:28.432743 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":99,"threads_started":1}
I20260807 22:44:28.432987 20407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:28.428448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46212 (local address 127.22.212.66:44829)
0807 22:44:28.428681 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:28.428685 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:28.428699 (+ 14us) server_negotiation.cc:407] Connection header received
0807 22:44:28.428858 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:28.428862 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:28.428878 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:28.429019 (+ 141us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:44:28.429248 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:28.430392 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:28.431706 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:28.432358 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:28.432428 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:28.432485 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:28.432852 (+ 367us) server_negotiation.cc:299] Negotiation successful
0807 22:44:28.432900 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":77,"threads_started":1}
I20260807 22:44:28.433049 20403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:28.428348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.67:39223 (local address 127.0.0.1:54280)
0807 22:44:28.428603 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:28.428647 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:28.428744 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:28.429076 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:28.429079 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:28.429082 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:44:28.429153 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:28.429156 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:28.430081 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:28.430081 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:28.431331 (+ 1250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:28.431335 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:28.432310 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:28.432311 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:28.432410 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:28.432428 (+ 18us) client_negotiation.cc:769] Sending connection context
0807 22:44:28.432924 (+ 496us) client_negotiation.cc:240] Negotiation successful
0807 22:44:28.432975 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":126,"threads_started":1}
I20260807 22:44:28.433683 20261 tablet_service.cc:1467] Processing CreateTablet for tablet ecec02229da644a38bda3bef74057662 (DEFAULT_TABLE table=test-table [id=78405b40c9ce449b97c45a68ae301a9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:44:28.433717 20057 tablet_service.cc:1467] Processing CreateTablet for tablet ecec02229da644a38bda3bef74057662 (DEFAULT_TABLE table=test-table [id=78405b40c9ce449b97c45a68ae301a9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:44:28.434013 20057 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ecec02229da644a38bda3bef74057662. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:44:28.434021 20261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ecec02229da644a38bda3bef74057662. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:44:28.436489 20408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:28.428586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:33995 (local address 127.0.0.1:53014)
0807 22:44:28.428811 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:28.428821 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:28.428866 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:28.429171 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:28.429171 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:28.429173 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:44:28.429208 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:28.429209 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:28.430592 (+ 1383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:28.430593 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:28.431570 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:28.431573 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:28.432557 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:28.432558 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:28.432612 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:28.432615 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:44:28.432683 (+ 68us) client_negotiation.cc:240] Negotiation successful
0807 22:44:28.432728 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":77,"threads_started":1}
I20260807 22:44:28.436708 20413 tablet_bootstrap.cc:492] T ecec02229da644a38bda3bef74057662 P 5a6d78ab3f5949e2b09fdd7168d1acd3: Bootstrap starting.
I20260807 22:44:28.437431 20413 tablet_bootstrap.cc:654] T ecec02229da644a38bda3bef74057662 P 5a6d78ab3f5949e2b09fdd7168d1acd3: Neither blocks nor log segments found. Creating new log.
I20260807 22:44:28.437366 19855 tablet_service.cc:1467] Processing CreateTablet for tablet ecec02229da644a38bda3bef74057662 (DEFAULT_TABLE table=test-table [id=78405b40c9ce449b97c45a68ae301a9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:44:28.437734 20415 tablet_bootstrap.cc:492] T ecec02229da644a38bda3bef74057662 P 4eb446910cf6470ba0f07a00a299279b: Bootstrap starting.
I20260807 22:44:28.437749 19855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ecec02229da644a38bda3bef74057662. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:44:28.438030 20413 log.cc:824] T ecec02229da644a38bda3bef74057662 P 5a6d78ab3f5949e2b09fdd7168d1acd3: Log is configured to *not* fsync() on all Append() calls
I20260807 22:44:28.438555 20415 tablet_bootstrap.cc:654] T ecec02229da644a38bda3bef74057662 P 4eb446910cf6470ba0f07a00a299279b: Neither blocks nor log segments found. Creating new log.
I20260807 22:44:28.438901 20413 tablet_bootstrap.cc:492] T ecec02229da644a38bda3bef74057662 P 5a6d78ab3f5949e2b09fdd7168d1acd3: No bootstrap required, opened a new log
I20260807 22:44:28.438990 20413 ts_tablet_manager.cc:1397] T ecec02229da644a38bda3bef74057662 P 5a6d78ab3f5949e2b09fdd7168d1acd3: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 22:44:28.439155 20415 log.cc:824] T ecec02229da644a38bda3bef74057662 P 4eb446910cf6470ba0f07a00a299279b: Log is configured to *not* fsync() on all Append() calls
I20260807 22:44:28.439962 20415 tablet_bootstrap.cc:492] T ecec02229da644a38bda3bef74057662 P 4eb446910cf6470ba0f07a00a299279b: No bootstrap required, opened a new log
I20260807 22:44:28.440048 20415 ts_tablet_manager.cc:1397] T ecec02229da644a38bda3bef74057662 P 4eb446910cf6470ba0f07a00a299279b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 22:44:28.441073 20413 raft_consensus.cc:348] T ecec02229da644a38bda3bef74057662 P 5a6d78ab3f5949e2b09fdd7168d1acd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a6d78ab3f5949e2b09fdd7168d1acd3" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39223 } } peers { permanent_uuid: "4eb446910cf6470ba0f07a00a299279b" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 44829 } } peers { permanent_uuid: "d71d3896ecdb4bb5b9b9000a2db42539" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 33995 } }
I20260807 22:44:28.441277 20413 raft_consensus.cc:374] T ecec02229da644a38bda3bef74057662 P 5a6d78ab3f5949e2b09fdd7168d1acd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:44:28.441331 20413 raft_consensus.cc:729] T ecec02229da644a38bda3bef74057662 P 5a6d78ab3f5949e2b09fdd7168d1acd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a6d78ab3f5949e2b09fdd7168d1acd3, State: Initialized, Role: FOLLOWER
I20260807 22:44:28.441239 20418 tablet_bootstrap.cc:492] T ecec02229da644a38bda3bef74057662 P d71d3896ecdb4bb5b9b9000a2db42539: Bootstrap starting.
I20260807 22:44:28.441465 20413 consensus_queue.cc:260] T ecec02229da644a38bda3bef74057662 P 5a6d78ab3f5949e2b09fdd7168d1acd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a6d78ab3f5949e2b09fdd7168d1acd3" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39223 } } peers { permanent_uuid: "4eb446910cf6470ba0f07a00a299279b" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 44829 } } peers { permanent_uuid: "d71d3896ecdb4bb5b9b9000a2db42539" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 33995 } }
I20260807 22:44:28.441741 20413 ts_tablet_manager.cc:1428] T ecec02229da644a38bda3bef74057662 P 5a6d78ab3f5949e2b09fdd7168d1acd3: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 22:44:28.441865 20373 heartbeater.cc:503] Master 127.22.212.126:34609 was elected leader, sending a full tablet report...
I20260807 22:44:28.442272 20418 tablet_bootstrap.cc:654] T ecec02229da644a38bda3bef74057662 P d71d3896ecdb4bb5b9b9000a2db42539: Neither blocks nor log segments found. Creating new log.
I20260807 22:44:28.442442 20415 raft_consensus.cc:348] T ecec02229da644a38bda3bef74057662 P 4eb446910cf6470ba0f07a00a299279b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a6d78ab3f5949e2b09fdd7168d1acd3" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39223 } } peers { permanent_uuid: "4eb446910cf6470ba0f07a00a299279b" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 44829 } } peers { permanent_uuid: "d71d3896ecdb4bb5b9b9000a2db42539" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 33995 } }
I20260807 22:44:28.442687 20415 raft_consensus.cc:374] T ecec02229da644a38bda3bef74057662 P 4eb446910cf6470ba0f07a00a299279b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:44:28.442744 20415 raft_consensus.cc:729] T ecec02229da644a38bda3bef74057662 P 4eb446910cf6470ba0f07a00a299279b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eb446910cf6470ba0f07a00a299279b, State: Initialized, Role: FOLLOWER
I20260807 22:44:28.442902 20418 log.cc:824] T ecec02229da644a38bda3bef74057662 P d71d3896ecdb4bb5b9b9000a2db42539: Log is configured to *not* fsync() on all Append() calls
I20260807 22:44:28.442899 20415 consensus_queue.cc:260] T ecec02229da644a38bda3bef74057662 P 4eb446910cf6470ba0f07a00a299279b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a6d78ab3f5949e2b09fdd7168d1acd3" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39223 } } peers { permanent_uuid: "4eb446910cf6470ba0f07a00a299279b" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 44829 } } peers { permanent_uuid: "d71d3896ecdb4bb5b9b9000a2db42539" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 33995 } }
I20260807 22:44:28.443210 20415 ts_tablet_manager.cc:1428] T ecec02229da644a38bda3bef74057662 P 4eb446910cf6470ba0f07a00a299279b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 22:44:28.443243 20160 heartbeater.cc:503] Master 127.22.212.126:34609 was elected leader, sending a full tablet report...
I20260807 22:44:28.443672 20418 tablet_bootstrap.cc:492] T ecec02229da644a38bda3bef74057662 P d71d3896ecdb4bb5b9b9000a2db42539: No bootstrap required, opened a new log
I20260807 22:44:28.443763 20418 ts_tablet_manager.cc:1397] T ecec02229da644a38bda3bef74057662 P d71d3896ecdb4bb5b9b9000a2db42539: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 22:44:28.445412 20418 raft_consensus.cc:348] T ecec02229da644a38bda3bef74057662 P d71d3896ecdb4bb5b9b9000a2db42539 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a6d78ab3f5949e2b09fdd7168d1acd3" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39223 } } peers { permanent_uuid: "4eb446910cf6470ba0f07a00a299279b" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 44829 } } peers { permanent_uuid: "d71d3896ecdb4bb5b9b9000a2db42539" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 33995 } }
I20260807 22:44:28.445574 20418 raft_consensus.cc:374] T ecec02229da644a38bda3bef74057662 P d71d3896ecdb4bb5b9b9000a2db42539 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:44:28.445627 20418 raft_consensus.cc:729] T ecec02229da644a38bda3bef74057662 P d71d3896ecdb4bb5b9b9000a2db42539 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d71d3896ecdb4bb5b9b9000a2db42539, State: Initialized, Role: FOLLOWER
I20260807 22:44:28.445757 20418 consensus_queue.cc:260] T ecec02229da644a38bda3bef74057662 P d71d3896ecdb4bb5b9b9000a2db42539 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a6d78ab3f5949e2b09fdd7168d1acd3" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39223 } } peers { permanent_uuid: "4eb446910cf6470ba0f07a00a299279b" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 44829 } } peers { permanent_uuid: "d71d3896ecdb4bb5b9b9000a2db42539" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 33995 } }
I20260807 22:44:28.446031 20418 ts_tablet_manager.cc:1428] T ecec02229da644a38bda3bef74057662 P d71d3896ecdb4bb5b9b9000a2db42539: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260807 22:44:28.446117 19956 heartbeater.cc:503] Master 127.22.212.126:34609 was elected leader, sending a full tablet report...
W20260807 22:44:28.480202 20163 tablet.cc:2369] T ecec02229da644a38bda3bef74057662 P 4eb446910cf6470ba0f07a00a299279b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:44:28.490008 20420 raft_consensus.cc:482] T ecec02229da644a38bda3bef74057662 P 5a6d78ab3f5949e2b09fdd7168d1acd3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:44:28.490140 20420 raft_consensus.cc:504] T ecec02229da644a38bda3bef74057662 P 5a6d78ab3f5949e2b09fdd7168d1acd3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a6d78ab3f5949e2b09fdd7168d1acd3" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39223 } } peers { permanent_uuid: "4eb446910cf6470ba0f07a00a299279b" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 44829 } } peers { permanent_uuid: "d71d3896ecdb4bb5b9b9000a2db42539" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 33995 } }
I20260807 22:44:28.490540 20420 leader_election.cc:288] T ecec02229da644a38bda3bef74057662 P 5a6d78ab3f5949e2b09fdd7168d1acd3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eb446910cf6470ba0f07a00a299279b (127.22.212.66:44829), d71d3896ecdb4bb5b9b9000a2db42539 (127.22.212.65:33995)
I20260807 22:44:28.494915 20407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:28.490780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:44787 (local address 127.22.212.66:44829)
0807 22:44:28.490857 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:28.490859 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:28.491097 (+ 238us) server_negotiation.cc:407] Connection header received
0807 22:44:28.491171 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:28.491172 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:28.491182 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:28.491234 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:44:28.491399 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:28.492100 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:28.493895 (+ 1795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:28.494501 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:28.494586 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:28.494596 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:28.494800 (+ 204us) server_negotiation.cc:299] Negotiation successful
0807 22:44:28.494840 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 22:44:28.494915 20411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:28.490857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:45065 (local address 127.22.212.65:33995)
0807 22:44:28.491015 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:28.491017 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:28.491025 (+ 8us) server_negotiation.cc:407] Connection header received
0807 22:44:28.491050 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:28.491051 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:28.491059 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:28.491133 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:44:28.491333 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:28.492108 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:28.493895 (+ 1787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:28.494505 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:28.494586 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:28.494596 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:28.494800 (+ 204us) server_negotiation.cc:299] Negotiation successful
0807 22:44:28.494841 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134}
I20260807 22:44:28.495050 20378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:28.490703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:33995 (local address 127.22.212.67:45065)
0807 22:44:28.490747 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:28.490759 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:28.490804 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:28.491156 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:28.491157 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:28.491159 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:44:28.491255 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:28.491257 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:28.492200 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:28.492201 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:28.493779 (+ 1578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:28.493782 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:28.494604 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:28.494605 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:28.494714 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:28.494716 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 22:44:28.494785 (+ 69us) client_negotiation.cc:240] Negotiation successful
0807 22:44:28.494846 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23,"mutex_wait_us":113}
I20260807 22:44:28.495266 20424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:28.490715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.66:44829 (local address 127.22.212.67:44787)
0807 22:44:28.491011 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:28.491023 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:28.491090 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:28.491254 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:28.491255 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:28.491256 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:44:28.491326 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:28.491327 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:28.492200 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:28.492201 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:28.493781 (+ 1580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:28.493783 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:28.494604 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:28.494605 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:28.494706 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:28.494711 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 22:44:28.494785 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 22:44:28.494846 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"mutex_wait_us":179,"thread_start_us":130,"threads_started":1}
I20260807 22:44:28.495497 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecec02229da644a38bda3bef74057662" candidate_uuid: "5a6d78ab3f5949e2b09fdd7168d1acd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d71d3896ecdb4bb5b9b9000a2db42539" is_pre_election: true
I20260807 22:44:28.495679 19884 raft_consensus.cc:2454] T ecec02229da644a38bda3bef74057662 P d71d3896ecdb4bb5b9b9000a2db42539 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a6d78ab3f5949e2b09fdd7168d1acd3 in term 0.
I20260807 22:44:28.495672 20093 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecec02229da644a38bda3bef74057662" candidate_uuid: "5a6d78ab3f5949e2b09fdd7168d1acd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eb446910cf6470ba0f07a00a299279b" is_pre_election: true
I20260807 22:44:28.495862 20093 raft_consensus.cc:2454] T ecec02229da644a38bda3bef74057662 P 4eb446910cf6470ba0f07a00a299279b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a6d78ab3f5949e2b09fdd7168d1acd3 in term 0.
I20260807 22:44:28.495949 20199 leader_election.cc:302] T ecec02229da644a38bda3bef74057662 P 5a6d78ab3f5949e2b09fdd7168d1acd3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a6d78ab3f5949e2b09fdd7168d1acd3, d71d3896ecdb4bb5b9b9000a2db42539; no voters:
I20260807 22:44:28.496073 20420 raft_consensus.cc:2781] T ecec02229da644a38bda3bef74057662 P 5a6d78ab3f5949e2b09fdd7168d1acd3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:44:28.496129 20420 raft_consensus.cc:482] T ecec02229da644a38bda3bef74057662 P 5a6d78ab3f5949e2b09fdd7168d1acd3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:44:28.496152 20420 raft_consensus.cc:3037] T ecec02229da644a38bda3bef74057662 P 5a6d78ab3f5949e2b09fdd7168d1acd3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:44:28.496919 20420 raft_consensus.cc:504] T ecec02229da644a38bda3bef74057662 P 5a6d78ab3f5949e2b09fdd7168d1acd3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a6d78ab3f5949e2b09fdd7168d1acd3" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39223 } } peers { permanent_uuid: "4eb446910cf6470ba0f07a00a299279b" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 44829 } } peers { permanent_uuid: "d71d3896ecdb4bb5b9b9000a2db42539" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 33995 } }
I20260807 22:44:28.497072 20420 leader_election.cc:288] T ecec02229da644a38bda3bef74057662 P 5a6d78ab3f5949e2b09fdd7168d1acd3 [CANDIDATE]: Term 1 election: Requested vote from peers 4eb446910cf6470ba0f07a00a299279b (127.22.212.66:44829), d71d3896ecdb4bb5b9b9000a2db42539 (127.22.212.65:33995)
I20260807 22:44:28.497225 19884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecec02229da644a38bda3bef74057662" candidate_uuid: "5a6d78ab3f5949e2b09fdd7168d1acd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d71d3896ecdb4bb5b9b9000a2db42539"
I20260807 22:44:28.497263 20093 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ecec02229da644a38bda3bef74057662" candidate_uuid: "5a6d78ab3f5949e2b09fdd7168d1acd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eb446910cf6470ba0f07a00a299279b"
I20260807 22:44:28.497303 19884 raft_consensus.cc:3037] T ecec02229da644a38bda3bef74057662 P d71d3896ecdb4bb5b9b9000a2db42539 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:44:28.497357 20093 raft_consensus.cc:3037] T ecec02229da644a38bda3bef74057662 P 4eb446910cf6470ba0f07a00a299279b [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:44:28.498072 19884 raft_consensus.cc:2454] T ecec02229da644a38bda3bef74057662 P d71d3896ecdb4bb5b9b9000a2db42539 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a6d78ab3f5949e2b09fdd7168d1acd3 in term 1.
I20260807 22:44:28.498231 20093 raft_consensus.cc:2454] T ecec02229da644a38bda3bef74057662 P 4eb446910cf6470ba0f07a00a299279b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a6d78ab3f5949e2b09fdd7168d1acd3 in term 1.
I20260807 22:44:28.498258 20199 leader_election.cc:302] T ecec02229da644a38bda3bef74057662 P 5a6d78ab3f5949e2b09fdd7168d1acd3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a6d78ab3f5949e2b09fdd7168d1acd3, d71d3896ecdb4bb5b9b9000a2db42539; no voters:
I20260807 22:44:28.498447 20420 raft_consensus.cc:2781] T ecec02229da644a38bda3bef74057662 P 5a6d78ab3f5949e2b09fdd7168d1acd3 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:44:28.498648 20420 raft_consensus.cc:686] T ecec02229da644a38bda3bef74057662 P 5a6d78ab3f5949e2b09fdd7168d1acd3 [term 1 LEADER]: Becoming Leader. State: Replica: 5a6d78ab3f5949e2b09fdd7168d1acd3, State: Running, Role: LEADER
I20260807 22:44:28.498739 20420 consensus_queue.cc:237] T ecec02229da644a38bda3bef74057662 P 5a6d78ab3f5949e2b09fdd7168d1acd3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a6d78ab3f5949e2b09fdd7168d1acd3" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39223 } } peers { permanent_uuid: "4eb446910cf6470ba0f07a00a299279b" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 44829 } } peers { permanent_uuid: "d71d3896ecdb4bb5b9b9000a2db42539" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 33995 } }
I20260807 22:44:28.499645 19643 catalog_manager.cc:5495] T ecec02229da644a38bda3bef74057662 P 5a6d78ab3f5949e2b09fdd7168d1acd3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a6d78ab3f5949e2b09fdd7168d1acd3 (127.22.212.67). New cstate: current_term: 1 leader_uuid: "5a6d78ab3f5949e2b09fdd7168d1acd3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a6d78ab3f5949e2b09fdd7168d1acd3" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 39223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4eb446910cf6470ba0f07a00a299279b" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 44829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d71d3896ecdb4bb5b9b9000a2db42539" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 33995 } health_report { overall_health: UNKNOWN } } }
I20260807 22:44:28.505643 20406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:28.503445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54282 (local address 127.22.212.67:39223)
0807 22:44:28.503495 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:28.503497 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:28.503519 (+ 22us) server_negotiation.cc:407] Connection header received
0807 22:44:28.503577 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:28.503577 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:28.503593 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:28.503650 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:44:28.503731 (+ 81us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:28.504213 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:28.504945 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:28.505163 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:28.505218 (+ 55us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:28.505334 (+ 116us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:44:28.505413 (+ 79us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:44:28.505484 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:28.505534 (+ 50us) server_negotiation.cc:299] Negotiation successful
0807 22:44:28.505543 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 22:44:28.507278 19884 raft_consensus.cc:1261] T ecec02229da644a38bda3bef74057662 P d71d3896ecdb4bb5b9b9000a2db42539 [term 1 FOLLOWER]: Refusing update from remote peer 5a6d78ab3f5949e2b09fdd7168d1acd3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:44:28.507622 20093 raft_consensus.cc:1261] T ecec02229da644a38bda3bef74057662 P 4eb446910cf6470ba0f07a00a299279b [term 1 FOLLOWER]: Refusing update from remote peer 5a6d78ab3f5949e2b09fdd7168d1acd3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:44:28.507604 20425 consensus_queue.cc:1035] T ecec02229da644a38bda3bef74057662 P 5a6d78ab3f5949e2b09fdd7168d1acd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d71d3896ecdb4bb5b9b9000a2db42539" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 33995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:44:28.507889 20425 consensus_queue.cc:1035] T ecec02229da644a38bda3bef74057662 P 5a6d78ab3f5949e2b09fdd7168d1acd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eb446910cf6470ba0f07a00a299279b" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 44829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:44:28.509989 20429 mvcc.cc:205] Tried to move back new op lower bound from 7316040370203336704 to 7316040370171596800. Current Snapshot: MvccSnapshot[applied={T|T < 7316040370203336704}]
I20260807 22:44:28.510222 20430 mvcc.cc:205] Tried to move back new op lower bound from 7316040370203336704 to 7316040370171596800. Current Snapshot: MvccSnapshot[applied={T|T < 7316040370203336704}]
I20260807 22:44:28.511291 20432 mvcc.cc:205] Tried to move back new op lower bound from 7316040370203336704 to 7316040370171596800. Current Snapshot: MvccSnapshot[applied={T|T < 7316040370203336704}]
I20260807 22:44:28.513163 19638 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39254:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:44:28.513278 19638 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39254:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:44:28.514081 19638 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a2a1b3b8a5ff4526abe9f94ebcfa18aa: Sending DeleteTablet for 3 replicas of tablet ecec02229da644a38bda3bef74057662
I20260807 22:44:28.514380 20261 tablet_service.cc:1514] Processing DeleteTablet for tablet ecec02229da644a38bda3bef74057662 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:44:28 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:54280
I20260807 22:44:28.514410 20057 tablet_service.cc:1514] Processing DeleteTablet for tablet ecec02229da644a38bda3bef74057662 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:44:28 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:46212
I20260807 22:44:28.514626 19855 tablet_service.cc:1514] Processing DeleteTablet for tablet ecec02229da644a38bda3bef74057662 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:44:28 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:53014
I20260807 22:44:28.514856 20446 tablet_replica.cc:330] T ecec02229da644a38bda3bef74057662 P d71d3896ecdb4bb5b9b9000a2db42539: stopping tablet replica
I20260807 22:44:28.514964 20446 raft_consensus.cc:2229] T ecec02229da644a38bda3bef74057662 P d71d3896ecdb4bb5b9b9000a2db42539 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:44:28.515076 20446 raft_consensus.cc:2258] T ecec02229da644a38bda3bef74057662 P d71d3896ecdb4bb5b9b9000a2db42539 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:44:28.515202 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 19749
I20260807 22:44:28.524158 20443 tablet_replica.cc:330] T ecec02229da644a38bda3bef74057662 P 4eb446910cf6470ba0f07a00a299279b: stopping tablet replica
I20260807 22:44:28.524327 20443 raft_consensus.cc:2229] T ecec02229da644a38bda3bef74057662 P 4eb446910cf6470ba0f07a00a299279b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:44:28.524454 20443 raft_consensus.cc:2258] T ecec02229da644a38bda3bef74057662 P 4eb446910cf6470ba0f07a00a299279b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:44:28.524909 20443 ts_tablet_manager.cc:1905] T ecec02229da644a38bda3bef74057662 P 4eb446910cf6470ba0f07a00a299279b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:44:28.526213 20442 tablet_replica.cc:330] T ecec02229da644a38bda3bef74057662 P 5a6d78ab3f5949e2b09fdd7168d1acd3: stopping tablet replica
I20260807 22:44:28.526342 20442 raft_consensus.cc:2229] T ecec02229da644a38bda3bef74057662 P 5a6d78ab3f5949e2b09fdd7168d1acd3 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:44:28.526490 20442 raft_consensus.cc:2258] T ecec02229da644a38bda3bef74057662 P 5a6d78ab3f5949e2b09fdd7168d1acd3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:44:28.526665 20443 ts_tablet_manager.cc:1918] T ecec02229da644a38bda3bef74057662 P 4eb446910cf6470ba0f07a00a299279b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:44:28.526785 20443 log.cc:1196] T ecec02229da644a38bda3bef74057662 P 4eb446910cf6470ba0f07a00a299279b: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-1/wal/wals/ecec02229da644a38bda3bef74057662
I20260807 22:44:28.526962 20442 ts_tablet_manager.cc:1905] T ecec02229da644a38bda3bef74057662 P 5a6d78ab3f5949e2b09fdd7168d1acd3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:44:28.527240 20443 ts_tablet_manager.cc:1939] T ecec02229da644a38bda3bef74057662 P 4eb446910cf6470ba0f07a00a299279b: Deleting consensus metadata
I20260807 22:44:28.527737 19616 catalog_manager.cc:4841] TS 4eb446910cf6470ba0f07a00a299279b (127.22.212.66:44829): tablet ecec02229da644a38bda3bef74057662 (table test-table [id=78405b40c9ce449b97c45a68ae301a9c]) successfully deleted
I20260807 22:44:28.528539 20442 ts_tablet_manager.cc:1918] T ecec02229da644a38bda3bef74057662 P 5a6d78ab3f5949e2b09fdd7168d1acd3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:44:28.528612 20442 log.cc:1196] T ecec02229da644a38bda3bef74057662 P 5a6d78ab3f5949e2b09fdd7168d1acd3: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786142418640232-23377-0/minicluster-data/ts-2/wal/wals/ecec02229da644a38bda3bef74057662
W20260807 22:44:28.528714 19617 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.212.65:33995 (error 108)
I20260807 22:44:28.528924 20442 ts_tablet_manager.cc:1939] T ecec02229da644a38bda3bef74057662 P 5a6d78ab3f5949e2b09fdd7168d1acd3: Deleting consensus metadata
I20260807 22:44:28.529297 20408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:28.529162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:33995 (local address 127.0.0.1:53016)
0807 22:44:28.529214 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:28.529258 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.65:33995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260807 22:44:28.529310 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 19966
I20260807 22:44:28.529336 19617 catalog_manager.cc:4841] TS 5a6d78ab3f5949e2b09fdd7168d1acd3 (127.22.212.67:39223): tablet ecec02229da644a38bda3bef74057662 (table test-table [id=78405b40c9ce449b97c45a68ae301a9c]) successfully deleted
W20260807 22:44:28.529445 19617 catalog_manager.cc:4584] TS d71d3896ecdb4bb5b9b9000a2db42539 (127.22.212.65:33995): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ecec02229da644a38bda3bef74057662: Network error: Client connection negotiation failed: client connection to 127.22.212.65:33995: connect: Connection refused (error 111)
I20260807 22:44:28.545485 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 20169
I20260807 22:44:28.554611 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 19585
2026-08-07T22:44:28Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2224 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-07T22:44:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:44:28Z Disabled control of system clock
I20260807 22:44:28.592741 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:41333
--webserver_interface=127.22.212.126
--webserver_port=0
--builtin_ntp_servers=127.22.212.84:43051
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:41333
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 22:44:28.674487 20453 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:44:28.674763 20453 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:44:28.674800 20453 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:44:28.675941 20453 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:44:28.676013 20453 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:44:28.676034 20453 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:44:28.676054 20453 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:44:28.676070 20453 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:44:28.677476 20453 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:43051
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:41333
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:41333
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20453
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:44:28.677767 20453 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:44:28.678081 20453 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 22:44:28.683111 20453 server_base.cc:1034] running on GCE node
W20260807 22:44:28.683081 20463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:28.683084 20465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:28.683135 20462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:28.683562 20453 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:44:28.683857 20453 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:44:28.685020 20453 hybrid_clock.cc:648] HybridClock initialized: now 1786142668685002 us; error 46 us; skew 500 ppm
I20260807 22:44:28.686230 20453 webserver.cc:460] Webserver started at http://127.22.212.126:45447/ using document root <none> and password file <none>
I20260807 22:44:28.686513 20453 fs_manager.cc:359] Metadata directory not provided
I20260807 22:44:28.686585 20453 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:44:28.686750 20453 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:44:28.687814 20453 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "54beca5207284cb09f8f555d9d3d4945"
format_stamp: "Formatted at 2026-08-07 22:44:28 on dist-test-slave-2d19"
server_key: "7140ac48fefc669c3008fa6d236906ce"
server_key_iv: "5e508a3e89dee84ff8f059b38f3a13a2"
server_key_version: "encryptionkey@0"
I20260807 22:44:28.688185 20453 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "54beca5207284cb09f8f555d9d3d4945"
format_stamp: "Formatted at 2026-08-07 22:44:28 on dist-test-slave-2d19"
server_key: "7140ac48fefc669c3008fa6d236906ce"
server_key_iv: "5e508a3e89dee84ff8f059b38f3a13a2"
server_key_version: "encryptionkey@0"
I20260807 22:44:28.689520 20453 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 22:44:28.690222 20476 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:28.690388 20453 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 22:44:28.690507 20453 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "54beca5207284cb09f8f555d9d3d4945"
format_stamp: "Formatted at 2026-08-07 22:44:28 on dist-test-slave-2d19"
server_key: "7140ac48fefc669c3008fa6d236906ce"
server_key_iv: "5e508a3e89dee84ff8f059b38f3a13a2"
server_key_version: "encryptionkey@0"
I20260807 22:44:28.690582 20453 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:44:28.701815 20453 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:44:28.702116 20453 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:44:28.702262 20453 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:44:28.706235 20453 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:41333
I20260807 22:44:28.706274 20550 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:41333 every 8 connection(s)
I20260807 22:44:28.706630 20453 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:44:28.707167 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 20453
I20260807 22:44:28.707299 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:44:28.707551 23377 external_mini_cluster.cc:1428] Setting key 5b6a8662d4d64cb61a22d04709432ce4
I20260807 22:44:28.708036 20552 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:44:28.711622 20552 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54beca5207284cb09f8f555d9d3d4945: Bootstrap starting.
I20260807 22:44:28.712366 20552 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 54beca5207284cb09f8f555d9d3d4945: Neither blocks nor log segments found. Creating new log.
I20260807 22:44:28.712714 20552 log.cc:824] T 00000000000000000000000000000000 P 54beca5207284cb09f8f555d9d3d4945: Log is configured to *not* fsync() on all Append() calls
I20260807 22:44:28.713662 20552 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54beca5207284cb09f8f555d9d3d4945: No bootstrap required, opened a new log
I20260807 22:44:28.713729 20556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:28.708117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50008 (local address 127.22.212.126:41333)
0807 22:44:28.708373 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:28.708380 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:28.708405 (+ 25us) server_negotiation.cc:407] Connection header received
0807 22:44:28.708831 (+ 426us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:28.708837 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:28.708894 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:28.709004 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:28.709273 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:28.710145 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:28.711319 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:28.711701 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:28.711841 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:28.712797 (+ 956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:28.712802 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:28.712802 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:44:28.713040 (+ 238us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:28.713077 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:44:28.713089 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:28.713148 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:28.713279 (+ 131us) server_negotiation.cc:299] Negotiation successful
0807 22:44:28.713370 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":101,"threads_started":1}
I20260807 22:44:28.715912 20552 raft_consensus.cc:348] T 00000000000000000000000000000000 P 54beca5207284cb09f8f555d9d3d4945 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54beca5207284cb09f8f555d9d3d4945" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 41333 } }
I20260807 22:44:28.716084 20552 raft_consensus.cc:374] T 00000000000000000000000000000000 P 54beca5207284cb09f8f555d9d3d4945 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:44:28.716110 20552 raft_consensus.cc:729] T 00000000000000000000000000000000 P 54beca5207284cb09f8f555d9d3d4945 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54beca5207284cb09f8f555d9d3d4945, State: Initialized, Role: FOLLOWER
I20260807 22:44:28.716235 20552 consensus_queue.cc:260] T 00000000000000000000000000000000 P 54beca5207284cb09f8f555d9d3d4945 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54beca5207284cb09f8f555d9d3d4945" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 41333 } }
I20260807 22:44:28.716349 20552 raft_consensus.cc:388] T 00000000000000000000000000000000 P 54beca5207284cb09f8f555d9d3d4945 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:44:28.716377 20552 raft_consensus.cc:482] T 00000000000000000000000000000000 P 54beca5207284cb09f8f555d9d3d4945 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:44:28.716413 20552 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 54beca5207284cb09f8f555d9d3d4945 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:44:28.716964 20552 raft_consensus.cc:504] T 00000000000000000000000000000000 P 54beca5207284cb09f8f555d9d3d4945 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54beca5207284cb09f8f555d9d3d4945" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 41333 } }
I20260807 22:44:28.717059 20552 leader_election.cc:302] T 00000000000000000000000000000000 P 54beca5207284cb09f8f555d9d3d4945 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 54beca5207284cb09f8f555d9d3d4945; no voters:
I20260807 22:44:28.717203 20552 leader_election.cc:288] T 00000000000000000000000000000000 P 54beca5207284cb09f8f555d9d3d4945 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:44:28.717264 20559 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 54beca5207284cb09f8f555d9d3d4945 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:44:28.717406 20559 raft_consensus.cc:686] T 00000000000000000000000000000000 P 54beca5207284cb09f8f555d9d3d4945 [term 1 LEADER]: Becoming Leader. State: Replica: 54beca5207284cb09f8f555d9d3d4945, State: Running, Role: LEADER
I20260807 22:44:28.717486 20552 sys_catalog.cc:564] T 00000000000000000000000000000000 P 54beca5207284cb09f8f555d9d3d4945 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:44:28.717551 20559 consensus_queue.cc:237] T 00000000000000000000000000000000 P 54beca5207284cb09f8f555d9d3d4945 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54beca5207284cb09f8f555d9d3d4945" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 41333 } }
I20260807 22:44:28.717912 20560 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54beca5207284cb09f8f555d9d3d4945 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "54beca5207284cb09f8f555d9d3d4945" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54beca5207284cb09f8f555d9d3d4945" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 41333 } } }
I20260807 22:44:28.718029 20560 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54beca5207284cb09f8f555d9d3d4945 [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:28.717914 20561 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54beca5207284cb09f8f555d9d3d4945 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 54beca5207284cb09f8f555d9d3d4945. Latest consensus state: current_term: 1 leader_uuid: "54beca5207284cb09f8f555d9d3d4945" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54beca5207284cb09f8f555d9d3d4945" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 41333 } } }
I20260807 22:44:28.718153 20561 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54beca5207284cb09f8f555d9d3d4945 [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:28.718302 20569 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:44:28.718801 20569 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:44:28.720417 20569 catalog_manager.cc:1347] Generated new cluster ID: 8d03a733984e42649f24a012f66ee155
I20260807 22:44:28.720484 20569 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:44:28.729898 20569 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:44:28.730370 20569 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:44:28.735499 20569 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 54beca5207284cb09f8f555d9d3d4945: Generated new TSK 0
I20260807 22:44:28.735662 20569 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:44:28.740813 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.65:0
--local_ip_for_outbound_sockets=127.22.212.65
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:41333
--builtin_ntp_servers=127.22.212.84:43051
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 22:44:28.826053 20592 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:44:28.826249 20592 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:44:28.826272 20592 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:44:28.827435 20592 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:44:28.827479 20592 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:44:28.827507 20592 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.65
I20260807 22:44:28.828900 20592 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:43051
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:41333
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20592
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.65
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:44:28.829146 20592 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:44:28.829450 20592 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:44:28.834586 20605 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:28.834609 20609 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:28.834586 20607 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:28.834802 20592 server_base.cc:1034] running on GCE node
I20260807 22:44:28.835031 20592 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:44:28.835304 20592 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:44:28.836524 20592 hybrid_clock.cc:648] HybridClock initialized: now 1786142668836505 us; error 30 us; skew 500 ppm
I20260807 22:44:28.837905 20592 webserver.cc:460] Webserver started at http://127.22.212.65:36685/ using document root <none> and password file <none>
I20260807 22:44:28.838202 20592 fs_manager.cc:359] Metadata directory not provided
I20260807 22:44:28.838274 20592 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:44:28.838418 20592 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:44:28.839527 20592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-0/data/instance:
uuid: "c61792f057504c7f8d951ef537999f1c"
format_stamp: "Formatted at 2026-08-07 22:44:28 on dist-test-slave-2d19"
server_key: "34a2e0b1669db39a5f7d0a7fb5275107"
server_key_iv: "4b4795829edaa505a8875615e0b6ab47"
server_key_version: "encryptionkey@0"
I20260807 22:44:28.839900 20592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance:
uuid: "c61792f057504c7f8d951ef537999f1c"
format_stamp: "Formatted at 2026-08-07 22:44:28 on dist-test-slave-2d19"
server_key: "34a2e0b1669db39a5f7d0a7fb5275107"
server_key_iv: "4b4795829edaa505a8875615e0b6ab47"
server_key_version: "encryptionkey@0"
I20260807 22:44:28.841408 20592 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 22:44:28.842245 20624 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:28.842427 20592 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 22:44:28.842537 20592 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-0/wal
uuid: "c61792f057504c7f8d951ef537999f1c"
format_stamp: "Formatted at 2026-08-07 22:44:28 on dist-test-slave-2d19"
server_key: "34a2e0b1669db39a5f7d0a7fb5275107"
server_key_iv: "4b4795829edaa505a8875615e0b6ab47"
server_key_version: "encryptionkey@0"
I20260807 22:44:28.842626 20592 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:44:28.856645 20592 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:44:28.856964 20592 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:44:28.857111 20592 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:44:28.857354 20592 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:44:28.857692 20592 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:44:28.857745 20592 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:28.857786 20592 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:44:28.857815 20592 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:28.863750 20592 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.65:44749
I20260807 22:44:28.863793 20819 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.65:44749 every 8 connection(s)
I20260807 22:44:28.864183 20592 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
I20260807 22:44:28.866591 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 20592
I20260807 22:44:28.866707 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance
I20260807 22:44:28.866904 23377 external_mini_cluster.cc:1428] Setting key 1e88ca9b4cb799b0755720559f0d7b2d
I20260807 22:44:28.867835 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.66:0
--local_ip_for_outbound_sockets=127.22.212.66
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:41333
--builtin_ntp_servers=127.22.212.84:43051
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 22:44:28.869784 20556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:28.864964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:58057 (local address 127.22.212.126:41333)
0807 22:44:28.865058 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:28.865060 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:28.865269 (+ 209us) server_negotiation.cc:407] Connection header received
0807 22:44:28.865828 (+ 559us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:28.865829 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:28.865847 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:28.865904 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:28.866614 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:28.867268 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:28.868278 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:28.868497 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:28.868570 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:28.869505 (+ 935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:28.869507 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:28.869507 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:44:28.869513 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:28.869533 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:44:28.869539 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:28.869602 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:28.869701 (+ 99us) server_negotiation.cc:299] Negotiation successful
0807 22:44:28.869726 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 22:44:28.870076 20823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:28.864934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:41333 (local address 127.22.212.65:58057)
0807 22:44:28.865134 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:28.865174 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:28.865716 (+ 542us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:28.865974 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:28.865978 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:28.865988 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:44:28.866503 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:28.866508 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:28.867351 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:28.867352 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:28.868162 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:28.868165 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:28.868591 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:28.868592 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:28.868727 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:28.869304 (+ 577us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:44:28.869305 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:44:28.869359 (+ 54us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:44:28.869398 (+ 39us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:44:28.869614 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:44:28.869621 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:44:28.869624 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:44:28.869705 (+ 81us) client_negotiation.cc:240] Negotiation successful
0807 22:44:28.869823 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":73,"threads_started":1}
I20260807 22:44:28.870579 20820 heartbeater.cc:347] Connected to a master server at 127.22.212.126:41333
I20260807 22:44:28.870699 20820 heartbeater.cc:464] Registering TS with master...
I20260807 22:44:28.870908 20820 heartbeater.cc:511] Master 127.22.212.126:41333 requested a full tablet report, sending...
I20260807 22:44:28.871418 20505 ts_manager.cc:194] Registered new tserver with Master: c61792f057504c7f8d951ef537999f1c (127.22.212.65:44749)
I20260807 22:44:28.872088 20505 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.212.65:58057
W20260807 22:44:28.954070 20825 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:44:28.954282 20825 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:44:28.954304 20825 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:44:28.955550 20825 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:44:28.955595 20825 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:44:28.955621 20825 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.66
I20260807 22:44:28.957028 20825 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:43051
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:41333
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20825
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.66
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:44:28.957283 20825 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:44:28.957580 20825 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:44:28.962809 20833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:28.962824 20832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:28.962821 20837 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:28.962913 20825 server_base.cc:1034] running on GCE node
I20260807 22:44:28.963253 20825 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:44:28.963490 20825 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:44:28.964677 20825 hybrid_clock.cc:648] HybridClock initialized: now 1786142668964666 us; error 36 us; skew 500 ppm
I20260807 22:44:28.966095 20825 webserver.cc:460] Webserver started at http://127.22.212.66:46281/ using document root <none> and password file <none>
I20260807 22:44:28.966361 20825 fs_manager.cc:359] Metadata directory not provided
I20260807 22:44:28.966434 20825 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:44:28.966583 20825 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:44:28.967685 20825 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-1/data/instance:
uuid: "2a6fc7c1e1064880bcb73c2175e645ee"
format_stamp: "Formatted at 2026-08-07 22:44:28 on dist-test-slave-2d19"
server_key: "83761da9706c33dcb7c9fd0448989778"
server_key_iv: "35f683decad98d2298c7de3187496e69"
server_key_version: "encryptionkey@0"
I20260807 22:44:28.968060 20825 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance:
uuid: "2a6fc7c1e1064880bcb73c2175e645ee"
format_stamp: "Formatted at 2026-08-07 22:44:28 on dist-test-slave-2d19"
server_key: "83761da9706c33dcb7c9fd0448989778"
server_key_iv: "35f683decad98d2298c7de3187496e69"
server_key_version: "encryptionkey@0"
I20260807 22:44:28.969494 20825 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:44:28.970259 20848 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:28.970443 20825 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 22:44:28.970548 20825 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-1/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-1/wal
uuid: "2a6fc7c1e1064880bcb73c2175e645ee"
format_stamp: "Formatted at 2026-08-07 22:44:28 on dist-test-slave-2d19"
server_key: "83761da9706c33dcb7c9fd0448989778"
server_key_iv: "35f683decad98d2298c7de3187496e69"
server_key_version: "encryptionkey@0"
I20260807 22:44:28.970625 20825 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:44:28.991190 20825 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:44:28.991554 20825 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:44:28.991714 20825 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:44:28.992058 20825 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:44:28.992471 20825 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:44:28.992525 20825 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:28.992573 20825 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:44:28.992615 20825 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:28.998724 20825 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.66:33113
I20260807 22:44:28.998780 21041 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.66:33113 every 8 connection(s)
I20260807 22:44:28.999135 20825 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
I20260807 22:44:29.004377 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 20825
I20260807 22:44:29.004500 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance
I20260807 22:44:29.004594 20556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:28.999923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:59541 (local address 127.22.212.126:41333)
0807 22:44:28.999990 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:28.999992 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:29.000224 (+ 232us) server_negotiation.cc:407] Connection header received
0807 22:44:29.000770 (+ 546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:29.000772 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:29.000784 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:29.000847 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:29.001559 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:29.002054 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:29.003043 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:29.003228 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:29.003287 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:29.004205 (+ 918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:29.004206 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:29.004207 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:44:29.004212 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:29.004232 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:44:29.004237 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:29.004325 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:29.004469 (+ 144us) server_negotiation.cc:299] Negotiation successful
0807 22:44:29.004500 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 22:44:29.004709 23377 external_mini_cluster.cc:1428] Setting key a95c37835a4619f69de3d72e62b2bd52
I20260807 22:44:29.004865 21047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:28.999925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:41333 (local address 127.22.212.66:59541)
0807 22:44:29.000100 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:29.000135 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:29.000645 (+ 510us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:29.000926 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:29.000929 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:29.000938 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:44:29.001445 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:29.001448 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:29.002137 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:29.002138 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:29.002954 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:29.002956 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:29.003302 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:29.003303 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:29.003411 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:29.004011 (+ 600us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:44:29.004011 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:44:29.004042 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:44:29.004065 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:44:29.004354 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:44:29.004366 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:44:29.004370 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 22:44:29.004458 (+ 88us) client_negotiation.cc:240] Negotiation successful
0807 22:44:29.004598 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":66,"threads_started":1}
I20260807 22:44:29.005393 21043 heartbeater.cc:347] Connected to a master server at 127.22.212.126:41333
I20260807 22:44:29.005501 21043 heartbeater.cc:464] Registering TS with master...
I20260807 22:44:29.005690 21043 heartbeater.cc:511] Master 127.22.212.126:41333 requested a full tablet report, sending...
I20260807 22:44:29.005750 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.67:0
--local_ip_for_outbound_sockets=127.22.212.67
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:41333
--builtin_ntp_servers=127.22.212.84:43051
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 22:44:29.006072 20505 ts_manager.cc:194] Registered new tserver with Master: 2a6fc7c1e1064880bcb73c2175e645ee (127.22.212.66:33113)
I20260807 22:44:29.006471 20505 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.212.66:59541
W20260807 22:44:29.089174 21048 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:44:29.089385 21048 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:44:29.089408 21048 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:44:29.090605 21048 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:44:29.090649 21048 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:44:29.090674 21048 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.67
I20260807 22:44:29.092114 21048 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:43051
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:41333
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21048
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.67
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:44:29.092394 21048 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:44:29.092768 21048 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:44:29.097841 21058 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:29.098090 21048 server_base.cc:1034] running on GCE node
W20260807 22:44:29.097854 21063 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:29.097841 21057 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:29.098469 21048 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:44:29.098730 21048 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:44:29.099885 21048 hybrid_clock.cc:648] HybridClock initialized: now 1786142669099873 us; error 44 us; skew 500 ppm
I20260807 22:44:29.101208 21048 webserver.cc:460] Webserver started at http://127.22.212.67:33241/ using document root <none> and password file <none>
I20260807 22:44:29.101504 21048 fs_manager.cc:359] Metadata directory not provided
I20260807 22:44:29.101572 21048 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:44:29.101722 21048 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:44:29.102810 21048 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-2/data/instance:
uuid: "984da16a93564eceaa3241c97cac0df2"
format_stamp: "Formatted at 2026-08-07 22:44:29 on dist-test-slave-2d19"
server_key: "fdc7103ca43a456c4b25c3cd82d66926"
server_key_iv: "ae71e3af1ea04c433536a10c87b9ccf8"
server_key_version: "encryptionkey@0"
I20260807 22:44:29.103175 21048 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance:
uuid: "984da16a93564eceaa3241c97cac0df2"
format_stamp: "Formatted at 2026-08-07 22:44:29 on dist-test-slave-2d19"
server_key: "fdc7103ca43a456c4b25c3cd82d66926"
server_key_iv: "ae71e3af1ea04c433536a10c87b9ccf8"
server_key_version: "encryptionkey@0"
I20260807 22:44:29.104632 21048 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 22:44:29.105352 21072 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:29.105520 21048 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 22:44:29.105620 21048 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-2/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-2/wal
uuid: "984da16a93564eceaa3241c97cac0df2"
format_stamp: "Formatted at 2026-08-07 22:44:29 on dist-test-slave-2d19"
server_key: "fdc7103ca43a456c4b25c3cd82d66926"
server_key_iv: "ae71e3af1ea04c433536a10c87b9ccf8"
server_key_version: "encryptionkey@0"
I20260807 22:44:29.105690 21048 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:44:29.122836 21048 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:44:29.123150 21048 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:44:29.123299 21048 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:44:29.123533 21048 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:44:29.123862 21048 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:44:29.123911 21048 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:29.123952 21048 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:44:29.123981 21048 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:29.129734 21048 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.67:42385
I20260807 22:44:29.129776 21246 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.67:42385 every 8 connection(s)
I20260807 22:44:29.130107 21048 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
I20260807 22:44:29.131748 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 21048
I20260807 22:44:29.131842 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance
I20260807 22:44:29.132042 23377 external_mini_cluster.cc:1428] Setting key d7ed3a168e106f46610fe9e7a8fc430c
I20260807 22:44:29.135602 20556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:29.130822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:60791 (local address 127.22.212.126:41333)
0807 22:44:29.130887 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:29.130889 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:29.131088 (+ 199us) server_negotiation.cc:407] Connection header received
0807 22:44:29.131650 (+ 562us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:29.131651 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:29.131662 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:29.131716 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:29.132707 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:29.133357 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:29.134323 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:29.134505 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:29.134560 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:29.135340 (+ 780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:29.135341 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:29.135341 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:44:29.135346 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:29.135359 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:44:29.135363 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:29.135442 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:29.135514 (+ 72us) server_negotiation.cc:299] Negotiation successful
0807 22:44:29.135535 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 22:44:29.135782 21252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:29.130789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:41333 (local address 127.22.212.67:60791)
0807 22:44:29.130968 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:29.131004 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:29.131521 (+ 517us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:29.131801 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:29.131805 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:29.131817 (+ 12us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:44:29.132596 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:29.132605 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:29.133436 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:29.133437 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:29.134241 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:29.134244 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:29.134576 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:29.134577 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:29.134686 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:29.135165 (+ 479us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:44:29.135165 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:44:29.135194 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:44:29.135216 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:44:29.135455 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:44:29.135459 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:44:29.135462 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:44:29.135514 (+ 52us) client_negotiation.cc:240] Negotiation successful
0807 22:44:29.135593 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":74,"threads_started":1}
I20260807 22:44:29.136281 21247 heartbeater.cc:347] Connected to a master server at 127.22.212.126:41333
I20260807 22:44:29.136392 21247 heartbeater.cc:464] Registering TS with master...
I20260807 22:44:29.136575 21247 heartbeater.cc:511] Master 127.22.212.126:41333 requested a full tablet report, sending...
I20260807 22:44:29.136955 20505 ts_manager.cc:194] Registered new tserver with Master: 984da16a93564eceaa3241c97cac0df2 (127.22.212.67:42385)
I20260807 22:44:29.137315 20505 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.212.67:60791
I20260807 22:44:29.143810 23377 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:44:29.148201 20556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:29.145321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50020 (local address 127.22.212.126:41333)
0807 22:44:29.145375 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:29.145377 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:29.145513 (+ 136us) server_negotiation.cc:407] Connection header received
0807 22:44:29.145557 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:29.145558 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:29.145567 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:29.145642 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:29.145791 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:29.146268 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:29.147014 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:29.147188 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:29.147240 (+ 52us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:29.147865 (+ 625us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:29.147867 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:29.147867 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:44:29.147871 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:29.147886 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:44:29.147890 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:29.147995 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:29.148125 (+ 130us) server_negotiation.cc:299] Negotiation successful
0807 22:44:29.148136 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260807 22:44:29.149667 20505 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50020:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:44:29.151312 20505 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:44:29.158083 21261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:29.153624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.67:42385 (local address 127.0.0.1:47462)
0807 22:44:29.154313 (+ 689us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:29.154325 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:29.154381 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:29.154661 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:29.154664 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:29.154667 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:44:29.154736 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:29.154738 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:29.155682 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:29.155683 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:29.156842 (+ 1159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:29.156845 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:29.157761 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:29.157762 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:29.157838 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:29.157855 (+ 17us) client_negotiation.cc:769] Sending connection context
0807 22:44:29.157932 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 22:44:29.157992 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":669,"thread_start_us":103,"threads_started":1}
I20260807 22:44:29.158180 21266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:29.154038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48700 (local address 127.22.212.65:44749)
0807 22:44:29.154498 (+ 460us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:29.154502 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:29.154511 (+ 9us) server_negotiation.cc:407] Connection header received
0807 22:44:29.154549 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:29.154551 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:29.154565 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:29.154673 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:44:29.154832 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:29.156013 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:29.157287 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:29.157821 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:29.157896 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:29.157986 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:29.158053 (+ 67us) server_negotiation.cc:299] Negotiation successful
0807 22:44:29.158088 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":223,"thread_start_us":88,"threads_started":1}
I20260807 22:44:29.158281 21267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:29.153869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47462 (local address 127.22.212.67:42385)
0807 22:44:29.154384 (+ 515us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:29.154389 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:29.154434 (+ 45us) server_negotiation.cc:407] Connection header received
0807 22:44:29.154477 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:29.154480 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:29.154497 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:29.154574 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:44:29.154799 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:29.155584 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:29.156932 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:29.157664 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:29.157744 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:29.157839 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:29.158148 (+ 309us) server_negotiation.cc:299] Negotiation successful
0807 22:44:29.158187 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":306,"thread_start_us":270,"threads_started":1}
I20260807 22:44:29.158473 21259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:29.153788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:44749 (local address 127.0.0.1:48700)
0807 22:44:29.154315 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:29.154352 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:29.154397 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:29.154676 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:29.154678 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:29.154680 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:44:29.154742 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:29.154744 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:29.156114 (+ 1370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:29.156115 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:29.157207 (+ 1092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:29.157209 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:29.157902 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:29.157904 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:29.157974 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:29.157978 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 22:44:29.158036 (+ 58us) client_negotiation.cc:240] Negotiation successful
0807 22:44:29.158085 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"mutex_wait_us":22,"thread_start_us":64,"threads_started":1}
I20260807 22:44:29.158597 21262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:29.153669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59962 (local address 127.22.212.66:33113)
0807 22:44:29.154552 (+ 883us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:29.154558 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:29.154568 (+ 10us) server_negotiation.cc:407] Connection header received
0807 22:44:29.154611 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:29.154613 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:29.154631 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:29.154842 (+ 211us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:44:29.154906 (+ 64us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:29.156033 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:29.157199 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:29.157889 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:29.158262 (+ 373us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:29.158419 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:29.158446 (+ 27us) server_negotiation.cc:299] Negotiation successful
0807 22:44:29.158484 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":836,"thread_start_us":99,"threads_started":1}
I20260807 22:44:29.158190 21263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:29.153579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.66:33113 (local address 127.0.0.1:59962)
0807 22:44:29.153913 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:29.153957 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:29.154060 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:29.154731 (+ 671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:29.154732 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:29.154734 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:44:29.154766 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:29.154767 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:29.156136 (+ 1369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:29.156137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:29.157096 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:29.157099 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:29.157979 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:29.157979 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:29.158052 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:29.158055 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:44:29.158083 (+ 28us) client_negotiation.cc:240] Negotiation successful
0807 22:44:29.158119 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":62,"threads_started":1}
I20260807 22:44:29.159300 21147 tablet_service.cc:1467] Processing CreateTablet for tablet 77d807ccb6124f9b8b27a60271711e87 (DEFAULT_TABLE table=test-table [id=8ad142d5b8454e33bbd704fa3157a1a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:44:29.159375 20937 tablet_service.cc:1467] Processing CreateTablet for tablet 77d807ccb6124f9b8b27a60271711e87 (DEFAULT_TABLE table=test-table [id=8ad142d5b8454e33bbd704fa3157a1a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:44:29.159354 20708 tablet_service.cc:1467] Processing CreateTablet for tablet 77d807ccb6124f9b8b27a60271711e87 (DEFAULT_TABLE table=test-table [id=8ad142d5b8454e33bbd704fa3157a1a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:44:29.159716 21147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77d807ccb6124f9b8b27a60271711e87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:44:29.159719 20708 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77d807ccb6124f9b8b27a60271711e87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:44:29.159719 20937 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77d807ccb6124f9b8b27a60271711e87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:44:29.162338 21268 tablet_bootstrap.cc:492] T 77d807ccb6124f9b8b27a60271711e87 P 984da16a93564eceaa3241c97cac0df2: Bootstrap starting.
I20260807 22:44:29.163030 21268 tablet_bootstrap.cc:654] T 77d807ccb6124f9b8b27a60271711e87 P 984da16a93564eceaa3241c97cac0df2: Neither blocks nor log segments found. Creating new log.
I20260807 22:44:29.163127 21270 tablet_bootstrap.cc:492] T 77d807ccb6124f9b8b27a60271711e87 P 2a6fc7c1e1064880bcb73c2175e645ee: Bootstrap starting.
I20260807 22:44:29.163379 21269 tablet_bootstrap.cc:492] T 77d807ccb6124f9b8b27a60271711e87 P c61792f057504c7f8d951ef537999f1c: Bootstrap starting.
I20260807 22:44:29.163594 21268 log.cc:824] T 77d807ccb6124f9b8b27a60271711e87 P 984da16a93564eceaa3241c97cac0df2: Log is configured to *not* fsync() on all Append() calls
I20260807 22:44:29.163771 21270 tablet_bootstrap.cc:654] T 77d807ccb6124f9b8b27a60271711e87 P 2a6fc7c1e1064880bcb73c2175e645ee: Neither blocks nor log segments found. Creating new log.
I20260807 22:44:29.164057 21270 log.cc:824] T 77d807ccb6124f9b8b27a60271711e87 P 2a6fc7c1e1064880bcb73c2175e645ee: Log is configured to *not* fsync() on all Append() calls
I20260807 22:44:29.164070 21269 tablet_bootstrap.cc:654] T 77d807ccb6124f9b8b27a60271711e87 P c61792f057504c7f8d951ef537999f1c: Neither blocks nor log segments found. Creating new log.
I20260807 22:44:29.164429 21269 log.cc:824] T 77d807ccb6124f9b8b27a60271711e87 P c61792f057504c7f8d951ef537999f1c: Log is configured to *not* fsync() on all Append() calls
I20260807 22:44:29.164558 21268 tablet_bootstrap.cc:492] T 77d807ccb6124f9b8b27a60271711e87 P 984da16a93564eceaa3241c97cac0df2: No bootstrap required, opened a new log
I20260807 22:44:29.164637 21268 ts_tablet_manager.cc:1397] T 77d807ccb6124f9b8b27a60271711e87 P 984da16a93564eceaa3241c97cac0df2: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 22:44:29.164861 21270 tablet_bootstrap.cc:492] T 77d807ccb6124f9b8b27a60271711e87 P 2a6fc7c1e1064880bcb73c2175e645ee: No bootstrap required, opened a new log
I20260807 22:44:29.164940 21270 ts_tablet_manager.cc:1397] T 77d807ccb6124f9b8b27a60271711e87 P 2a6fc7c1e1064880bcb73c2175e645ee: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260807 22:44:29.165174 21269 tablet_bootstrap.cc:492] T 77d807ccb6124f9b8b27a60271711e87 P c61792f057504c7f8d951ef537999f1c: No bootstrap required, opened a new log
I20260807 22:44:29.165257 21269 ts_tablet_manager.cc:1397] T 77d807ccb6124f9b8b27a60271711e87 P c61792f057504c7f8d951ef537999f1c: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260807 22:44:29.167305 21268 raft_consensus.cc:348] T 77d807ccb6124f9b8b27a60271711e87 P 984da16a93564eceaa3241c97cac0df2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a6fc7c1e1064880bcb73c2175e645ee" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 33113 } } peers { permanent_uuid: "c61792f057504c7f8d951ef537999f1c" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 44749 } } peers { permanent_uuid: "984da16a93564eceaa3241c97cac0df2" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42385 } }
I20260807 22:44:29.167377 21269 raft_consensus.cc:348] T 77d807ccb6124f9b8b27a60271711e87 P c61792f057504c7f8d951ef537999f1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a6fc7c1e1064880bcb73c2175e645ee" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 33113 } } peers { permanent_uuid: "c61792f057504c7f8d951ef537999f1c" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 44749 } } peers { permanent_uuid: "984da16a93564eceaa3241c97cac0df2" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42385 } }
I20260807 22:44:29.167500 21268 raft_consensus.cc:374] T 77d807ccb6124f9b8b27a60271711e87 P 984da16a93564eceaa3241c97cac0df2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:44:29.167517 21269 raft_consensus.cc:374] T 77d807ccb6124f9b8b27a60271711e87 P c61792f057504c7f8d951ef537999f1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:44:29.167544 21268 raft_consensus.cc:729] T 77d807ccb6124f9b8b27a60271711e87 P 984da16a93564eceaa3241c97cac0df2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 984da16a93564eceaa3241c97cac0df2, State: Initialized, Role: FOLLOWER
I20260807 22:44:29.167572 21269 raft_consensus.cc:729] T 77d807ccb6124f9b8b27a60271711e87 P c61792f057504c7f8d951ef537999f1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c61792f057504c7f8d951ef537999f1c, State: Initialized, Role: FOLLOWER
I20260807 22:44:29.167524 21270 raft_consensus.cc:348] T 77d807ccb6124f9b8b27a60271711e87 P 2a6fc7c1e1064880bcb73c2175e645ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a6fc7c1e1064880bcb73c2175e645ee" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 33113 } } peers { permanent_uuid: "c61792f057504c7f8d951ef537999f1c" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 44749 } } peers { permanent_uuid: "984da16a93564eceaa3241c97cac0df2" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42385 } }
I20260807 22:44:29.167665 21270 raft_consensus.cc:374] T 77d807ccb6124f9b8b27a60271711e87 P 2a6fc7c1e1064880bcb73c2175e645ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:44:29.167701 21270 raft_consensus.cc:729] T 77d807ccb6124f9b8b27a60271711e87 P 2a6fc7c1e1064880bcb73c2175e645ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a6fc7c1e1064880bcb73c2175e645ee, State: Initialized, Role: FOLLOWER
I20260807 22:44:29.167683 21268 consensus_queue.cc:260] T 77d807ccb6124f9b8b27a60271711e87 P 984da16a93564eceaa3241c97cac0df2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a6fc7c1e1064880bcb73c2175e645ee" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 33113 } } peers { permanent_uuid: "c61792f057504c7f8d951ef537999f1c" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 44749 } } peers { permanent_uuid: "984da16a93564eceaa3241c97cac0df2" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42385 } }
I20260807 22:44:29.167681 21269 consensus_queue.cc:260] T 77d807ccb6124f9b8b27a60271711e87 P c61792f057504c7f8d951ef537999f1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a6fc7c1e1064880bcb73c2175e645ee" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 33113 } } peers { permanent_uuid: "c61792f057504c7f8d951ef537999f1c" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 44749 } } peers { permanent_uuid: "984da16a93564eceaa3241c97cac0df2" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42385 } }
I20260807 22:44:29.167825 21270 consensus_queue.cc:260] T 77d807ccb6124f9b8b27a60271711e87 P 2a6fc7c1e1064880bcb73c2175e645ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a6fc7c1e1064880bcb73c2175e645ee" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 33113 } } peers { permanent_uuid: "c61792f057504c7f8d951ef537999f1c" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 44749 } } peers { permanent_uuid: "984da16a93564eceaa3241c97cac0df2" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42385 } }
I20260807 22:44:29.167985 21268 ts_tablet_manager.cc:1428] T 77d807ccb6124f9b8b27a60271711e87 P 984da16a93564eceaa3241c97cac0df2: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 22:44:29.167999 21269 ts_tablet_manager.cc:1428] T 77d807ccb6124f9b8b27a60271711e87 P c61792f057504c7f8d951ef537999f1c: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260807 22:44:29.168080 21270 ts_tablet_manager.cc:1428] T 77d807ccb6124f9b8b27a60271711e87 P 2a6fc7c1e1064880bcb73c2175e645ee: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260807 22:44:29.168126 21247 heartbeater.cc:503] Master 127.22.212.126:41333 was elected leader, sending a full tablet report...
I20260807 22:44:29.168210 21043 heartbeater.cc:503] Master 127.22.212.126:41333 was elected leader, sending a full tablet report...
I20260807 22:44:29.168440 20820 heartbeater.cc:503] Master 127.22.212.126:41333 was elected leader, sending a full tablet report...
W20260807 22:44:29.249696 21044 tablet.cc:2369] T 77d807ccb6124f9b8b27a60271711e87 P 2a6fc7c1e1064880bcb73c2175e645ee: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:44:29.310546 21279 raft_consensus.cc:482] T 77d807ccb6124f9b8b27a60271711e87 P 2a6fc7c1e1064880bcb73c2175e645ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:44:29.310675 21279 raft_consensus.cc:504] T 77d807ccb6124f9b8b27a60271711e87 P 2a6fc7c1e1064880bcb73c2175e645ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a6fc7c1e1064880bcb73c2175e645ee" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 33113 } } peers { permanent_uuid: "c61792f057504c7f8d951ef537999f1c" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 44749 } } peers { permanent_uuid: "984da16a93564eceaa3241c97cac0df2" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42385 } }
I20260807 22:44:29.311090 21279 leader_election.cc:288] T 77d807ccb6124f9b8b27a60271711e87 P 2a6fc7c1e1064880bcb73c2175e645ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c61792f057504c7f8d951ef537999f1c (127.22.212.65:44749), 984da16a93564eceaa3241c97cac0df2 (127.22.212.67:42385)
I20260807 22:44:29.314051 21267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:29.311396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:44149 (local address 127.22.212.67:42385)
0807 22:44:29.311446 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:29.311448 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:29.311458 (+ 10us) server_negotiation.cc:407] Connection header received
0807 22:44:29.311490 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:29.311491 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:29.311501 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:29.311569 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:44:29.311750 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:29.312397 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:29.313315 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:29.313685 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:29.313741 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:29.313747 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:29.313918 (+ 171us) server_negotiation.cc:299] Negotiation successful
0807 22:44:29.313962 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260807 22:44:29.314073 21266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:29.311401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:56311 (local address 127.22.212.65:44749)
0807 22:44:29.311447 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:29.311450 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:29.311596 (+ 146us) server_negotiation.cc:407] Connection header received
0807 22:44:29.311630 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:29.311631 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:29.311646 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:29.311716 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:44:29.311895 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:29.312400 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:29.313340 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:29.313699 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:29.313786 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:29.313794 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:29.313963 (+ 169us) server_negotiation.cc:299] Negotiation successful
0807 22:44:29.314008 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 22:44:29.314073 21047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:29.311269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.67:42385 (local address 127.22.212.66:44149)
0807 22:44:29.311319 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:29.311333 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:29.311382 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:29.311595 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:29.311596 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:29.311598 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:44:29.311676 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:29.311678 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:29.312476 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:29.312477 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:29.313220 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:29.313222 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:29.313767 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:29.313768 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:29.313845 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:29.313847 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 22:44:29.313890 (+ 43us) client_negotiation.cc:240] Negotiation successful
0807 22:44:29.313940 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30,"mutex_wait_us":2}
I20260807 22:44:29.314194 21280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:29.311270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:44749 (local address 127.22.212.66:56311)
0807 22:44:29.311524 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:29.311533 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:29.311585 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:29.311744 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:29.311744 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:29.311746 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:44:29.311818 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:29.311819 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:29.312513 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:29.312514 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:29.313231 (+ 717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:29.313232 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:29.313800 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:29.313801 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:29.313866 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:29.313869 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:44:29.313941 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 22:44:29.313975 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"mutex_wait_us":51,"thread_start_us":105,"threads_started":1}
I20260807 22:44:29.314472 21177 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77d807ccb6124f9b8b27a60271711e87" candidate_uuid: "2a6fc7c1e1064880bcb73c2175e645ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "984da16a93564eceaa3241c97cac0df2" is_pre_election: true
I20260807 22:44:29.314643 21177 raft_consensus.cc:2454] T 77d807ccb6124f9b8b27a60271711e87 P 984da16a93564eceaa3241c97cac0df2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a6fc7c1e1064880bcb73c2175e645ee in term 0.
I20260807 22:44:29.314764 20746 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77d807ccb6124f9b8b27a60271711e87" candidate_uuid: "2a6fc7c1e1064880bcb73c2175e645ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61792f057504c7f8d951ef537999f1c" is_pre_election: true
I20260807 22:44:29.314906 20851 leader_election.cc:302] T 77d807ccb6124f9b8b27a60271711e87 P 2a6fc7c1e1064880bcb73c2175e645ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a6fc7c1e1064880bcb73c2175e645ee, 984da16a93564eceaa3241c97cac0df2; no voters:
I20260807 22:44:29.314931 20746 raft_consensus.cc:2454] T 77d807ccb6124f9b8b27a60271711e87 P c61792f057504c7f8d951ef537999f1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a6fc7c1e1064880bcb73c2175e645ee in term 0.
I20260807 22:44:29.315045 21279 raft_consensus.cc:2781] T 77d807ccb6124f9b8b27a60271711e87 P 2a6fc7c1e1064880bcb73c2175e645ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:44:29.315109 21279 raft_consensus.cc:482] T 77d807ccb6124f9b8b27a60271711e87 P 2a6fc7c1e1064880bcb73c2175e645ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:44:29.315132 21279 raft_consensus.cc:3037] T 77d807ccb6124f9b8b27a60271711e87 P 2a6fc7c1e1064880bcb73c2175e645ee [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:44:29.315834 21279 raft_consensus.cc:504] T 77d807ccb6124f9b8b27a60271711e87 P 2a6fc7c1e1064880bcb73c2175e645ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a6fc7c1e1064880bcb73c2175e645ee" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 33113 } } peers { permanent_uuid: "c61792f057504c7f8d951ef537999f1c" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 44749 } } peers { permanent_uuid: "984da16a93564eceaa3241c97cac0df2" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42385 } }
I20260807 22:44:29.315990 21279 leader_election.cc:288] T 77d807ccb6124f9b8b27a60271711e87 P 2a6fc7c1e1064880bcb73c2175e645ee [CANDIDATE]: Term 1 election: Requested vote from peers c61792f057504c7f8d951ef537999f1c (127.22.212.65:44749), 984da16a93564eceaa3241c97cac0df2 (127.22.212.67:42385)
I20260807 22:44:29.316180 21177 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77d807ccb6124f9b8b27a60271711e87" candidate_uuid: "2a6fc7c1e1064880bcb73c2175e645ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "984da16a93564eceaa3241c97cac0df2"
I20260807 22:44:29.316215 20746 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77d807ccb6124f9b8b27a60271711e87" candidate_uuid: "2a6fc7c1e1064880bcb73c2175e645ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c61792f057504c7f8d951ef537999f1c"
I20260807 22:44:29.316243 21177 raft_consensus.cc:3037] T 77d807ccb6124f9b8b27a60271711e87 P 984da16a93564eceaa3241c97cac0df2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:44:29.316339 20746 raft_consensus.cc:3037] T 77d807ccb6124f9b8b27a60271711e87 P c61792f057504c7f8d951ef537999f1c [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:44:29.317167 21177 raft_consensus.cc:2454] T 77d807ccb6124f9b8b27a60271711e87 P 984da16a93564eceaa3241c97cac0df2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a6fc7c1e1064880bcb73c2175e645ee in term 1.
I20260807 22:44:29.317273 20746 raft_consensus.cc:2454] T 77d807ccb6124f9b8b27a60271711e87 P c61792f057504c7f8d951ef537999f1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a6fc7c1e1064880bcb73c2175e645ee in term 1.
I20260807 22:44:29.317430 20851 leader_election.cc:302] T 77d807ccb6124f9b8b27a60271711e87 P 2a6fc7c1e1064880bcb73c2175e645ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a6fc7c1e1064880bcb73c2175e645ee, 984da16a93564eceaa3241c97cac0df2; no voters:
I20260807 22:44:29.317569 21279 raft_consensus.cc:2781] T 77d807ccb6124f9b8b27a60271711e87 P 2a6fc7c1e1064880bcb73c2175e645ee [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:44:29.317739 21279 raft_consensus.cc:686] T 77d807ccb6124f9b8b27a60271711e87 P 2a6fc7c1e1064880bcb73c2175e645ee [term 1 LEADER]: Becoming Leader. State: Replica: 2a6fc7c1e1064880bcb73c2175e645ee, State: Running, Role: LEADER
I20260807 22:44:29.317843 21279 consensus_queue.cc:237] T 77d807ccb6124f9b8b27a60271711e87 P 2a6fc7c1e1064880bcb73c2175e645ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a6fc7c1e1064880bcb73c2175e645ee" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 33113 } } peers { permanent_uuid: "c61792f057504c7f8d951ef537999f1c" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 44749 } } peers { permanent_uuid: "984da16a93564eceaa3241c97cac0df2" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42385 } }
I20260807 22:44:29.318704 20501 catalog_manager.cc:5495] T 77d807ccb6124f9b8b27a60271711e87 P 2a6fc7c1e1064880bcb73c2175e645ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 2a6fc7c1e1064880bcb73c2175e645ee (127.22.212.66). New cstate: current_term: 1 leader_uuid: "2a6fc7c1e1064880bcb73c2175e645ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a6fc7c1e1064880bcb73c2175e645ee" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 33113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c61792f057504c7f8d951ef537999f1c" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 44749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "984da16a93564eceaa3241c97cac0df2" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42385 } health_report { overall_health: UNKNOWN } } }
I20260807 22:44:29.340096 21262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:29.337915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59974 (local address 127.22.212.66:33113)
0807 22:44:29.337974 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:29.337976 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:29.337985 (+ 9us) server_negotiation.cc:407] Connection header received
0807 22:44:29.338071 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:29.338072 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:29.338092 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:29.338161 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:44:29.338283 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:29.338740 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:29.339444 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:29.339632 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:29.339682 (+ 50us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:29.339808 (+ 126us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:44:29.339891 (+ 83us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:44:29.339962 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:29.340009 (+ 47us) server_negotiation.cc:299] Negotiation successful
0807 22:44:29.340018 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260807 22:44:29.341907 21177 raft_consensus.cc:1261] T 77d807ccb6124f9b8b27a60271711e87 P 984da16a93564eceaa3241c97cac0df2 [term 1 FOLLOWER]: Refusing update from remote peer 2a6fc7c1e1064880bcb73c2175e645ee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:44:29.341907 20746 raft_consensus.cc:1261] T 77d807ccb6124f9b8b27a60271711e87 P c61792f057504c7f8d951ef537999f1c [term 1 FOLLOWER]: Refusing update from remote peer 2a6fc7c1e1064880bcb73c2175e645ee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:44:29.342329 21281 consensus_queue.cc:1035] T 77d807ccb6124f9b8b27a60271711e87 P 2a6fc7c1e1064880bcb73c2175e645ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "c61792f057504c7f8d951ef537999f1c" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 44749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:44:29.342461 21279 consensus_queue.cc:1035] T 77d807ccb6124f9b8b27a60271711e87 P 2a6fc7c1e1064880bcb73c2175e645ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "984da16a93564eceaa3241c97cac0df2" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 42385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:44:29.345510 21286 mvcc.cc:205] Tried to move back new op lower bound from 7316040373621882880 to 7316040373526589440. Current Snapshot: MvccSnapshot[applied={T|T < 7316040373621882880}]
I20260807 22:44:29.345963 21285 mvcc.cc:205] Tried to move back new op lower bound from 7316040373621882880 to 7316040373526589440. Current Snapshot: MvccSnapshot[applied={T|T < 7316040373621882880}]
I20260807 22:44:29.347347 20501 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:50020:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:44:29.347455 20501 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:50020:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:44:29.348170 20501 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 54beca5207284cb09f8f555d9d3d4945: Sending DeleteTablet for 3 replicas of tablet 77d807ccb6124f9b8b27a60271711e87
I20260807 22:44:29.348613 20708 tablet_service.cc:1514] Processing DeleteTablet for tablet 77d807ccb6124f9b8b27a60271711e87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:44:29 UTC) from {username='slave'} at 127.0.0.1:48700
I20260807 22:44:29.348618 21147 tablet_service.cc:1514] Processing DeleteTablet for tablet 77d807ccb6124f9b8b27a60271711e87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:44:29 UTC) from {username='slave'} at 127.0.0.1:47462
I20260807 22:44:29.348850 21299 tablet_replica.cc:330] T 77d807ccb6124f9b8b27a60271711e87 P 984da16a93564eceaa3241c97cac0df2: stopping tablet replica
I20260807 22:44:29.348889 20937 tablet_service.cc:1514] Processing DeleteTablet for tablet 77d807ccb6124f9b8b27a60271711e87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:44:29 UTC) from {username='slave'} at 127.0.0.1:59962
I20260807 22:44:29.348927 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 20592
I20260807 22:44:29.349735 21304 tablet_replica.cc:330] T 77d807ccb6124f9b8b27a60271711e87 P 2a6fc7c1e1064880bcb73c2175e645ee: stopping tablet replica
I20260807 22:44:29.349818 21304 raft_consensus.cc:2229] T 77d807ccb6124f9b8b27a60271711e87 P 2a6fc7c1e1064880bcb73c2175e645ee [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:44:29.349895 21304 raft_consensus.cc:2258] T 77d807ccb6124f9b8b27a60271711e87 P 2a6fc7c1e1064880bcb73c2175e645ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:44:29.358827 21304 ts_tablet_manager.cc:1905] T 77d807ccb6124f9b8b27a60271711e87 P 2a6fc7c1e1064880bcb73c2175e645ee: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:44:29.360630 21304 ts_tablet_manager.cc:1918] T 77d807ccb6124f9b8b27a60271711e87 P 2a6fc7c1e1064880bcb73c2175e645ee: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:44:29.360704 21304 log.cc:1196] T 77d807ccb6124f9b8b27a60271711e87 P 2a6fc7c1e1064880bcb73c2175e645ee: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-1/wal/wals/77d807ccb6124f9b8b27a60271711e87
I20260807 22:44:29.360970 21304 ts_tablet_manager.cc:1939] T 77d807ccb6124f9b8b27a60271711e87 P 2a6fc7c1e1064880bcb73c2175e645ee: Deleting consensus metadata
I20260807 22:44:29.361418 20479 catalog_manager.cc:4841] TS 2a6fc7c1e1064880bcb73c2175e645ee (127.22.212.66:33113): tablet 77d807ccb6124f9b8b27a60271711e87 (table test-table [id=8ad142d5b8454e33bbd704fa3157a1a1]) successfully deleted
I20260807 22:44:29.361577 21299 raft_consensus.cc:2229] T 77d807ccb6124f9b8b27a60271711e87 P 984da16a93564eceaa3241c97cac0df2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:44:29.361749 21299 raft_consensus.cc:2258] T 77d807ccb6124f9b8b27a60271711e87 P 984da16a93564eceaa3241c97cac0df2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:44:29.362243 21299 ts_tablet_manager.cc:1905] T 77d807ccb6124f9b8b27a60271711e87 P 984da16a93564eceaa3241c97cac0df2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:44:29.364184 21299 ts_tablet_manager.cc:1918] T 77d807ccb6124f9b8b27a60271711e87 P 984da16a93564eceaa3241c97cac0df2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:44:29.364295 21299 log.cc:1196] T 77d807ccb6124f9b8b27a60271711e87 P 984da16a93564eceaa3241c97cac0df2: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786142418640232-23377-0/minicluster-data/ts-2/wal/wals/77d807ccb6124f9b8b27a60271711e87
I20260807 22:44:29.364559 21299 ts_tablet_manager.cc:1939] T 77d807ccb6124f9b8b27a60271711e87 P 984da16a93564eceaa3241c97cac0df2: Deleting consensus metadata
I20260807 22:44:29.365015 20478 catalog_manager.cc:4841] TS 984da16a93564eceaa3241c97cac0df2 (127.22.212.67:42385): tablet 77d807ccb6124f9b8b27a60271711e87 (table test-table [id=8ad142d5b8454e33bbd704fa3157a1a1]) successfully deleted
W20260807 22:44:29.365829 20479 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.212.65:44749 (error 108)
I20260807 22:44:29.365938 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 20825
I20260807 22:44:29.369479 21261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:29.369297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:44749 (local address 127.0.0.1:48712)
0807 22:44:29.369378 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:29.369435 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.65:44749: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260807 22:44:29.369623 20479 catalog_manager.cc:4584] TS c61792f057504c7f8d951ef537999f1c (127.22.212.65:44749): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 77d807ccb6124f9b8b27a60271711e87: Network error: Client connection negotiation failed: client connection to 127.22.212.65:44749: connect: Connection refused (error 111)
I20260807 22:44:29.373167 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 21048
I20260807 22:44:29.384976 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 20453
2026-08-07T22:44:29Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (828 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:44:29 dist-test-slave-2d19 krb5kdc[21309](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:44:29 dist-test-slave-2d19 krb5kdc[21309](info): set up 2 sockets
Aug 07 22:44:29 dist-test-slave-2d19 krb5kdc[21309](info): commencing operation
krb5kdc: starting...
W20260807 22:44:30.673005 23377 mini_kdc.cc:121] Time spent starting KDC: real 1.260s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Aug 07 22:44:30 dist-test-slave-2d19 krb5kdc[21309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142670, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:44:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:44:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.212.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
I20260807 22:44:30.799337 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:39383
--webserver_interface=127.22.212.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:40083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:39383
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:44:30.882894 21329 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:44:30.883131 21329 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:44:30.883167 21329 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:44:30.884320 21329 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:44:30.884382 21329 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:44:30.884405 21329 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:44:30.884426 21329 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:44:30.884476 21329 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:44:30.885975 21329 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:40083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:39383
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:39383
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21329
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:44:30.886253 21329 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:44:30.886487 21329 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:44:30.891637 21337 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:30.891613 21339 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:30.891618 21336 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:30.891896 21329 server_base.cc:1034] running on GCE node
I20260807 22:44:30.892414 21329 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:44:30.892716 21329 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:44:30.893878 21329 hybrid_clock.cc:648] HybridClock initialized: now 1786142670893866 us; error 43 us; skew 500 ppm
Aug 07 22:44:30 dist-test-slave-2d19 krb5kdc[21309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142670, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:44:30.896526 21329 init.cc:377] Logged in from keytab as kudu/127.22.212.126@KRBTEST.COM (short username kudu)
I20260807 22:44:30.897008 21329 webserver.cc:460] Webserver started at http://127.22.212.126:33503/ using document root <none> and password file <none>
I20260807 22:44:30.897259 21329 fs_manager.cc:359] Metadata directory not provided
I20260807 22:44:30.897325 21329 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:44:30.897464 21329 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:44:30.898504 21329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "6777df4bc9fd4e5ba463c9f886f7427e"
format_stamp: "Formatted at 2026-08-07 22:44:30 on dist-test-slave-2d19"
server_key: "b3e71b6fb68fda4da889857583b1b0c9"
server_key_iv: "ef67010cc397cd1f888abbef9fb4eb91"
server_key_version: "encryptionkey@0"
I20260807 22:44:30.898869 21329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "6777df4bc9fd4e5ba463c9f886f7427e"
format_stamp: "Formatted at 2026-08-07 22:44:30 on dist-test-slave-2d19"
server_key: "b3e71b6fb68fda4da889857583b1b0c9"
server_key_iv: "ef67010cc397cd1f888abbef9fb4eb91"
server_key_version: "encryptionkey@0"
I20260807 22:44:30.900172 21329 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260807 22:44:30.900945 21350 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:30.901115 21329 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 22:44:30.901213 21329 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "6777df4bc9fd4e5ba463c9f886f7427e"
format_stamp: "Formatted at 2026-08-07 22:44:30 on dist-test-slave-2d19"
server_key: "b3e71b6fb68fda4da889857583b1b0c9"
server_key_iv: "ef67010cc397cd1f888abbef9fb4eb91"
server_key_version: "encryptionkey@0"
I20260807 22:44:30.901291 21329 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:44:30.934376 21329 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:44:30.936864 21329 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:44:30.937038 21329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:44:30.941454 21329 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:39383
I20260807 22:44:30.941501 21439 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:39383 every 8 connection(s)
I20260807 22:44:30.941859 21329 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:44:30.942780 21440 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:44:30.945189 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 21329
I20260807 22:44:30.945314 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:44:30.945385 21440 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6777df4bc9fd4e5ba463c9f886f7427e: Bootstrap starting.
I20260807 22:44:30.945535 23377 external_mini_cluster.cc:1428] Setting key 99cd31459ca5f06782a3af5fa99b9ae3
I20260807 22:44:30.946177 21440 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6777df4bc9fd4e5ba463c9f886f7427e: Neither blocks nor log segments found. Creating new log.
I20260807 22:44:30.946513 21440 log.cc:824] T 00000000000000000000000000000000 P 6777df4bc9fd4e5ba463c9f886f7427e: Log is configured to *not* fsync() on all Append() calls
I20260807 22:44:30.947376 21440 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6777df4bc9fd4e5ba463c9f886f7427e: No bootstrap required, opened a new log
I20260807 22:44:30.949792 21440 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6777df4bc9fd4e5ba463c9f886f7427e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6777df4bc9fd4e5ba463c9f886f7427e" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 39383 } }
I20260807 22:44:30.949970 21440 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6777df4bc9fd4e5ba463c9f886f7427e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:44:30.950002 21440 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6777df4bc9fd4e5ba463c9f886f7427e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6777df4bc9fd4e5ba463c9f886f7427e, State: Initialized, Role: FOLLOWER
I20260807 22:44:30.950129 21440 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6777df4bc9fd4e5ba463c9f886f7427e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6777df4bc9fd4e5ba463c9f886f7427e" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 39383 } }
I20260807 22:44:30.950224 21440 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6777df4bc9fd4e5ba463c9f886f7427e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:44:30.950260 21440 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6777df4bc9fd4e5ba463c9f886f7427e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:44:30.950314 21440 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6777df4bc9fd4e5ba463c9f886f7427e [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:44:30.950929 21440 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6777df4bc9fd4e5ba463c9f886f7427e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6777df4bc9fd4e5ba463c9f886f7427e" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 39383 } }
I20260807 22:44:30.951059 21440 leader_election.cc:302] T 00000000000000000000000000000000 P 6777df4bc9fd4e5ba463c9f886f7427e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6777df4bc9fd4e5ba463c9f886f7427e; no voters:
I20260807 22:44:30.951256 21440 leader_election.cc:288] T 00000000000000000000000000000000 P 6777df4bc9fd4e5ba463c9f886f7427e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:44:30.951277 21452 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6777df4bc9fd4e5ba463c9f886f7427e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:44:30.951392 21452 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6777df4bc9fd4e5ba463c9f886f7427e [term 1 LEADER]: Becoming Leader. State: Replica: 6777df4bc9fd4e5ba463c9f886f7427e, State: Running, Role: LEADER
I20260807 22:44:30.951470 21452 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6777df4bc9fd4e5ba463c9f886f7427e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6777df4bc9fd4e5ba463c9f886f7427e" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 39383 } }
I20260807 22:44:30.951547 21440 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6777df4bc9fd4e5ba463c9f886f7427e [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:44:30.951830 21452 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6777df4bc9fd4e5ba463c9f886f7427e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6777df4bc9fd4e5ba463c9f886f7427e. Latest consensus state: current_term: 1 leader_uuid: "6777df4bc9fd4e5ba463c9f886f7427e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6777df4bc9fd4e5ba463c9f886f7427e" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 39383 } } }
I20260807 22:44:30.951918 21452 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6777df4bc9fd4e5ba463c9f886f7427e [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:30.952725 21453 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6777df4bc9fd4e5ba463c9f886f7427e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6777df4bc9fd4e5ba463c9f886f7427e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6777df4bc9fd4e5ba463c9f886f7427e" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 39383 } } }
I20260807 22:44:30.952801 21453 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6777df4bc9fd4e5ba463c9f886f7427e [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:30.953022 21459 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:44:30.954011 21459 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 07 22:44:30 dist-test-slave-2d19 krb5kdc[21309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142670, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:44:30.956228 21459 catalog_manager.cc:1347] Generated new cluster ID: 5d398706b7074c0497eaad2051fc0933
I20260807 22:44:30.956311 21459 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:44:30.961369 21459 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:44:30.961901 21459 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:44:30.964540 21448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:30.946075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47800 (local address 127.22.212.126:39383)
0807 22:44:30.946261 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:30.946272 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:30.946307 (+ 35us) server_negotiation.cc:407] Connection header received
0807 22:44:30.946897 (+ 590us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:30.946907 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:30.946973 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:30.947124 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:30.947942 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:30.949121 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:30.950236 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:30.950760 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:30.950859 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:30.954966 (+ 4107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:30.954970 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:30.954971 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:44:30.954984 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:30.960861 (+ 5877us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:30.962453 (+ 1592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:30.962456 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:30.962457 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:30.962581 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:30.962809 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:30.962809 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:30.962810 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:30.963123 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:30.963798 (+ 675us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:30.964097 (+ 299us) server_negotiation.cc:299] Negotiation successful
0807 22:44:30.964283 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":84,"threads_started":1}
I20260807 22:44:30.979594 21459 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6777df4bc9fd4e5ba463c9f886f7427e: Generated new TSK 0
I20260807 22:44:30.979811 21459 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.212.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab.
Entry for principal kudu/127.22.212.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab.
I20260807 22:44:31.021659 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.65:0
--local_ip_for_outbound_sockets=127.22.212.65
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:39383
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:40083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:44:31.115324 21485 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:44:31.115536 21485 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:44:31.115561 21485 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:44:31.116750 21485 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:44:31.116796 21485 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:44:31.116822 21485 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.65
I20260807 22:44:31.118286 21485 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:40083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.65.keytab
--principal=kudu/127.22.212.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:39383
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21485
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.65
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:44:31.118525 21485 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:44:31.118772 21485 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:44:31.124316 21496 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:31.124322 21494 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:31.124408 21493 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:31.124498 21485 server_base.cc:1034] running on GCE node
I20260807 22:44:31.124727 21485 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:44:31.124943 21485 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:44:31.126133 21485 hybrid_clock.cc:648] HybridClock initialized: now 1786142671126124 us; error 35 us; skew 500 ppm
Aug 07 22:44:31 dist-test-slave-2d19 krb5kdc[21309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142671, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:44:31.128911 21485 init.cc:377] Logged in from keytab as kudu/127.22.212.65@KRBTEST.COM (short username kudu)
I20260807 22:44:31.129340 21485 webserver.cc:460] Webserver started at http://127.22.212.65:39779/ using document root <none> and password file <none>
I20260807 22:44:31.129571 21485 fs_manager.cc:359] Metadata directory not provided
I20260807 22:44:31.129638 21485 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:44:31.129783 21485 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:44:31.130856 21485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-0/data/instance:
uuid: "b12eb425ac1e404b9e51c20c995520a8"
format_stamp: "Formatted at 2026-08-07 22:44:31 on dist-test-slave-2d19"
server_key: "ca3c22e34409799a31ff4f782a26d55c"
server_key_iv: "6e2e13dc47d0603749c6138bff2aeb39"
server_key_version: "encryptionkey@0"
I20260807 22:44:31.131227 21485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance:
uuid: "b12eb425ac1e404b9e51c20c995520a8"
format_stamp: "Formatted at 2026-08-07 22:44:31 on dist-test-slave-2d19"
server_key: "ca3c22e34409799a31ff4f782a26d55c"
server_key_iv: "6e2e13dc47d0603749c6138bff2aeb39"
server_key_version: "encryptionkey@0"
I20260807 22:44:31.132675 21485 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 22:44:31.133387 21503 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:31.133558 21485 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 22:44:31.133661 21485 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-0/wal
uuid: "b12eb425ac1e404b9e51c20c995520a8"
format_stamp: "Formatted at 2026-08-07 22:44:31 on dist-test-slave-2d19"
server_key: "ca3c22e34409799a31ff4f782a26d55c"
server_key_iv: "6e2e13dc47d0603749c6138bff2aeb39"
server_key_version: "encryptionkey@0"
I20260807 22:44:31.133733 21485 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:44:31.146919 21485 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:44:31.149255 21485 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:44:31.149412 21485 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:44:31.149650 21485 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:44:31.149958 21485 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:44:31.150014 21485 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:31.150058 21485 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:44:31.150087 21485 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:31.155992 21485 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.65:35499
I20260807 22:44:31.156092 21689 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.65:35499 every 8 connection(s)
I20260807 22:44:31.156472 21485 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
I20260807 22:44:31.158260 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 21485
I20260807 22:44:31.158404 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance
I20260807 22:44:31.158667 23377 external_mini_cluster.cc:1428] Setting key e01608c96e2353b01bd56552000cff76
Aug 07 22:44:31 dist-test-slave-2d19 krb5kdc[21309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142671, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.65@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:44:31.167881 21448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:31.157267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:53081 (local address 127.22.212.126:39383)
0807 22:44:31.157345 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:31.157348 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:31.157524 (+ 176us) server_negotiation.cc:407] Connection header received
0807 22:44:31.158030 (+ 506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:31.158031 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:31.158042 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:31.158086 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:31.159441 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:31.159942 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:31.161482 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:31.161699 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:31.161790 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:31.164487 (+ 2697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:31.164489 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:31.164489 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:44:31.164499 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:31.166023 (+ 1524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:31.166818 (+ 795us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:31.166820 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:31.166820 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:31.166886 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:31.167156 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:31.167156 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:31.167157 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:31.167275 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:31.167352 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:31.167666 (+ 314us) server_negotiation.cc:299] Negotiation successful
0807 22:44:31.167781 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 22:44:31.168044 21695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:31.157222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:39383 (local address 127.22.212.65:53081)
0807 22:44:31.157397 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:31.157435 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:31.157931 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:31.158215 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:31.158221 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:31.159083 (+ 862us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:44:31.159326 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:31.159333 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:31.160054 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:31.160056 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:31.161385 (+ 1329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:31.161388 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:31.161799 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:31.161801 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:31.161939 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:31.162485 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:44:31.162500 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:44:31.164378 (+ 1878us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:44:31.166457 (+ 2079us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:44:31.166465 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:44:31.166468 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:44:31.166719 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:44:31.166956 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:44:31.166957 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:44:31.166957 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:44:31.167078 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:44:31.167343 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:44:31.167351 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:44:31.167519 (+ 168us) client_negotiation.cc:769] Sending connection context
0807 22:44:31.167630 (+ 111us) client_negotiation.cc:240] Negotiation successful
0807 22:44:31.167804 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":93,"threads_started":1}
I20260807 22:44:31.168557 21691 heartbeater.cc:347] Connected to a master server at 127.22.212.126:39383
I20260807 22:44:31.168656 21691 heartbeater.cc:464] Registering TS with master...
I20260807 22:44:31.168865 21691 heartbeater.cc:511] Master 127.22.212.126:39383 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.22.212.66@KRBTEST.COM; defaulting to no policy
I20260807 22:44:31.169425 21376 ts_manager.cc:194] Registered new tserver with Master: b12eb425ac1e404b9e51c20c995520a8 (127.22.212.65:35499)
I20260807 22:44:31.170063 21376 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.65@KRBTEST.COM'} at 127.22.212.65:53081
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab.
Entry for principal kudu/127.22.212.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab.
I20260807 22:44:31.187685 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.66:0
--local_ip_for_outbound_sockets=127.22.212.66
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:39383
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:40083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:44:31.274451 21698 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:44:31.274667 21698 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:44:31.274689 21698 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:44:31.275846 21698 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:44:31.275890 21698 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:44:31.275938 21698 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.66
I20260807 22:44:31.277467 21698 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:40083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.66.keytab
--principal=kudu/127.22.212.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:39383
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21698
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.66
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:44:31.277701 21698 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:44:31.277943 21698 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:44:31.283167 21711 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:31.283174 21706 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:31.283175 21703 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:31.283488 21698 server_base.cc:1034] running on GCE node
I20260807 22:44:31.283742 21698 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:44:31.284030 21698 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:44:31.285215 21698 hybrid_clock.cc:648] HybridClock initialized: now 1786142671285195 us; error 28 us; skew 500 ppm
Aug 07 22:44:31 dist-test-slave-2d19 krb5kdc[21309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142671, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:44:31.287969 21698 init.cc:377] Logged in from keytab as kudu/127.22.212.66@KRBTEST.COM (short username kudu)
I20260807 22:44:31.288489 21698 webserver.cc:460] Webserver started at http://127.22.212.66:37419/ using document root <none> and password file <none>
I20260807 22:44:31.288718 21698 fs_manager.cc:359] Metadata directory not provided
I20260807 22:44:31.288784 21698 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:44:31.288936 21698 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:44:31.290059 21698 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-1/data/instance:
uuid: "b30ce35e01ae4f879061b6358024a412"
format_stamp: "Formatted at 2026-08-07 22:44:31 on dist-test-slave-2d19"
server_key: "528028221e21a230d5d336fdc9c1ada7"
server_key_iv: "ab5a5e7e5c0925db21f53d38611ddfa8"
server_key_version: "encryptionkey@0"
I20260807 22:44:31.290444 21698 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance:
uuid: "b30ce35e01ae4f879061b6358024a412"
format_stamp: "Formatted at 2026-08-07 22:44:31 on dist-test-slave-2d19"
server_key: "528028221e21a230d5d336fdc9c1ada7"
server_key_iv: "ab5a5e7e5c0925db21f53d38611ddfa8"
server_key_version: "encryptionkey@0"
I20260807 22:44:31.291802 21698 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 22:44:31.292618 21723 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:31.292780 21698 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:31.292881 21698 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-1/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-1/wal
uuid: "b30ce35e01ae4f879061b6358024a412"
format_stamp: "Formatted at 2026-08-07 22:44:31 on dist-test-slave-2d19"
server_key: "528028221e21a230d5d336fdc9c1ada7"
server_key_iv: "ab5a5e7e5c0925db21f53d38611ddfa8"
server_key_version: "encryptionkey@0"
I20260807 22:44:31.292958 21698 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:44:31.307664 21698 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:44:31.309571 21698 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:44:31.309737 21698 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:44:31.309978 21698 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:44:31.310302 21698 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:44:31.310352 21698 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:31.310395 21698 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:44:31.310436 21698 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:31.316452 21698 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.66:39391
I20260807 22:44:31.316514 21907 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.66:39391 every 8 connection(s)
I20260807 22:44:31.316810 21698 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
Aug 07 22:44:31 dist-test-slave-2d19 krb5kdc[21309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142671, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.66@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:44:31.323534 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 21698
I20260807 22:44:31.323653 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance
I20260807 22:44:31.323872 23377 external_mini_cluster.cc:1428] Setting key 78aa0208340b881afff91cd7e3eb878d
I20260807 22:44:31.326190 21448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:31.317479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:33489 (local address 127.22.212.126:39383)
0807 22:44:31.317588 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:31.317591 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:31.317749 (+ 158us) server_negotiation.cc:407] Connection header received
0807 22:44:31.318325 (+ 576us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:31.318327 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:31.318339 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:31.318397 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:31.319334 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:31.319861 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:31.320923 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:31.321139 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:31.321215 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:31.323282 (+ 2067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:31.323284 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:31.323284 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:44:31.323291 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:31.324819 (+ 1528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:31.325240 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:31.325241 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:31.325241 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:31.325304 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:31.325561 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:31.325562 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:31.325562 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:31.325676 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:31.325743 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:31.326013 (+ 270us) server_negotiation.cc:299] Negotiation successful
0807 22:44:31.326096 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 22:44:31.326381 21911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:31.317438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:39383 (local address 127.22.212.66:33489)
0807 22:44:31.317625 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:31.317667 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:31.318213 (+ 546us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:31.318471 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:31.318475 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:31.319043 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:44:31.319233 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:31.319237 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:31.319963 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:31.319964 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:31.320831 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:31.320834 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:31.321222 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:31.321223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:31.321342 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:31.321752 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:44:31.321761 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:44:31.323195 (+ 1434us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:44:31.324926 (+ 1731us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:44:31.324933 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:44:31.324935 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:44:31.325159 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:44:31.325379 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:44:31.325379 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:44:31.325380 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:44:31.325486 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:44:31.325745 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:44:31.325753 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:44:31.325885 (+ 132us) client_negotiation.cc:769] Sending connection context
0807 22:44:31.325998 (+ 113us) client_negotiation.cc:240] Negotiation successful
0807 22:44:31.326155 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":90,"threads_started":1}
I20260807 22:44:31.326856 21908 heartbeater.cc:347] Connected to a master server at 127.22.212.126:39383
I20260807 22:44:31.326958 21908 heartbeater.cc:464] Registering TS with master...
I20260807 22:44:31.327140 21908 heartbeater.cc:511] Master 127.22.212.126:39383 requested a full tablet report, sending...
I20260807 22:44:31.327538 21376 ts_manager.cc:194] Registered new tserver with Master: b30ce35e01ae4f879061b6358024a412 (127.22.212.66:39391)
I20260807 22:44:31.327903 21376 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.66@KRBTEST.COM'} at 127.22.212.66:33489
WARNING: no policy specified for kudu/127.22.212.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab.
Entry for principal kudu/127.22.212.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab.
I20260807 22:44:31.352464 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.67:0
--local_ip_for_outbound_sockets=127.22.212.67
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:39383
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:40083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:44:31.435855 21917 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:44:31.436108 21917 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:44:31.436148 21917 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:44:31.437295 21917 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:44:31.437366 21917 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:44:31.437408 21917 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.67
I20260807 22:44:31.438856 21917 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:40083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.67.keytab
--principal=kudu/127.22.212.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:39383
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21917
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.67
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:44:31.439146 21917 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:44:31.439383 21917 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:44:31.444675 21926 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:31.444718 21927 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:31.444747 21930 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:31.444864 21917 server_base.cc:1034] running on GCE node
I20260807 22:44:31.445076 21917 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:44:31.445273 21917 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:44:31.446405 21917 hybrid_clock.cc:648] HybridClock initialized: now 1786142671446393 us; error 28 us; skew 500 ppm
Aug 07 22:44:31 dist-test-slave-2d19 krb5kdc[21309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142671, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:44:31.448901 21917 init.cc:377] Logged in from keytab as kudu/127.22.212.67@KRBTEST.COM (short username kudu)
I20260807 22:44:31.449369 21917 webserver.cc:460] Webserver started at http://127.22.212.67:40521/ using document root <none> and password file <none>
I20260807 22:44:31.449597 21917 fs_manager.cc:359] Metadata directory not provided
I20260807 22:44:31.449643 21917 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:44:31.449806 21917 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:44:31.450917 21917 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-2/data/instance:
uuid: "070f92ae2f0740bb805749f3dbeb7703"
format_stamp: "Formatted at 2026-08-07 22:44:31 on dist-test-slave-2d19"
server_key: "565b7ff32db8119112921fc092eaa851"
server_key_iv: "2fdf9859ca572e17006d315b47b8d9c8"
server_key_version: "encryptionkey@0"
I20260807 22:44:31.451305 21917 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance:
uuid: "070f92ae2f0740bb805749f3dbeb7703"
format_stamp: "Formatted at 2026-08-07 22:44:31 on dist-test-slave-2d19"
server_key: "565b7ff32db8119112921fc092eaa851"
server_key_iv: "2fdf9859ca572e17006d315b47b8d9c8"
server_key_version: "encryptionkey@0"
I20260807 22:44:31.453004 21917 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 22:44:31.453769 21939 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:31.453953 21917 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 22:44:31.454071 21917 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-2/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-2/wal
uuid: "070f92ae2f0740bb805749f3dbeb7703"
format_stamp: "Formatted at 2026-08-07 22:44:31 on dist-test-slave-2d19"
server_key: "565b7ff32db8119112921fc092eaa851"
server_key_iv: "2fdf9859ca572e17006d315b47b8d9c8"
server_key_version: "encryptionkey@0"
I20260807 22:44:31.454156 21917 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:44:31.475193 21917 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:44:31.477200 21917 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:44:31.477358 21917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:44:31.477630 21917 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:44:31.477962 21917 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:44:31.478016 21917 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:31.478075 21917 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:44:31.478117 21917 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:31.484138 21917 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.67:37201
I20260807 22:44:31.484185 22111 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.67:37201 every 8 connection(s)
I20260807 22:44:31.484541 21917 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
I20260807 22:44:31.487957 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 21917
I20260807 22:44:31.488106 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance
I20260807 22:44:31.488333 23377 external_mini_cluster.cc:1428] Setting key 7c7155d907923bbb38b835eab8c0827b
Aug 07 22:44:31 dist-test-slave-2d19 krb5kdc[21309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142671, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.67@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:44:31.494010 21448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:31.485267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:43481 (local address 127.22.212.126:39383)
0807 22:44:31.485329 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:31.485332 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:31.485536 (+ 204us) server_negotiation.cc:407] Connection header received
0807 22:44:31.486060 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:31.486061 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:31.486071 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:31.486115 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:31.487052 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:31.487561 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:31.488801 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:31.489078 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:31.489155 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:31.491330 (+ 2175us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:31.491332 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:31.491332 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:44:31.491339 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:31.492788 (+ 1449us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:31.493155 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:31.493155 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:31.493156 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:31.493210 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:31.493418 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:31.493419 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:31.493419 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:31.493523 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:31.493577 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:31.493849 (+ 272us) server_negotiation.cc:299] Negotiation successful
0807 22:44:31.493932 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260807 22:44:31.494081 22115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:31.485232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:39383 (local address 127.22.212.67:43481)
0807 22:44:31.485393 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:31.485436 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:31.485929 (+ 493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:31.486174 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:31.486177 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:31.486744 (+ 567us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:44:31.486941 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:31.486946 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:31.487647 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:31.487647 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:31.488709 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:31.488713 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:31.489165 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:31.489167 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:31.489304 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:31.489855 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:44:31.489864 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:44:31.491246 (+ 1382us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:44:31.492864 (+ 1618us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:44:31.492870 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:44:31.492872 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:44:31.493093 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:44:31.493266 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:44:31.493266 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:44:31.493267 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:44:31.493363 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:44:31.493576 (+ 213us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:44:31.493580 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:44:31.493692 (+ 112us) client_negotiation.cc:769] Sending connection context
0807 22:44:31.493777 (+ 85us) client_negotiation.cc:240] Negotiation successful
0807 22:44:31.493897 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":86,"threads_started":1}
I20260807 22:44:31.494624 22113 heartbeater.cc:347] Connected to a master server at 127.22.212.126:39383
I20260807 22:44:31.494731 22113 heartbeater.cc:464] Registering TS with master...
I20260807 22:44:31.494922 22113 heartbeater.cc:511] Master 127.22.212.126:39383 requested a full tablet report, sending...
I20260807 22:44:31.495328 21376 ts_manager.cc:194] Registered new tserver with Master: 070f92ae2f0740bb805749f3dbeb7703 (127.22.212.67:37201)
I20260807 22:44:31.495782 21376 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.212.67@KRBTEST.COM'} at 127.22.212.67:43481
I20260807 22:44:31.500108 23377 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:44:31.507381 21448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:31.501481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47806 (local address 127.22.212.126:39383)
0807 22:44:31.501562 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:31.501564 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:31.501658 (+ 94us) server_negotiation.cc:407] Connection header received
0807 22:44:31.501736 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:31.501736 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:31.501746 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:31.501798 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:31.502371 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:31.502850 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:31.503578 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:31.503791 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:31.503867 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:31.505093 (+ 1226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:31.505095 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:31.505095 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:44:31.505103 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:31.506236 (+ 1133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:31.506568 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:31.506569 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:31.506570 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:31.506631 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:31.506825 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:31.506826 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:31.506826 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:31.506975 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:31.507086 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:31.507198 (+ 112us) server_negotiation.cc:299] Negotiation successful
0807 22:44:31.507280 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 22:44:31.508999 21376 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47806:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:44:31.510572 21376 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:44:31.517441 22131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:31.513016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50810 (local address 127.22.212.66:39391)
0807 22:44:31.513195 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:31.513201 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:31.513531 (+ 330us) server_negotiation.cc:407] Connection header received
0807 22:44:31.513583 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:31.513585 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:31.513603 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:31.513699 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:44:31.514044 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:31.514773 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:31.516166 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:31.516894 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:31.516968 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:31.517044 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:31.517297 (+ 253us) server_negotiation.cc:299] Negotiation successful
0807 22:44:31.517340 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":95,"threads_started":1}
I20260807 22:44:31.517439 22134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:31.513047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51408 (local address 127.22.212.65:35499)
0807 22:44:31.513273 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:31.513277 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:31.513779 (+ 502us) server_negotiation.cc:407] Connection header received
0807 22:44:31.513825 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:31.513827 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:31.513844 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:31.513960 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:44:31.514073 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:31.515131 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:31.516293 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:31.516975 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:31.517071 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:31.517126 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:31.517304 (+ 178us) server_negotiation.cc:299] Negotiation successful
0807 22:44:31.517347 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":82,"threads_started":1}
I20260807 22:44:31.517449 22130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:31.512924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:35499 (local address 127.0.0.1:51408)
0807 22:44:31.513223 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:31.513272 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:31.513350 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:31.513959 (+ 609us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:31.513960 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:31.513962 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:44:31.514012 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:31.514013 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:31.515246 (+ 1233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:31.515247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:31.516177 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:31.516179 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:31.517076 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:31.517078 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:31.517166 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:31.517180 (+ 14us) client_negotiation.cc:769] Sending connection context
0807 22:44:31.517272 (+ 92us) client_negotiation.cc:240] Negotiation successful
0807 22:44:31.517340 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":103,"threads_started":1}
I20260807 22:44:31.517434 22128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:31.512900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.66:39391 (local address 127.0.0.1:50810)
0807 22:44:31.513218 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:31.513262 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:31.513347 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:31.513759 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:31.513763 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:31.513766 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:44:31.513865 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:31.513867 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:31.514871 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:31.514872 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:31.516082 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:31.516085 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:31.517079 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:31.517080 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:31.517166 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:31.517181 (+ 15us) client_negotiation.cc:769] Sending connection context
0807 22:44:31.517278 (+ 97us) client_negotiation.cc:240] Negotiation successful
0807 22:44:31.517350 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"mutex_wait_us":25,"thread_start_us":111,"threads_started":1}
I20260807 22:44:31.518287 21799 tablet_service.cc:1467] Processing CreateTablet for tablet 254e5139a0b54ad78a18ff99565af290 (DEFAULT_TABLE table=test-table [id=11c6e7e58a0747db9fee27c0137a13e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:44:31.518263 21584 tablet_service.cc:1467] Processing CreateTablet for tablet 254e5139a0b54ad78a18ff99565af290 (DEFAULT_TABLE table=test-table [id=11c6e7e58a0747db9fee27c0137a13e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:44:31.518666 21799 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 254e5139a0b54ad78a18ff99565af290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:44:31.518666 21584 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 254e5139a0b54ad78a18ff99565af290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:44:31.520567 22136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:31.513371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41312 (local address 127.22.212.67:37201)
0807 22:44:31.513538 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:31.513542 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:31.513552 (+ 10us) server_negotiation.cc:407] Connection header received
0807 22:44:31.513585 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:31.513610 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:31.513627 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:31.513698 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:44:31.513954 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:31.515067 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:31.516495 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:31.516963 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:31.517067 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:31.517128 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:31.520414 (+ 3286us) server_negotiation.cc:299] Negotiation successful
0807 22:44:31.520467 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":95,"threads_started":1}
I20260807 22:44:31.520799 22135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:31.513167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.67:37201 (local address 127.0.0.1:41312)
0807 22:44:31.513376 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:31.513386 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:31.513441 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:31.513784 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:31.513785 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:31.513788 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:44:31.513870 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:31.513872 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:31.515175 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:31.515176 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:31.516411 (+ 1235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:31.516413 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:31.517675 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:31.517677 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:31.517740 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:31.517744 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 22:44:31.520681 (+ 2937us) client_negotiation.cc:240] Negotiation successful
0807 22:44:31.520731 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"mutex_wait_us":22,"thread_start_us":67,"threads_started":1}
I20260807 22:44:31.521485 22010 tablet_service.cc:1467] Processing CreateTablet for tablet 254e5139a0b54ad78a18ff99565af290 (DEFAULT_TABLE table=test-table [id=11c6e7e58a0747db9fee27c0137a13e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:44:31.521803 22010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 254e5139a0b54ad78a18ff99565af290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:44:31.522159 22138 tablet_bootstrap.cc:492] T 254e5139a0b54ad78a18ff99565af290 P b30ce35e01ae4f879061b6358024a412: Bootstrap starting.
I20260807 22:44:31.522382 22137 tablet_bootstrap.cc:492] T 254e5139a0b54ad78a18ff99565af290 P b12eb425ac1e404b9e51c20c995520a8: Bootstrap starting.
I20260807 22:44:31.523154 22137 tablet_bootstrap.cc:654] T 254e5139a0b54ad78a18ff99565af290 P b12eb425ac1e404b9e51c20c995520a8: Neither blocks nor log segments found. Creating new log.
I20260807 22:44:31.523912 22138 tablet_bootstrap.cc:654] T 254e5139a0b54ad78a18ff99565af290 P b30ce35e01ae4f879061b6358024a412: Neither blocks nor log segments found. Creating new log.
I20260807 22:44:31.524580 22138 log.cc:824] T 254e5139a0b54ad78a18ff99565af290 P b30ce35e01ae4f879061b6358024a412: Log is configured to *not* fsync() on all Append() calls
I20260807 22:44:31.524843 22137 log.cc:824] T 254e5139a0b54ad78a18ff99565af290 P b12eb425ac1e404b9e51c20c995520a8: Log is configured to *not* fsync() on all Append() calls
I20260807 22:44:31.525363 22142 tablet_bootstrap.cc:492] T 254e5139a0b54ad78a18ff99565af290 P 070f92ae2f0740bb805749f3dbeb7703: Bootstrap starting.
I20260807 22:44:31.525434 22138 tablet_bootstrap.cc:492] T 254e5139a0b54ad78a18ff99565af290 P b30ce35e01ae4f879061b6358024a412: No bootstrap required, opened a new log
I20260807 22:44:31.525511 22138 ts_tablet_manager.cc:1397] T 254e5139a0b54ad78a18ff99565af290 P b30ce35e01ae4f879061b6358024a412: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260807 22:44:31.525964 22142 tablet_bootstrap.cc:654] T 254e5139a0b54ad78a18ff99565af290 P 070f92ae2f0740bb805749f3dbeb7703: Neither blocks nor log segments found. Creating new log.
I20260807 22:44:31.526454 22142 log.cc:824] T 254e5139a0b54ad78a18ff99565af290 P 070f92ae2f0740bb805749f3dbeb7703: Log is configured to *not* fsync() on all Append() calls
I20260807 22:44:31.527011 22138 raft_consensus.cc:348] T 254e5139a0b54ad78a18ff99565af290 P b30ce35e01ae4f879061b6358024a412 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b30ce35e01ae4f879061b6358024a412" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 39391 } } peers { permanent_uuid: "070f92ae2f0740bb805749f3dbeb7703" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37201 } } peers { permanent_uuid: "b12eb425ac1e404b9e51c20c995520a8" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 35499 } }
I20260807 22:44:31.527201 22138 raft_consensus.cc:374] T 254e5139a0b54ad78a18ff99565af290 P b30ce35e01ae4f879061b6358024a412 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:44:31.527242 22138 raft_consensus.cc:729] T 254e5139a0b54ad78a18ff99565af290 P b30ce35e01ae4f879061b6358024a412 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b30ce35e01ae4f879061b6358024a412, State: Initialized, Role: FOLLOWER
I20260807 22:44:31.527287 22142 tablet_bootstrap.cc:492] T 254e5139a0b54ad78a18ff99565af290 P 070f92ae2f0740bb805749f3dbeb7703: No bootstrap required, opened a new log
I20260807 22:44:31.527343 22142 ts_tablet_manager.cc:1397] T 254e5139a0b54ad78a18ff99565af290 P 070f92ae2f0740bb805749f3dbeb7703: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 22:44:31.527400 22138 consensus_queue.cc:260] T 254e5139a0b54ad78a18ff99565af290 P b30ce35e01ae4f879061b6358024a412 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b30ce35e01ae4f879061b6358024a412" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 39391 } } peers { permanent_uuid: "070f92ae2f0740bb805749f3dbeb7703" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37201 } } peers { permanent_uuid: "b12eb425ac1e404b9e51c20c995520a8" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 35499 } }
I20260807 22:44:31.527707 22138 ts_tablet_manager.cc:1428] T 254e5139a0b54ad78a18ff99565af290 P b30ce35e01ae4f879061b6358024a412: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260807 22:44:31.527747 21908 heartbeater.cc:503] Master 127.22.212.126:39383 was elected leader, sending a full tablet report...
I20260807 22:44:31.528385 22137 tablet_bootstrap.cc:492] T 254e5139a0b54ad78a18ff99565af290 P b12eb425ac1e404b9e51c20c995520a8: No bootstrap required, opened a new log
I20260807 22:44:31.528460 22137 ts_tablet_manager.cc:1397] T 254e5139a0b54ad78a18ff99565af290 P b12eb425ac1e404b9e51c20c995520a8: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260807 22:44:31.529184 22142 raft_consensus.cc:348] T 254e5139a0b54ad78a18ff99565af290 P 070f92ae2f0740bb805749f3dbeb7703 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b30ce35e01ae4f879061b6358024a412" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 39391 } } peers { permanent_uuid: "070f92ae2f0740bb805749f3dbeb7703" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37201 } } peers { permanent_uuid: "b12eb425ac1e404b9e51c20c995520a8" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 35499 } }
I20260807 22:44:31.529358 22142 raft_consensus.cc:374] T 254e5139a0b54ad78a18ff99565af290 P 070f92ae2f0740bb805749f3dbeb7703 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:44:31.529413 22142 raft_consensus.cc:729] T 254e5139a0b54ad78a18ff99565af290 P 070f92ae2f0740bb805749f3dbeb7703 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 070f92ae2f0740bb805749f3dbeb7703, State: Initialized, Role: FOLLOWER
I20260807 22:44:31.529521 22142 consensus_queue.cc:260] T 254e5139a0b54ad78a18ff99565af290 P 070f92ae2f0740bb805749f3dbeb7703 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b30ce35e01ae4f879061b6358024a412" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 39391 } } peers { permanent_uuid: "070f92ae2f0740bb805749f3dbeb7703" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37201 } } peers { permanent_uuid: "b12eb425ac1e404b9e51c20c995520a8" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 35499 } }
I20260807 22:44:31.529783 22142 ts_tablet_manager.cc:1428] T 254e5139a0b54ad78a18ff99565af290 P 070f92ae2f0740bb805749f3dbeb7703: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260807 22:44:31.529836 22113 heartbeater.cc:503] Master 127.22.212.126:39383 was elected leader, sending a full tablet report...
I20260807 22:44:31.530192 22137 raft_consensus.cc:348] T 254e5139a0b54ad78a18ff99565af290 P b12eb425ac1e404b9e51c20c995520a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b30ce35e01ae4f879061b6358024a412" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 39391 } } peers { permanent_uuid: "070f92ae2f0740bb805749f3dbeb7703" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37201 } } peers { permanent_uuid: "b12eb425ac1e404b9e51c20c995520a8" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 35499 } }
I20260807 22:44:31.530383 22137 raft_consensus.cc:374] T 254e5139a0b54ad78a18ff99565af290 P b12eb425ac1e404b9e51c20c995520a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:44:31.530424 22137 raft_consensus.cc:729] T 254e5139a0b54ad78a18ff99565af290 P b12eb425ac1e404b9e51c20c995520a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b12eb425ac1e404b9e51c20c995520a8, State: Initialized, Role: FOLLOWER
I20260807 22:44:31.530539 22137 consensus_queue.cc:260] T 254e5139a0b54ad78a18ff99565af290 P b12eb425ac1e404b9e51c20c995520a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b30ce35e01ae4f879061b6358024a412" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 39391 } } peers { permanent_uuid: "070f92ae2f0740bb805749f3dbeb7703" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37201 } } peers { permanent_uuid: "b12eb425ac1e404b9e51c20c995520a8" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 35499 } }
I20260807 22:44:31.530819 22137 ts_tablet_manager.cc:1428] T 254e5139a0b54ad78a18ff99565af290 P b12eb425ac1e404b9e51c20c995520a8: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 22:44:31.530961 21691 heartbeater.cc:503] Master 127.22.212.126:39383 was elected leader, sending a full tablet report...
W20260807 22:44:31.567368 21909 tablet.cc:2369] T 254e5139a0b54ad78a18ff99565af290 P b30ce35e01ae4f879061b6358024a412: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:44:31.608982 22144 raft_consensus.cc:482] T 254e5139a0b54ad78a18ff99565af290 P b30ce35e01ae4f879061b6358024a412 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:44:31.609135 22144 raft_consensus.cc:504] T 254e5139a0b54ad78a18ff99565af290 P b30ce35e01ae4f879061b6358024a412 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b30ce35e01ae4f879061b6358024a412" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 39391 } } peers { permanent_uuid: "070f92ae2f0740bb805749f3dbeb7703" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37201 } } peers { permanent_uuid: "b12eb425ac1e404b9e51c20c995520a8" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 35499 } }
I20260807 22:44:31.609488 22144 leader_election.cc:288] T 254e5139a0b54ad78a18ff99565af290 P b30ce35e01ae4f879061b6358024a412 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 070f92ae2f0740bb805749f3dbeb7703 (127.22.212.67:37201), b12eb425ac1e404b9e51c20c995520a8 (127.22.212.65:35499)
I20260807 22:44:31.612423 22134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:31.609757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:42611 (local address 127.22.212.65:35499)
0807 22:44:31.609802 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:31.609804 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:31.609980 (+ 176us) server_negotiation.cc:407] Connection header received
0807 22:44:31.610009 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:31.610010 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:31.610020 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:31.610070 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:44:31.610231 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:31.610674 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:31.611609 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:31.611999 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:31.612114 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:31.612124 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:31.612310 (+ 186us) server_negotiation.cc:299] Negotiation successful
0807 22:44:31.612344 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 22:44:31.612424 22136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:31.609707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:54237 (local address 127.22.212.67:37201)
0807 22:44:31.609759 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:31.609762 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:31.609866 (+ 104us) server_negotiation.cc:407] Connection header received
0807 22:44:31.609901 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:31.609902 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:31.609913 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:31.609978 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:44:31.610144 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:31.610666 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:31.611580 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:31.611976 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:31.612040 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:31.612048 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:31.612225 (+ 177us) server_negotiation.cc:299] Negotiation successful
0807 22:44:31.612320 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260807 22:44:31.612459 21911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:31.609642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.67:37201 (local address 127.22.212.66:54237)
0807 22:44:31.609746 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:31.609760 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:31.609815 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:31.609984 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:31.609985 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:31.609987 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:44:31.610069 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:31.610070 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:31.610752 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:31.610753 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:31.611490 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:31.611492 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:31.612057 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:31.612058 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:31.612142 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:31.612145 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:44:31.612217 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 22:44:31.612338 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":81}
I20260807 22:44:31.612468 22150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:31.609683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:35499 (local address 127.22.212.66:42611)
0807 22:44:31.609868 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:31.609880 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:31.609944 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:31.610077 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:31.610078 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:31.610079 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:44:31.610166 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:31.610167 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:31.610760 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:31.610761 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:31.611497 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:31.611499 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:31.612110 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:31.612111 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:31.612207 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:31.612212 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 22:44:31.612302 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 22:44:31.612341 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":121,"threads_started":1}
I20260807 22:44:31.612843 21617 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "254e5139a0b54ad78a18ff99565af290" candidate_uuid: "b30ce35e01ae4f879061b6358024a412" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b12eb425ac1e404b9e51c20c995520a8" is_pre_election: true
I20260807 22:44:31.612988 21617 raft_consensus.cc:2454] T 254e5139a0b54ad78a18ff99565af290 P b12eb425ac1e404b9e51c20c995520a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b30ce35e01ae4f879061b6358024a412 in term 0.
I20260807 22:44:31.613018 22043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "254e5139a0b54ad78a18ff99565af290" candidate_uuid: "b30ce35e01ae4f879061b6358024a412" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "070f92ae2f0740bb805749f3dbeb7703" is_pre_election: true
I20260807 22:44:31.613195 22043 raft_consensus.cc:2454] T 254e5139a0b54ad78a18ff99565af290 P 070f92ae2f0740bb805749f3dbeb7703 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b30ce35e01ae4f879061b6358024a412 in term 0.
I20260807 22:44:31.613227 21729 leader_election.cc:302] T 254e5139a0b54ad78a18ff99565af290 P b30ce35e01ae4f879061b6358024a412 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12eb425ac1e404b9e51c20c995520a8, b30ce35e01ae4f879061b6358024a412; no voters:
I20260807 22:44:31.613356 22144 raft_consensus.cc:2781] T 254e5139a0b54ad78a18ff99565af290 P b30ce35e01ae4f879061b6358024a412 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:44:31.613410 22144 raft_consensus.cc:482] T 254e5139a0b54ad78a18ff99565af290 P b30ce35e01ae4f879061b6358024a412 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:44:31.613438 22144 raft_consensus.cc:3037] T 254e5139a0b54ad78a18ff99565af290 P b30ce35e01ae4f879061b6358024a412 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:44:31.614131 22144 raft_consensus.cc:504] T 254e5139a0b54ad78a18ff99565af290 P b30ce35e01ae4f879061b6358024a412 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b30ce35e01ae4f879061b6358024a412" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 39391 } } peers { permanent_uuid: "070f92ae2f0740bb805749f3dbeb7703" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37201 } } peers { permanent_uuid: "b12eb425ac1e404b9e51c20c995520a8" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 35499 } }
I20260807 22:44:31.614269 22144 leader_election.cc:288] T 254e5139a0b54ad78a18ff99565af290 P b30ce35e01ae4f879061b6358024a412 [CANDIDATE]: Term 1 election: Requested vote from peers 070f92ae2f0740bb805749f3dbeb7703 (127.22.212.67:37201), b12eb425ac1e404b9e51c20c995520a8 (127.22.212.65:35499)
I20260807 22:44:31.614421 22043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "254e5139a0b54ad78a18ff99565af290" candidate_uuid: "b30ce35e01ae4f879061b6358024a412" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "070f92ae2f0740bb805749f3dbeb7703"
I20260807 22:44:31.614436 21617 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "254e5139a0b54ad78a18ff99565af290" candidate_uuid: "b30ce35e01ae4f879061b6358024a412" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b12eb425ac1e404b9e51c20c995520a8"
I20260807 22:44:31.614514 22043 raft_consensus.cc:3037] T 254e5139a0b54ad78a18ff99565af290 P 070f92ae2f0740bb805749f3dbeb7703 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:44:31.614511 21617 raft_consensus.cc:3037] T 254e5139a0b54ad78a18ff99565af290 P b12eb425ac1e404b9e51c20c995520a8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:44:31.615213 21617 raft_consensus.cc:2454] T 254e5139a0b54ad78a18ff99565af290 P b12eb425ac1e404b9e51c20c995520a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b30ce35e01ae4f879061b6358024a412 in term 1.
I20260807 22:44:31.615324 22043 raft_consensus.cc:2454] T 254e5139a0b54ad78a18ff99565af290 P 070f92ae2f0740bb805749f3dbeb7703 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b30ce35e01ae4f879061b6358024a412 in term 1.
I20260807 22:44:31.615370 21729 leader_election.cc:302] T 254e5139a0b54ad78a18ff99565af290 P b30ce35e01ae4f879061b6358024a412 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b12eb425ac1e404b9e51c20c995520a8, b30ce35e01ae4f879061b6358024a412; no voters:
I20260807 22:44:31.615455 22144 raft_consensus.cc:2781] T 254e5139a0b54ad78a18ff99565af290 P b30ce35e01ae4f879061b6358024a412 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:44:31.615602 22144 raft_consensus.cc:686] T 254e5139a0b54ad78a18ff99565af290 P b30ce35e01ae4f879061b6358024a412 [term 1 LEADER]: Becoming Leader. State: Replica: b30ce35e01ae4f879061b6358024a412, State: Running, Role: LEADER
I20260807 22:44:31.615694 22144 consensus_queue.cc:237] T 254e5139a0b54ad78a18ff99565af290 P b30ce35e01ae4f879061b6358024a412 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b30ce35e01ae4f879061b6358024a412" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 39391 } } peers { permanent_uuid: "070f92ae2f0740bb805749f3dbeb7703" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37201 } } peers { permanent_uuid: "b12eb425ac1e404b9e51c20c995520a8" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 35499 } }
I20260807 22:44:31.616499 21376 catalog_manager.cc:5495] T 254e5139a0b54ad78a18ff99565af290 P b30ce35e01ae4f879061b6358024a412 reported cstate change: term changed from 0 to 1, leader changed from <none> to b30ce35e01ae4f879061b6358024a412 (127.22.212.66). New cstate: current_term: 1 leader_uuid: "b30ce35e01ae4f879061b6358024a412" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b30ce35e01ae4f879061b6358024a412" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 39391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "070f92ae2f0740bb805749f3dbeb7703" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b12eb425ac1e404b9e51c20c995520a8" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 35499 } health_report { overall_health: UNKNOWN } } }
I20260807 22:44:31.634506 22131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:31.632079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50816 (local address 127.22.212.66:39391)
0807 22:44:31.632141 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:31.632143 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:31.632152 (+ 9us) server_negotiation.cc:407] Connection header received
0807 22:44:31.632191 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:31.632192 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:31.632209 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:31.632306 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:44:31.632443 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:31.632908 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:31.633734 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:31.633925 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:31.633996 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:31.634172 (+ 176us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:44:31.634271 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:44:31.634358 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:31.634397 (+ 39us) server_negotiation.cc:299] Negotiation successful
0807 22:44:31.634417 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 22:44:31.636529 21617 raft_consensus.cc:1261] T 254e5139a0b54ad78a18ff99565af290 P b12eb425ac1e404b9e51c20c995520a8 [term 1 FOLLOWER]: Refusing update from remote peer b30ce35e01ae4f879061b6358024a412: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:44:31.636528 22043 raft_consensus.cc:1261] T 254e5139a0b54ad78a18ff99565af290 P 070f92ae2f0740bb805749f3dbeb7703 [term 1 FOLLOWER]: Refusing update from remote peer b30ce35e01ae4f879061b6358024a412: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:44:31.636934 22152 consensus_queue.cc:1035] T 254e5139a0b54ad78a18ff99565af290 P b30ce35e01ae4f879061b6358024a412 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b12eb425ac1e404b9e51c20c995520a8" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:44:31.637094 22144 consensus_queue.cc:1035] T 254e5139a0b54ad78a18ff99565af290 P b30ce35e01ae4f879061b6358024a412 [LEADER]: Connected to new peer: Peer: permanent_uuid: "070f92ae2f0740bb805749f3dbeb7703" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 37201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:44:31.639611 22163 mvcc.cc:205] Tried to move back new op lower bound from 7316040383019548672 to 7316040382938349568. Current Snapshot: MvccSnapshot[applied={T|T < 7316040383019548672}]
I20260807 22:44:31.641402 22160 mvcc.cc:205] Tried to move back new op lower bound from 7316040383019548672 to 7316040382938349568. Current Snapshot: MvccSnapshot[applied={T|T < 7316040383019548672 or (T in {7316040383019548672})}]
I20260807 22:44:31.641696 21375 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47806:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:44:31.641783 21375 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47806:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:44:31.642655 21375 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6777df4bc9fd4e5ba463c9f886f7427e: Sending DeleteTablet for 3 replicas of tablet 254e5139a0b54ad78a18ff99565af290
I20260807 22:44:31.643051 21584 tablet_service.cc:1514] Processing DeleteTablet for tablet 254e5139a0b54ad78a18ff99565af290 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:44:31 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:51408
I20260807 22:44:31.643051 21799 tablet_service.cc:1514] Processing DeleteTablet for tablet 254e5139a0b54ad78a18ff99565af290 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:44:31 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:50810
I20260807 22:44:31.643170 22010 tablet_service.cc:1514] Processing DeleteTablet for tablet 254e5139a0b54ad78a18ff99565af290 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:44:31 UTC) from {username='kudu', principal='kudu/127.22.212.126@KRBTEST.COM'} at 127.0.0.1:41312
I20260807 22:44:31.643443 22181 tablet_replica.cc:330] T 254e5139a0b54ad78a18ff99565af290 P b30ce35e01ae4f879061b6358024a412: stopping tablet replica
I20260807 22:44:31.643466 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 21485
I20260807 22:44:31.656365 22181 raft_consensus.cc:2229] T 254e5139a0b54ad78a18ff99565af290 P b30ce35e01ae4f879061b6358024a412 [term 1 LEADER]: Raft consensus shutting down.
I20260807 22:44:31.656610 22181 raft_consensus.cc:2258] T 254e5139a0b54ad78a18ff99565af290 P b30ce35e01ae4f879061b6358024a412 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:44:31.656827 22182 tablet_replica.cc:330] T 254e5139a0b54ad78a18ff99565af290 P 070f92ae2f0740bb805749f3dbeb7703: stopping tablet replica
I20260807 22:44:31.656971 22182 raft_consensus.cc:2229] T 254e5139a0b54ad78a18ff99565af290 P 070f92ae2f0740bb805749f3dbeb7703 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:44:31.657152 22182 raft_consensus.cc:2258] T 254e5139a0b54ad78a18ff99565af290 P 070f92ae2f0740bb805749f3dbeb7703 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:44:31.657706 22182 ts_tablet_manager.cc:1905] T 254e5139a0b54ad78a18ff99565af290 P 070f92ae2f0740bb805749f3dbeb7703: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:44:31.660030 22182 ts_tablet_manager.cc:1918] T 254e5139a0b54ad78a18ff99565af290 P 070f92ae2f0740bb805749f3dbeb7703: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:44:31.660128 22182 log.cc:1196] T 254e5139a0b54ad78a18ff99565af290 P 070f92ae2f0740bb805749f3dbeb7703: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786142418640232-23377-0/minicluster-data/ts-2/wal/wals/254e5139a0b54ad78a18ff99565af290
I20260807 22:44:31.660481 22182 ts_tablet_manager.cc:1939] T 254e5139a0b54ad78a18ff99565af290 P 070f92ae2f0740bb805749f3dbeb7703: Deleting consensus metadata
I20260807 22:44:31.661048 21357 catalog_manager.cc:4841] TS 070f92ae2f0740bb805749f3dbeb7703 (127.22.212.67:37201): tablet 254e5139a0b54ad78a18ff99565af290 (table test-table [id=11c6e7e58a0747db9fee27c0137a13e1]) successfully deleted
W20260807 22:44:31.662148 21355 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.212.65:35499 (error 108)
I20260807 22:44:31.662724 22135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:31.662590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:35499 (local address 127.0.0.1:51410)
0807 22:44:31.662640 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:31.662682 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.65:35499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260807 22:44:31.662875 22181 ts_tablet_manager.cc:1905] T 254e5139a0b54ad78a18ff99565af290 P b30ce35e01ae4f879061b6358024a412: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260807 22:44:31.662878 21355 catalog_manager.cc:4584] TS b12eb425ac1e404b9e51c20c995520a8 (127.22.212.65:35499): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 254e5139a0b54ad78a18ff99565af290: Network error: Client connection negotiation failed: client connection to 127.22.212.65:35499: connect: Connection refused (error 111)
I20260807 22:44:31.662914 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 21698
I20260807 22:44:31.675462 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 21917
I20260807 22:44:31.675498 22135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:31.675361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.66:39391 (local address 127.0.0.1:50828)
0807 22:44:31.675423 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:31.675453 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.66:39391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260807 22:44:31.686661 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 21329
2026-08-07T22:44:31Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2303 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-07T22:44:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:44:31Z Disabled control of system clock
I20260807 22:44:31.725312 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:42149
--webserver_interface=127.22.212.126
--webserver_port=0
--builtin_ntp_servers=127.22.212.84:41623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:42149
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 22:44:31.808156 22187 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:44:31.808395 22187 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:44:31.808418 22187 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:44:31.809523 22187 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:44:31.809561 22187 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:44:31.809574 22187 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:44:31.809587 22187 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:44:31.809599 22187 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:44:31.810887 22187 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:41623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:42149
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:42149
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22187
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:44:31.811096 22187 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:44:31.811347 22187 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:44:31.816488 22198 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:31.816504 22201 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:31.816620 22187 server_base.cc:1034] running on GCE node
W20260807 22:44:31.816651 22199 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:31.817052 22187 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:44:31.817342 22187 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:44:31.818538 22187 hybrid_clock.cc:648] HybridClock initialized: now 1786142671818517 us; error 37 us; skew 500 ppm
I20260807 22:44:31.819833 22187 webserver.cc:460] Webserver started at http://127.22.212.126:36091/ using document root <none> and password file <none>
I20260807 22:44:31.820107 22187 fs_manager.cc:359] Metadata directory not provided
I20260807 22:44:31.820158 22187 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:44:31.820365 22187 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:44:31.821480 22187 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "28233e0f9dd3424ba5302bb8185bd138"
format_stamp: "Formatted at 2026-08-07 22:44:31 on dist-test-slave-2d19"
server_key: "9bf4f35c623bcaaeeb872add6c57c220"
server_key_iv: "5d204eddcc932e1c6b2e9c54b890f909"
server_key_version: "encryptionkey@0"
I20260807 22:44:31.821863 22187 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "28233e0f9dd3424ba5302bb8185bd138"
format_stamp: "Formatted at 2026-08-07 22:44:31 on dist-test-slave-2d19"
server_key: "9bf4f35c623bcaaeeb872add6c57c220"
server_key_iv: "5d204eddcc932e1c6b2e9c54b890f909"
server_key_version: "encryptionkey@0"
I20260807 22:44:31.823266 22187 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 22:44:31.823988 22214 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:31.824160 22187 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 22:44:31.824239 22187 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "28233e0f9dd3424ba5302bb8185bd138"
format_stamp: "Formatted at 2026-08-07 22:44:31 on dist-test-slave-2d19"
server_key: "9bf4f35c623bcaaeeb872add6c57c220"
server_key_iv: "5d204eddcc932e1c6b2e9c54b890f909"
server_key_version: "encryptionkey@0"
I20260807 22:44:31.824333 22187 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:44:31.840482 22187 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:44:31.840814 22187 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:44:31.840971 22187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:44:31.845189 22187 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:42149
I20260807 22:44:31.845276 22300 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:42149 every 8 connection(s)
I20260807 22:44:31.845613 22187 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:44:31.846644 22301 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:44:31.849054 22301 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 28233e0f9dd3424ba5302bb8185bd138: Bootstrap starting.
I20260807 22:44:31.849725 22301 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 28233e0f9dd3424ba5302bb8185bd138: Neither blocks nor log segments found. Creating new log.
I20260807 22:44:31.849750 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 22187
I20260807 22:44:31.849845 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:44:31.850075 23377 external_mini_cluster.cc:1428] Setting key b1ded9764811e084c1ad00f7467de80a
I20260807 22:44:31.850107 22301 log.cc:824] T 00000000000000000000000000000000 P 28233e0f9dd3424ba5302bb8185bd138: Log is configured to *not* fsync() on all Append() calls
I20260807 22:44:31.850931 22301 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 28233e0f9dd3424ba5302bb8185bd138: No bootstrap required, opened a new log
I20260807 22:44:31.853204 22301 raft_consensus.cc:348] T 00000000000000000000000000000000 P 28233e0f9dd3424ba5302bb8185bd138 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28233e0f9dd3424ba5302bb8185bd138" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 42149 } }
I20260807 22:44:31.853423 22301 raft_consensus.cc:374] T 00000000000000000000000000000000 P 28233e0f9dd3424ba5302bb8185bd138 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:44:31.853478 22301 raft_consensus.cc:729] T 00000000000000000000000000000000 P 28233e0f9dd3424ba5302bb8185bd138 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28233e0f9dd3424ba5302bb8185bd138, State: Initialized, Role: FOLLOWER
I20260807 22:44:31.853646 22301 consensus_queue.cc:260] T 00000000000000000000000000000000 P 28233e0f9dd3424ba5302bb8185bd138 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28233e0f9dd3424ba5302bb8185bd138" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 42149 } }
I20260807 22:44:31.853720 22301 raft_consensus.cc:388] T 00000000000000000000000000000000 P 28233e0f9dd3424ba5302bb8185bd138 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:44:31.853747 22301 raft_consensus.cc:482] T 00000000000000000000000000000000 P 28233e0f9dd3424ba5302bb8185bd138 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:44:31.853789 22301 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 28233e0f9dd3424ba5302bb8185bd138 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:44:31.854416 22301 raft_consensus.cc:504] T 00000000000000000000000000000000 P 28233e0f9dd3424ba5302bb8185bd138 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28233e0f9dd3424ba5302bb8185bd138" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 42149 } }
I20260807 22:44:31.854543 22301 leader_election.cc:302] T 00000000000000000000000000000000 P 28233e0f9dd3424ba5302bb8185bd138 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 28233e0f9dd3424ba5302bb8185bd138; no voters:
I20260807 22:44:31.854725 22301 leader_election.cc:288] T 00000000000000000000000000000000 P 28233e0f9dd3424ba5302bb8185bd138 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:44:31.854764 22309 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 28233e0f9dd3424ba5302bb8185bd138 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:44:31.854887 22309 raft_consensus.cc:686] T 00000000000000000000000000000000 P 28233e0f9dd3424ba5302bb8185bd138 [term 1 LEADER]: Becoming Leader. State: Replica: 28233e0f9dd3424ba5302bb8185bd138, State: Running, Role: LEADER
I20260807 22:44:31.854977 22309 consensus_queue.cc:237] T 00000000000000000000000000000000 P 28233e0f9dd3424ba5302bb8185bd138 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28233e0f9dd3424ba5302bb8185bd138" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 42149 } }
I20260807 22:44:31.855027 22301 sys_catalog.cc:564] T 00000000000000000000000000000000 P 28233e0f9dd3424ba5302bb8185bd138 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:44:31.855332 22311 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28233e0f9dd3424ba5302bb8185bd138 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "28233e0f9dd3424ba5302bb8185bd138" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28233e0f9dd3424ba5302bb8185bd138" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 42149 } } }
I20260807 22:44:31.855424 22311 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28233e0f9dd3424ba5302bb8185bd138 [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:31.855608 22312 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28233e0f9dd3424ba5302bb8185bd138 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 28233e0f9dd3424ba5302bb8185bd138. Latest consensus state: current_term: 1 leader_uuid: "28233e0f9dd3424ba5302bb8185bd138" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28233e0f9dd3424ba5302bb8185bd138" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 42149 } } }
I20260807 22:44:31.855675 22312 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28233e0f9dd3424ba5302bb8185bd138 [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:31.855787 22325 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:44:31.856329 22325 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:44:31.857362 22306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:31.850633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57496 (local address 127.22.212.126:42149)
0807 22:44:31.850854 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:31.850863 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:31.850895 (+ 32us) server_negotiation.cc:407] Connection header received
0807 22:44:31.851462 (+ 567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:31.851472 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:31.851553 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:31.851705 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:31.851902 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:31.853942 (+ 2040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:31.854857 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:31.855473 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:31.855594 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:31.856605 (+ 1011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:31.856609 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:31.856609 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:44:31.856798 (+ 189us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:31.856833 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:44:31.856844 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:31.856931 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:31.857090 (+ 159us) server_negotiation.cc:299] Negotiation successful
0807 22:44:31.857181 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":87,"threads_started":1}
I20260807 22:44:31.858474 22325 catalog_manager.cc:1347] Generated new cluster ID: d618524326af466bba46b6e2a7caa44e
I20260807 22:44:31.858534 22325 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:44:31.897308 22325 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:44:31.897888 22325 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:44:31.903118 22325 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 28233e0f9dd3424ba5302bb8185bd138: Generated new TSK 0
I20260807 22:44:31.903314 22325 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:44:31.909919 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.65:0
--local_ip_for_outbound_sockets=127.22.212.65
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:42149
--builtin_ntp_servers=127.22.212.84:41623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 22:44:32.018676 22346 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:44:32.018893 22346 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:44:32.018915 22346 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:44:32.020084 22346 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:44:32.020126 22346 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:44:32.020151 22346 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.65
I20260807 22:44:32.021530 22346 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:41623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.212.65
--webserver_port=0
--tserver_master_addrs=127.22.212.126:42149
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22346
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.65
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:44:32.021782 22346 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:44:32.022100 22346 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:44:32.027264 22362 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:32.027258 22360 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:32.027264 22359 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:32.027379 22346 server_base.cc:1034] running on GCE node
I20260807 22:44:32.027810 22346 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:44:32.028060 22346 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:44:32.029241 22346 hybrid_clock.cc:648] HybridClock initialized: now 1786142672029225 us; error 31 us; skew 500 ppm
I20260807 22:44:32.030437 22346 webserver.cc:460] Webserver started at http://127.22.212.65:33337/ using document root <none> and password file <none>
I20260807 22:44:32.030637 22346 fs_manager.cc:359] Metadata directory not provided
I20260807 22:44:32.030678 22346 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:44:32.030771 22346 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:44:32.031788 22346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-0/data/instance:
uuid: "152eccf354de431494f0a3d05aae41a5"
format_stamp: "Formatted at 2026-08-07 22:44:32 on dist-test-slave-2d19"
server_key: "e237e2ac2d41c2a545e291ea5db1c9c4"
server_key_iv: "6fe5ffe50985038b3cea24f3f27f583f"
server_key_version: "encryptionkey@0"
I20260807 22:44:32.032176 22346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance:
uuid: "152eccf354de431494f0a3d05aae41a5"
format_stamp: "Formatted at 2026-08-07 22:44:32 on dist-test-slave-2d19"
server_key: "e237e2ac2d41c2a545e291ea5db1c9c4"
server_key_iv: "6fe5ffe50985038b3cea24f3f27f583f"
server_key_version: "encryptionkey@0"
I20260807 22:44:32.033505 22346 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 22:44:32.034224 22370 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:32.034415 22346 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 22:44:32.034510 22346 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-0/wal
uuid: "152eccf354de431494f0a3d05aae41a5"
format_stamp: "Formatted at 2026-08-07 22:44:32 on dist-test-slave-2d19"
server_key: "e237e2ac2d41c2a545e291ea5db1c9c4"
server_key_iv: "6fe5ffe50985038b3cea24f3f27f583f"
server_key_version: "encryptionkey@0"
I20260807 22:44:32.034567 22346 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:44:32.051739 22346 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:44:32.052021 22346 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:44:32.052131 22346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:44:32.052374 22346 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:44:32.052731 22346 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:44:32.052767 22346 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:32.052806 22346 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:44:32.052832 22346 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:32.058701 22346 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.65:42521
I20260807 22:44:32.058782 22543 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.65:42521 every 8 connection(s)
I20260807 22:44:32.059113 22346 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-0/data/info.pb
I20260807 22:44:32.064122 22306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:32.059855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:54571 (local address 127.22.212.126:42149)
0807 22:44:32.059927 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:32.059930 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:32.060191 (+ 261us) server_negotiation.cc:407] Connection header received
0807 22:44:32.060707 (+ 516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:32.060708 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:32.060720 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:32.060776 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:32.061407 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:32.061893 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:32.062839 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:32.063026 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:32.063081 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:32.063848 (+ 767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:32.063850 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:32.063850 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:44:32.063854 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:32.063866 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:44:32.063870 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:32.063914 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:32.064033 (+ 119us) server_negotiation.cc:299] Negotiation successful
0807 22:44:32.064055 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260807 22:44:32.064318 22546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:32.059848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:42149 (local address 127.22.212.65:54571)
0807 22:44:32.060069 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:32.060104 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:32.060611 (+ 507us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:32.060830 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:32.060834 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:32.060843 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:44:32.061331 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:32.061336 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:32.061978 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:32.061979 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:32.062759 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:32.062761 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:32.063107 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:32.063108 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:32.063216 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:32.063709 (+ 493us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:44:32.063710 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:44:32.063738 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:44:32.063760 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:44:32.063929 (+ 169us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:44:32.063932 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:44:32.063935 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:44:32.063990 (+ 55us) client_negotiation.cc:240] Negotiation successful
0807 22:44:32.064079 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":108,"threads_started":1}
I20260807 22:44:32.064788 22544 heartbeater.cc:347] Connected to a master server at 127.22.212.126:42149
I20260807 22:44:32.064881 22544 heartbeater.cc:464] Registering TS with master...
I20260807 22:44:32.065032 22544 heartbeater.cc:511] Master 127.22.212.126:42149 requested a full tablet report, sending...
I20260807 22:44:32.065552 22241 ts_manager.cc:194] Registered new tserver with Master: 152eccf354de431494f0a3d05aae41a5 (127.22.212.65:42521)
I20260807 22:44:32.066190 22241 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.212.65:54571
I20260807 22:44:32.066852 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 22346
I20260807 22:44:32.066956 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-0/wal/instance
I20260807 22:44:32.067206 23377 external_mini_cluster.cc:1428] Setting key c81dc886076be88f6fc8bbc0779be3ee
I20260807 22:44:32.068075 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.66:0
--local_ip_for_outbound_sockets=127.22.212.66
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:42149
--builtin_ntp_servers=127.22.212.84:41623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 22:44:32.153600 22547 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:44:32.153813 22547 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:44:32.153836 22547 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:44:32.154990 22547 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:44:32.155028 22547 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:44:32.155053 22547 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.66
I20260807 22:44:32.156558 22547 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:41623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.212.66
--webserver_port=0
--tserver_master_addrs=127.22.212.126:42149
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22547
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.66
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:44:32.156756 22547 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:44:32.157064 22547 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:44:32.162325 22554 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:32.162321 22558 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:32.162711 22547 server_base.cc:1034] running on GCE node
W20260807 22:44:32.162319 22555 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:32.163050 22547 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:44:32.163321 22547 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:44:32.164485 22547 hybrid_clock.cc:648] HybridClock initialized: now 1786142672164465 us; error 37 us; skew 500 ppm
I20260807 22:44:32.165890 22547 webserver.cc:460] Webserver started at http://127.22.212.66:42409/ using document root <none> and password file <none>
I20260807 22:44:32.166147 22547 fs_manager.cc:359] Metadata directory not provided
I20260807 22:44:32.166198 22547 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:44:32.166373 22547 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:44:32.167476 22547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-1/data/instance:
uuid: "f43841402438471d9050ae9a37336e99"
format_stamp: "Formatted at 2026-08-07 22:44:32 on dist-test-slave-2d19"
server_key: "bd00d64e1a5856533c906717dd6bf4bb"
server_key_iv: "93a9b8d480b4f74d8e78f14f7e31a18b"
server_key_version: "encryptionkey@0"
I20260807 22:44:32.167850 22547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance:
uuid: "f43841402438471d9050ae9a37336e99"
format_stamp: "Formatted at 2026-08-07 22:44:32 on dist-test-slave-2d19"
server_key: "bd00d64e1a5856533c906717dd6bf4bb"
server_key_iv: "93a9b8d480b4f74d8e78f14f7e31a18b"
server_key_version: "encryptionkey@0"
I20260807 22:44:32.169366 22547 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 22:44:32.170217 22568 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:32.170437 22547 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 22:44:32.170519 22547 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-1/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-1/wal
uuid: "f43841402438471d9050ae9a37336e99"
format_stamp: "Formatted at 2026-08-07 22:44:32 on dist-test-slave-2d19"
server_key: "bd00d64e1a5856533c906717dd6bf4bb"
server_key_iv: "93a9b8d480b4f74d8e78f14f7e31a18b"
server_key_version: "encryptionkey@0"
I20260807 22:44:32.170611 22547 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:44:32.182548 22547 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:44:32.182873 22547 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:44:32.183022 22547 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:44:32.183255 22547 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:44:32.183629 22547 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:44:32.183688 22547 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:32.183743 22547 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:44:32.183770 22547 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:32.189747 22547 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.66:46709
I20260807 22:44:32.189795 22758 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.66:46709 every 8 connection(s)
I20260807 22:44:32.190135 22547 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-1/data/info.pb
I20260807 22:44:32.193930 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 22547
I20260807 22:44:32.194041 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-1/wal/instance
I20260807 22:44:32.194247 23377 external_mini_cluster.cc:1428] Setting key 972afc6430727c7916ba4d3df741de91
I20260807 22:44:32.195387 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.212.67:0
--local_ip_for_outbound_sockets=127.22.212.67
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:42149
--builtin_ntp_servers=127.22.212.84:41623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 22:44:32.196135 22306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:32.190932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.66:41701 (local address 127.22.212.126:42149)
0807 22:44:32.191034 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:32.191036 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:32.191249 (+ 213us) server_negotiation.cc:407] Connection header received
0807 22:44:32.191808 (+ 559us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:32.191810 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:32.191823 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:32.191901 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:32.192695 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:32.193203 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:32.194520 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:32.194798 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:32.194869 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:32.195816 (+ 947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:32.195818 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:32.195818 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:44:32.195824 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:32.195841 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:44:32.195846 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:32.195908 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:32.195986 (+ 78us) server_negotiation.cc:299] Negotiation successful
0807 22:44:32.196014 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260807 22:44:32.196295 22764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:32.190856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:42149 (local address 127.22.212.66:41701)
0807 22:44:32.191119 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:32.191156 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:32.191697 (+ 541us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:32.191984 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:32.191989 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:32.191998 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:44:32.192600 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:32.192605 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:32.193301 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:32.193302 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:32.194404 (+ 1102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:32.194407 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:32.194894 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:32.194895 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:32.195066 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:32.195670 (+ 604us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:44:32.195670 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:44:32.195700 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:44:32.195725 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:44:32.195918 (+ 193us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:44:32.195924 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:44:32.195928 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 22:44:32.195986 (+ 58us) client_negotiation.cc:240] Negotiation successful
0807 22:44:32.196072 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":94,"threads_started":1}
I20260807 22:44:32.196762 22759 heartbeater.cc:347] Connected to a master server at 127.22.212.126:42149
I20260807 22:44:32.196868 22759 heartbeater.cc:464] Registering TS with master...
I20260807 22:44:32.197069 22759 heartbeater.cc:511] Master 127.22.212.126:42149 requested a full tablet report, sending...
I20260807 22:44:32.197503 22241 ts_manager.cc:194] Registered new tserver with Master: f43841402438471d9050ae9a37336e99 (127.22.212.66:46709)
I20260807 22:44:32.197880 22241 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.212.66:41701
W20260807 22:44:32.279963 22765 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:44:32.280177 22765 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:44:32.280200 22765 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:44:32.281361 22765 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:44:32.281404 22765 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:44:32.281451 22765 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.212.67
I20260807 22:44:32.282810 22765 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:41623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.212.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.212.67
--webserver_port=0
--tserver_master_addrs=127.22.212.126:42149
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22765
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.212.67
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:44:32.283108 22765 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:44:32.283448 22765 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:44:32.288537 22776 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:32.288544 22771 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:32.288552 22772 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:32.288751 22765 server_base.cc:1034] running on GCE node
I20260807 22:44:32.288938 22765 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:44:32.289129 22765 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:44:32.290284 22765 hybrid_clock.cc:648] HybridClock initialized: now 1786142672290266 us; error 29 us; skew 500 ppm
I20260807 22:44:32.291512 22765 webserver.cc:460] Webserver started at http://127.22.212.67:38823/ using document root <none> and password file <none>
I20260807 22:44:32.291767 22765 fs_manager.cc:359] Metadata directory not provided
I20260807 22:44:32.291833 22765 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:44:32.291987 22765 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:44:32.293128 22765 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-2/data/instance:
uuid: "b4f4f134cf8b462f8b422b846aa0e474"
format_stamp: "Formatted at 2026-08-07 22:44:32 on dist-test-slave-2d19"
server_key: "7629b866b50332806cb33a09f8b3ab18"
server_key_iv: "302755f9731dfdcc0f974e6e99aa68b4"
server_key_version: "encryptionkey@0"
I20260807 22:44:32.293484 22765 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance:
uuid: "b4f4f134cf8b462f8b422b846aa0e474"
format_stamp: "Formatted at 2026-08-07 22:44:32 on dist-test-slave-2d19"
server_key: "7629b866b50332806cb33a09f8b3ab18"
server_key_iv: "302755f9731dfdcc0f974e6e99aa68b4"
server_key_version: "encryptionkey@0"
I20260807 22:44:32.294835 22765 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260807 22:44:32.295545 22787 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:32.295712 22765 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 22:44:32.295819 22765 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-2/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-2/wal
uuid: "b4f4f134cf8b462f8b422b846aa0e474"
format_stamp: "Formatted at 2026-08-07 22:44:32 on dist-test-slave-2d19"
server_key: "7629b866b50332806cb33a09f8b3ab18"
server_key_iv: "302755f9731dfdcc0f974e6e99aa68b4"
server_key_version: "encryptionkey@0"
I20260807 22:44:32.295892 22765 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:44:32.322250 22765 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:44:32.322582 22765 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:44:32.322734 22765 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:44:32.322960 22765 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 22:44:32.323298 22765 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 22:44:32.323350 22765 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:32.323393 22765 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 22:44:32.323428 22765 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:32.329253 22765 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.67:34193
I20260807 22:44:32.329326 22977 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.67:34193 every 8 connection(s)
I20260807 22:44:32.329663 22765 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-2/data/info.pb
I20260807 22:44:32.331522 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 22765
I20260807 22:44:32.331632 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-2/wal/instance
I20260807 22:44:32.331807 23377 external_mini_cluster.cc:1428] Setting key 5c03924c9f2918aa46991023d2998132
I20260807 22:44:32.334836 22306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:32.330394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.67:51387 (local address 127.22.212.126:42149)
0807 22:44:32.330461 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:32.330463 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:32.330711 (+ 248us) server_negotiation.cc:407] Connection header received
0807 22:44:32.331197 (+ 486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:32.331198 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:32.331210 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:32.331253 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:32.332082 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:32.332763 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:32.333687 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:32.333865 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:32.333912 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:32.334643 (+ 731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:32.334644 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:32.334644 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:44:32.334648 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:32.334662 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:44:32.334666 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:32.334707 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:32.334756 (+ 49us) server_negotiation.cc:299] Negotiation successful
0807 22:44:32.334777 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 22:44:32.335107 22981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:32.330395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:42149 (local address 127.22.212.67:51387)
0807 22:44:32.330594 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:32.330628 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:32.331104 (+ 476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:32.331334 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:32.331337 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:32.331346 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:44:32.331960 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:32.331966 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:32.332842 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:32.332843 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:32.333609 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:32.333612 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:32.333933 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:32.333934 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:32.334065 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:32.334521 (+ 456us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 22:44:32.334521 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:44:32.334549 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 22:44:32.334570 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:44:32.334708 (+ 138us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:44:32.334710 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:44:32.334712 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 22:44:32.334758 (+ 46us) client_negotiation.cc:240] Negotiation successful
0807 22:44:32.334830 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":85,"threads_started":1}
I20260807 22:44:32.335584 22978 heartbeater.cc:347] Connected to a master server at 127.22.212.126:42149
I20260807 22:44:32.335683 22978 heartbeater.cc:464] Registering TS with master...
I20260807 22:44:32.335853 22978 heartbeater.cc:511] Master 127.22.212.126:42149 requested a full tablet report, sending...
I20260807 22:44:32.336217 22241 ts_manager.cc:194] Registered new tserver with Master: b4f4f134cf8b462f8b422b846aa0e474 (127.22.212.67:34193)
I20260807 22:44:32.336609 22241 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.212.67:51387
I20260807 22:44:32.343667 23377 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 22:44:32.347878 22306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:32.345164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57508 (local address 127.22.212.126:42149)
0807 22:44:32.345219 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:32.345221 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:32.345339 (+ 118us) server_negotiation.cc:407] Connection header received
0807 22:44:32.345393 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:32.345394 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:32.345402 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:32.345453 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:32.345597 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:32.346074 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:32.346826 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:32.347028 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:32.347083 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:32.347676 (+ 593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:32.347677 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:32.347677 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:44:32.347681 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:32.347694 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:44:32.347698 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:32.347740 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:32.347785 (+ 45us) server_negotiation.cc:299] Negotiation successful
0807 22:44:32.347804 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260807 22:44:32.349525 22241 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57508:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 22:44:32.351068 22241 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 22:44:32.357818 22997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:32.353330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41982 (local address 127.22.212.67:34193)
0807 22:44:32.353670 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:32.353673 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:32.353681 (+ 8us) server_negotiation.cc:407] Connection header received
0807 22:44:32.353721 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:32.353723 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:32.353739 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:32.354019 (+ 280us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:44:32.354080 (+ 61us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:32.355140 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:32.356792 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:32.357489 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:32.357564 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:32.357651 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:32.357727 (+ 76us) server_negotiation.cc:299] Negotiation successful
0807 22:44:32.357756 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":86,"threads_started":1}
I20260807 22:44:32.357811 22996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:32.353233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.67:34193 (local address 127.0.0.1:41982)
0807 22:44:32.353423 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:32.353468 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:32.353537 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:32.353847 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:32.353850 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:32.353853 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:44:32.353924 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:32.353928 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:32.355226 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:32.355227 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:32.356641 (+ 1414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:32.356644 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:32.357588 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:32.357589 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:32.357643 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:32.357646 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:44:32.357707 (+ 61us) client_negotiation.cc:240] Negotiation successful
0807 22:44:32.357733 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"mutex_wait_us":58,"thread_start_us":77,"threads_started":1}
I20260807 22:44:32.358059 22993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:32.353268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.66:46709 (local address 127.0.0.1:46778)
0807 22:44:32.353584 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:32.353595 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:32.353659 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:32.353882 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:32.353882 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:32.353884 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:44:32.353924 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:32.353925 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:32.355278 (+ 1353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:32.355280 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:32.356504 (+ 1224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:32.356506 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:32.357845 (+ 1339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:32.357846 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:32.357904 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:32.357907 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:44:32.357960 (+ 53us) client_negotiation.cc:240] Negotiation successful
0807 22:44:32.357998 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"mutex_wait_us":60,"thread_start_us":74,"threads_started":1}
I20260807 22:44:32.358352 22998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:32.353384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46778 (local address 127.22.212.66:46709)
0807 22:44:32.353581 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:32.353586 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:32.353647 (+ 61us) server_negotiation.cc:407] Connection header received
0807 22:44:32.353724 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:32.353726 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:32.353739 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:32.353816 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:44:32.354008 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:32.355216 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:32.356768 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:32.357489 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:32.357567 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:32.357650 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:32.358218 (+ 568us) server_negotiation.cc:299] Negotiation successful
0807 22:44:32.358259 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":113,"threads_started":1}
I20260807 22:44:32.358376 23000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:32.353655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58670 (local address 127.22.212.65:42521)
0807 22:44:32.353832 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:32.353837 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:32.353985 (+ 148us) server_negotiation.cc:407] Connection header received
0807 22:44:32.354032 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:32.354035 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:32.354050 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:32.354122 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:44:32.354299 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:32.355176 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:32.356742 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:32.357248 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:32.357337 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:32.357438 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:32.357949 (+ 511us) server_negotiation.cc:299] Negotiation successful
0807 22:44:32.357993 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":107,"threads_started":1}
I20260807 22:44:32.357812 22999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:32.353460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:42521 (local address 127.0.0.1:58670)
0807 22:44:32.353845 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:32.353874 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:32.353926 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:32.354185 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:32.354185 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:32.354187 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:44:32.354228 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:32.354229 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:32.355269 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:32.355270 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:32.356641 (+ 1371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:32.356644 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:32.357475 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:32.357481 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:32.357582 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:32.357598 (+ 16us) client_negotiation.cc:769] Sending connection context
0807 22:44:32.357665 (+ 67us) client_negotiation.cc:240] Negotiation successful
0807 22:44:32.357722 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":374,"mutex_wait_us":81,"thread_start_us":57,"threads_started":1}
I20260807 22:44:32.358677 22867 tablet_service.cc:1467] Processing CreateTablet for tablet 4043c8c6b45f4d1daaee49b4c314221b (DEFAULT_TABLE table=test-table [id=beabb46a8e3b4c61ba533dc2a08e54e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:44:32.359063 22867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4043c8c6b45f4d1daaee49b4c314221b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:44:32.359093 22654 tablet_service.cc:1467] Processing CreateTablet for tablet 4043c8c6b45f4d1daaee49b4c314221b (DEFAULT_TABLE table=test-table [id=beabb46a8e3b4c61ba533dc2a08e54e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:44:32.359365 22654 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4043c8c6b45f4d1daaee49b4c314221b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:44:32.360988 22444 tablet_service.cc:1467] Processing CreateTablet for tablet 4043c8c6b45f4d1daaee49b4c314221b (DEFAULT_TABLE table=test-table [id=beabb46a8e3b4c61ba533dc2a08e54e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 22:44:32.361356 22444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4043c8c6b45f4d1daaee49b4c314221b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:44:32.362267 23003 tablet_bootstrap.cc:492] T 4043c8c6b45f4d1daaee49b4c314221b P b4f4f134cf8b462f8b422b846aa0e474: Bootstrap starting.
I20260807 22:44:32.362843 23003 tablet_bootstrap.cc:654] T 4043c8c6b45f4d1daaee49b4c314221b P b4f4f134cf8b462f8b422b846aa0e474: Neither blocks nor log segments found. Creating new log.
I20260807 22:44:32.363065 23003 log.cc:824] T 4043c8c6b45f4d1daaee49b4c314221b P b4f4f134cf8b462f8b422b846aa0e474: Log is configured to *not* fsync() on all Append() calls
I20260807 22:44:32.363723 23003 tablet_bootstrap.cc:492] T 4043c8c6b45f4d1daaee49b4c314221b P b4f4f134cf8b462f8b422b846aa0e474: No bootstrap required, opened a new log
I20260807 22:44:32.363767 23003 ts_tablet_manager.cc:1397] T 4043c8c6b45f4d1daaee49b4c314221b P b4f4f134cf8b462f8b422b846aa0e474: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 22:44:32.364216 23007 tablet_bootstrap.cc:492] T 4043c8c6b45f4d1daaee49b4c314221b P 152eccf354de431494f0a3d05aae41a5: Bootstrap starting.
I20260807 22:44:32.364763 23002 tablet_bootstrap.cc:492] T 4043c8c6b45f4d1daaee49b4c314221b P f43841402438471d9050ae9a37336e99: Bootstrap starting.
I20260807 22:44:32.364923 23007 tablet_bootstrap.cc:654] T 4043c8c6b45f4d1daaee49b4c314221b P 152eccf354de431494f0a3d05aae41a5: Neither blocks nor log segments found. Creating new log.
I20260807 22:44:32.365267 23007 log.cc:824] T 4043c8c6b45f4d1daaee49b4c314221b P 152eccf354de431494f0a3d05aae41a5: Log is configured to *not* fsync() on all Append() calls
I20260807 22:44:32.365630 23002 tablet_bootstrap.cc:654] T 4043c8c6b45f4d1daaee49b4c314221b P f43841402438471d9050ae9a37336e99: Neither blocks nor log segments found. Creating new log.
I20260807 22:44:32.365882 23003 raft_consensus.cc:348] T 4043c8c6b45f4d1daaee49b4c314221b P b4f4f134cf8b462f8b422b846aa0e474 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4f4f134cf8b462f8b422b846aa0e474" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 34193 } } peers { permanent_uuid: "152eccf354de431494f0a3d05aae41a5" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 42521 } } peers { permanent_uuid: "f43841402438471d9050ae9a37336e99" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46709 } }
I20260807 22:44:32.365965 23002 log.cc:824] T 4043c8c6b45f4d1daaee49b4c314221b P f43841402438471d9050ae9a37336e99: Log is configured to *not* fsync() on all Append() calls
I20260807 22:44:32.366039 23003 raft_consensus.cc:374] T 4043c8c6b45f4d1daaee49b4c314221b P b4f4f134cf8b462f8b422b846aa0e474 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:44:32.366083 23003 raft_consensus.cc:729] T 4043c8c6b45f4d1daaee49b4c314221b P b4f4f134cf8b462f8b422b846aa0e474 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4f4f134cf8b462f8b422b846aa0e474, State: Initialized, Role: FOLLOWER
I20260807 22:44:32.366161 23007 tablet_bootstrap.cc:492] T 4043c8c6b45f4d1daaee49b4c314221b P 152eccf354de431494f0a3d05aae41a5: No bootstrap required, opened a new log
I20260807 22:44:32.366240 23007 ts_tablet_manager.cc:1397] T 4043c8c6b45f4d1daaee49b4c314221b P 152eccf354de431494f0a3d05aae41a5: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 22:44:32.366218 23003 consensus_queue.cc:260] T 4043c8c6b45f4d1daaee49b4c314221b P b4f4f134cf8b462f8b422b846aa0e474 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4f4f134cf8b462f8b422b846aa0e474" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 34193 } } peers { permanent_uuid: "152eccf354de431494f0a3d05aae41a5" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 42521 } } peers { permanent_uuid: "f43841402438471d9050ae9a37336e99" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46709 } }
I20260807 22:44:32.366530 23003 ts_tablet_manager.cc:1428] T 4043c8c6b45f4d1daaee49b4c314221b P b4f4f134cf8b462f8b422b846aa0e474: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 22:44:32.366863 23002 tablet_bootstrap.cc:492] T 4043c8c6b45f4d1daaee49b4c314221b P f43841402438471d9050ae9a37336e99: No bootstrap required, opened a new log
I20260807 22:44:32.366950 23002 ts_tablet_manager.cc:1397] T 4043c8c6b45f4d1daaee49b4c314221b P f43841402438471d9050ae9a37336e99: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 22:44:32.368357 22978 heartbeater.cc:503] Master 127.22.212.126:42149 was elected leader, sending a full tablet report...
I20260807 22:44:32.369370 23007 raft_consensus.cc:348] T 4043c8c6b45f4d1daaee49b4c314221b P 152eccf354de431494f0a3d05aae41a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4f4f134cf8b462f8b422b846aa0e474" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 34193 } } peers { permanent_uuid: "152eccf354de431494f0a3d05aae41a5" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 42521 } } peers { permanent_uuid: "f43841402438471d9050ae9a37336e99" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46709 } }
I20260807 22:44:32.369556 23007 raft_consensus.cc:374] T 4043c8c6b45f4d1daaee49b4c314221b P 152eccf354de431494f0a3d05aae41a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:44:32.369480 23002 raft_consensus.cc:348] T 4043c8c6b45f4d1daaee49b4c314221b P f43841402438471d9050ae9a37336e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4f4f134cf8b462f8b422b846aa0e474" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 34193 } } peers { permanent_uuid: "152eccf354de431494f0a3d05aae41a5" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 42521 } } peers { permanent_uuid: "f43841402438471d9050ae9a37336e99" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46709 } }
I20260807 22:44:32.369601 23007 raft_consensus.cc:729] T 4043c8c6b45f4d1daaee49b4c314221b P 152eccf354de431494f0a3d05aae41a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 152eccf354de431494f0a3d05aae41a5, State: Initialized, Role: FOLLOWER
I20260807 22:44:32.369614 23002 raft_consensus.cc:374] T 4043c8c6b45f4d1daaee49b4c314221b P f43841402438471d9050ae9a37336e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:44:32.369645 23002 raft_consensus.cc:729] T 4043c8c6b45f4d1daaee49b4c314221b P f43841402438471d9050ae9a37336e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f43841402438471d9050ae9a37336e99, State: Initialized, Role: FOLLOWER
I20260807 22:44:32.369746 23002 consensus_queue.cc:260] T 4043c8c6b45f4d1daaee49b4c314221b P f43841402438471d9050ae9a37336e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4f4f134cf8b462f8b422b846aa0e474" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 34193 } } peers { permanent_uuid: "152eccf354de431494f0a3d05aae41a5" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 42521 } } peers { permanent_uuid: "f43841402438471d9050ae9a37336e99" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46709 } }
I20260807 22:44:32.369746 23007 consensus_queue.cc:260] T 4043c8c6b45f4d1daaee49b4c314221b P 152eccf354de431494f0a3d05aae41a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4f4f134cf8b462f8b422b846aa0e474" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 34193 } } peers { permanent_uuid: "152eccf354de431494f0a3d05aae41a5" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 42521 } } peers { permanent_uuid: "f43841402438471d9050ae9a37336e99" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46709 } }
I20260807 22:44:32.370018 23007 ts_tablet_manager.cc:1428] T 4043c8c6b45f4d1daaee49b4c314221b P 152eccf354de431494f0a3d05aae41a5: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260807 22:44:32.370059 22759 heartbeater.cc:503] Master 127.22.212.126:42149 was elected leader, sending a full tablet report...
I20260807 22:44:32.370306 22544 heartbeater.cc:503] Master 127.22.212.126:42149 was elected leader, sending a full tablet report...
I20260807 22:44:32.370024 23002 ts_tablet_manager.cc:1428] T 4043c8c6b45f4d1daaee49b4c314221b P f43841402438471d9050ae9a37336e99: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 22:44:32.430287 23013 raft_consensus.cc:482] T 4043c8c6b45f4d1daaee49b4c314221b P 152eccf354de431494f0a3d05aae41a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 22:44:32.430449 23013 raft_consensus.cc:504] T 4043c8c6b45f4d1daaee49b4c314221b P 152eccf354de431494f0a3d05aae41a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4f4f134cf8b462f8b422b846aa0e474" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 34193 } } peers { permanent_uuid: "152eccf354de431494f0a3d05aae41a5" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 42521 } } peers { permanent_uuid: "f43841402438471d9050ae9a37336e99" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46709 } }
I20260807 22:44:32.430866 23013 leader_election.cc:288] T 4043c8c6b45f4d1daaee49b4c314221b P 152eccf354de431494f0a3d05aae41a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4f4f134cf8b462f8b422b846aa0e474 (127.22.212.67:34193), f43841402438471d9050ae9a37336e99 (127.22.212.66:46709)
I20260807 22:44:32.433732 22997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:32.431115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:44463 (local address 127.22.212.67:34193)
0807 22:44:32.431160 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:32.431162 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:32.431175 (+ 13us) server_negotiation.cc:407] Connection header received
0807 22:44:32.431247 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:32.431248 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:32.431259 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:32.431319 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:44:32.431481 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:32.431959 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:32.433040 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:32.433387 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:32.433468 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:32.433478 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:32.433631 (+ 153us) server_negotiation.cc:299] Negotiation successful
0807 22:44:32.433668 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 22:44:32.433732 22546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:32.431050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.67:34193 (local address 127.22.212.65:44463)
0807 22:44:32.431124 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:32.431136 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:32.431181 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:32.431339 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:32.431341 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:32.431342 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:44:32.431410 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:32.431412 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:32.432083 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:32.432084 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:32.432927 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:32.432930 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:32.433468 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:32.433470 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:32.433549 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:32.433552 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:44:32.433612 (+ 60us) client_negotiation.cc:240] Negotiation successful
0807 22:44:32.433655 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54,"mutex_wait_us":23}
I20260807 22:44:32.433789 22998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:32.431140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.212.65:33503 (local address 127.22.212.66:46709)
0807 22:44:32.431199 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:32.431201 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:32.431372 (+ 171us) server_negotiation.cc:407] Connection header received
0807 22:44:32.431428 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:32.431428 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:32.431438 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:32.431508 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 22:44:32.431675 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:32.432158 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:32.433105 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:32.433451 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:32.433534 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:32.433541 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:32.433686 (+ 145us) server_negotiation.cc:299] Negotiation successful
0807 22:44:32.433721 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 22:44:32.433861 23016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:32.431058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.66:46709 (local address 127.22.212.65:33503)
0807 22:44:32.431306 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:32.431314 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0807 22:44:32.431371 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:44:32.431524 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:44:32.431525 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:44:32.431526 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 22:44:32.431600 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:32.431601 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:32.432241 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:32.432242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:32.433012 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:44:32.433014 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:44:32.433536 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:44:32.433538 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:44:32.433615 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:32.433618 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 22:44:32.433680 (+ 62us) client_negotiation.cc:240] Negotiation successful
0807 22:44:32.433717 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"mutex_wait_us":95,"thread_start_us":109,"threads_started":1}
I20260807 22:44:32.434103 22899 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4043c8c6b45f4d1daaee49b4c314221b" candidate_uuid: "152eccf354de431494f0a3d05aae41a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4f4f134cf8b462f8b422b846aa0e474" is_pre_election: true
I20260807 22:44:32.434167 22687 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4043c8c6b45f4d1daaee49b4c314221b" candidate_uuid: "152eccf354de431494f0a3d05aae41a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f43841402438471d9050ae9a37336e99" is_pre_election: true
I20260807 22:44:32.434279 22899 raft_consensus.cc:2454] T 4043c8c6b45f4d1daaee49b4c314221b P b4f4f134cf8b462f8b422b846aa0e474 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 152eccf354de431494f0a3d05aae41a5 in term 0.
I20260807 22:44:32.434317 22687 raft_consensus.cc:2454] T 4043c8c6b45f4d1daaee49b4c314221b P f43841402438471d9050ae9a37336e99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 152eccf354de431494f0a3d05aae41a5 in term 0.
I20260807 22:44:32.434532 22371 leader_election.cc:302] T 4043c8c6b45f4d1daaee49b4c314221b P 152eccf354de431494f0a3d05aae41a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 152eccf354de431494f0a3d05aae41a5, b4f4f134cf8b462f8b422b846aa0e474; no voters:
I20260807 22:44:32.434691 23013 raft_consensus.cc:2781] T 4043c8c6b45f4d1daaee49b4c314221b P 152eccf354de431494f0a3d05aae41a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 22:44:32.434770 23013 raft_consensus.cc:482] T 4043c8c6b45f4d1daaee49b4c314221b P 152eccf354de431494f0a3d05aae41a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 22:44:32.434806 23013 raft_consensus.cc:3037] T 4043c8c6b45f4d1daaee49b4c314221b P 152eccf354de431494f0a3d05aae41a5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:44:32.435515 23013 raft_consensus.cc:504] T 4043c8c6b45f4d1daaee49b4c314221b P 152eccf354de431494f0a3d05aae41a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4f4f134cf8b462f8b422b846aa0e474" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 34193 } } peers { permanent_uuid: "152eccf354de431494f0a3d05aae41a5" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 42521 } } peers { permanent_uuid: "f43841402438471d9050ae9a37336e99" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46709 } }
I20260807 22:44:32.435665 23013 leader_election.cc:288] T 4043c8c6b45f4d1daaee49b4c314221b P 152eccf354de431494f0a3d05aae41a5 [CANDIDATE]: Term 1 election: Requested vote from peers b4f4f134cf8b462f8b422b846aa0e474 (127.22.212.67:34193), f43841402438471d9050ae9a37336e99 (127.22.212.66:46709)
I20260807 22:44:32.435823 22687 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4043c8c6b45f4d1daaee49b4c314221b" candidate_uuid: "152eccf354de431494f0a3d05aae41a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f43841402438471d9050ae9a37336e99"
I20260807 22:44:32.435847 22899 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4043c8c6b45f4d1daaee49b4c314221b" candidate_uuid: "152eccf354de431494f0a3d05aae41a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4f4f134cf8b462f8b422b846aa0e474"
I20260807 22:44:32.435894 22687 raft_consensus.cc:3037] T 4043c8c6b45f4d1daaee49b4c314221b P f43841402438471d9050ae9a37336e99 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:44:32.435926 22899 raft_consensus.cc:3037] T 4043c8c6b45f4d1daaee49b4c314221b P b4f4f134cf8b462f8b422b846aa0e474 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:44:32.436740 22899 raft_consensus.cc:2454] T 4043c8c6b45f4d1daaee49b4c314221b P b4f4f134cf8b462f8b422b846aa0e474 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 152eccf354de431494f0a3d05aae41a5 in term 1.
I20260807 22:44:32.436766 22687 raft_consensus.cc:2454] T 4043c8c6b45f4d1daaee49b4c314221b P f43841402438471d9050ae9a37336e99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 152eccf354de431494f0a3d05aae41a5 in term 1.
I20260807 22:44:32.436952 22371 leader_election.cc:302] T 4043c8c6b45f4d1daaee49b4c314221b P 152eccf354de431494f0a3d05aae41a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 152eccf354de431494f0a3d05aae41a5, b4f4f134cf8b462f8b422b846aa0e474; no voters:
I20260807 22:44:32.437050 23013 raft_consensus.cc:2781] T 4043c8c6b45f4d1daaee49b4c314221b P 152eccf354de431494f0a3d05aae41a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:44:32.437225 23013 raft_consensus.cc:686] T 4043c8c6b45f4d1daaee49b4c314221b P 152eccf354de431494f0a3d05aae41a5 [term 1 LEADER]: Becoming Leader. State: Replica: 152eccf354de431494f0a3d05aae41a5, State: Running, Role: LEADER
I20260807 22:44:32.437356 23013 consensus_queue.cc:237] T 4043c8c6b45f4d1daaee49b4c314221b P 152eccf354de431494f0a3d05aae41a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4f4f134cf8b462f8b422b846aa0e474" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 34193 } } peers { permanent_uuid: "152eccf354de431494f0a3d05aae41a5" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 42521 } } peers { permanent_uuid: "f43841402438471d9050ae9a37336e99" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46709 } }
I20260807 22:44:32.438200 22240 catalog_manager.cc:5495] T 4043c8c6b45f4d1daaee49b4c314221b P 152eccf354de431494f0a3d05aae41a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 152eccf354de431494f0a3d05aae41a5 (127.22.212.65). New cstate: current_term: 1 leader_uuid: "152eccf354de431494f0a3d05aae41a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4f4f134cf8b462f8b422b846aa0e474" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 34193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "152eccf354de431494f0a3d05aae41a5" member_type: VOTER last_known_addr { host: "127.22.212.65" port: 42521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f43841402438471d9050ae9a37336e99" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46709 } health_report { overall_health: UNKNOWN } } }
W20260807 22:44:32.440675 22761 tablet.cc:2369] T 4043c8c6b45f4d1daaee49b4c314221b P f43841402438471d9050ae9a37336e99: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 22:44:32.448418 23000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:32.446332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58676 (local address 127.22.212.65:42521)
0807 22:44:32.446386 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:32.446388 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:32.446395 (+ 7us) server_negotiation.cc:407] Connection header received
0807 22:44:32.446424 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:32.446425 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:32.446442 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:32.446514 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:44:32.446611 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:32.447051 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:32.447728 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:32.447898 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:32.447946 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:32.448066 (+ 120us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:44:32.448152 (+ 86us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:44:32.448210 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:32.448240 (+ 30us) server_negotiation.cc:299] Negotiation successful
0807 22:44:32.448295 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260807 22:44:32.450165 22687 raft_consensus.cc:1261] T 4043c8c6b45f4d1daaee49b4c314221b P f43841402438471d9050ae9a37336e99 [term 1 FOLLOWER]: Refusing update from remote peer 152eccf354de431494f0a3d05aae41a5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:44:32.450166 22899 raft_consensus.cc:1261] T 4043c8c6b45f4d1daaee49b4c314221b P b4f4f134cf8b462f8b422b846aa0e474 [term 1 FOLLOWER]: Refusing update from remote peer 152eccf354de431494f0a3d05aae41a5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:44:32.450520 23018 consensus_queue.cc:1035] T 4043c8c6b45f4d1daaee49b4c314221b P 152eccf354de431494f0a3d05aae41a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4f4f134cf8b462f8b422b846aa0e474" member_type: VOTER last_known_addr { host: "127.22.212.67" port: 34193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:44:32.450647 23013 consensus_queue.cc:1035] T 4043c8c6b45f4d1daaee49b4c314221b P 152eccf354de431494f0a3d05aae41a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f43841402438471d9050ae9a37336e99" member_type: VOTER last_known_addr { host: "127.22.212.66" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:44:32.453055 23025 mvcc.cc:205] Tried to move back new op lower bound from 7316040386353082368 to 7316040386304077824. Current Snapshot: MvccSnapshot[applied={T|T < 7316040386353082368}]
I20260807 22:44:32.455476 22240 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57508:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:44:32.455577 22240 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57508:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 22:44:32.456323 22240 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 28233e0f9dd3424ba5302bb8185bd138: Sending DeleteTablet for 3 replicas of tablet 4043c8c6b45f4d1daaee49b4c314221b
I20260807 22:44:32.456674 22867 tablet_service.cc:1514] Processing DeleteTablet for tablet 4043c8c6b45f4d1daaee49b4c314221b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:44:32 UTC) from {username='slave'} at 127.0.0.1:41982
I20260807 22:44:32.456692 22654 tablet_service.cc:1514] Processing DeleteTablet for tablet 4043c8c6b45f4d1daaee49b4c314221b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:44:32 UTC) from {username='slave'} at 127.0.0.1:46778
I20260807 22:44:32.456980 22444 tablet_service.cc:1514] Processing DeleteTablet for tablet 4043c8c6b45f4d1daaee49b4c314221b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 22:44:32 UTC) from {username='slave'} at 127.0.0.1:58670
I20260807 22:44:32.457050 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 22346
I20260807 22:44:32.459877 23043 tablet_replica.cc:330] T 4043c8c6b45f4d1daaee49b4c314221b P f43841402438471d9050ae9a37336e99: stopping tablet replica
I20260807 22:44:32.459990 23043 raft_consensus.cc:2229] T 4043c8c6b45f4d1daaee49b4c314221b P f43841402438471d9050ae9a37336e99 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:44:32.460090 23043 raft_consensus.cc:2258] T 4043c8c6b45f4d1daaee49b4c314221b P f43841402438471d9050ae9a37336e99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:44:32.460608 23043 ts_tablet_manager.cc:1905] T 4043c8c6b45f4d1daaee49b4c314221b P f43841402438471d9050ae9a37336e99: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:44:32.462852 23043 ts_tablet_manager.cc:1918] T 4043c8c6b45f4d1daaee49b4c314221b P f43841402438471d9050ae9a37336e99: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:44:32.463001 23043 log.cc:1196] T 4043c8c6b45f4d1daaee49b4c314221b P f43841402438471d9050ae9a37336e99: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-1/wal/wals/4043c8c6b45f4d1daaee49b4c314221b
I20260807 22:44:32.463328 23043 ts_tablet_manager.cc:1939] T 4043c8c6b45f4d1daaee49b4c314221b P f43841402438471d9050ae9a37336e99: Deleting consensus metadata
I20260807 22:44:32.463779 22219 catalog_manager.cc:4841] TS f43841402438471d9050ae9a37336e99 (127.22.212.66:46709): tablet 4043c8c6b45f4d1daaee49b4c314221b (table test-table [id=beabb46a8e3b4c61ba533dc2a08e54e2]) successfully deleted
I20260807 22:44:32.464398 23049 tablet_replica.cc:330] T 4043c8c6b45f4d1daaee49b4c314221b P b4f4f134cf8b462f8b422b846aa0e474: stopping tablet replica
I20260807 22:44:32.464506 23049 raft_consensus.cc:2229] T 4043c8c6b45f4d1daaee49b4c314221b P b4f4f134cf8b462f8b422b846aa0e474 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 22:44:32.464617 23049 raft_consensus.cc:2258] T 4043c8c6b45f4d1daaee49b4c314221b P b4f4f134cf8b462f8b422b846aa0e474 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 22:44:32.465042 23049 ts_tablet_manager.cc:1905] T 4043c8c6b45f4d1daaee49b4c314221b P b4f4f134cf8b462f8b422b846aa0e474: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 22:44:32.466313 23049 ts_tablet_manager.cc:1918] T 4043c8c6b45f4d1daaee49b4c314221b P b4f4f134cf8b462f8b422b846aa0e474: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 22:44:32.466373 23049 log.cc:1196] T 4043c8c6b45f4d1daaee49b4c314221b P b4f4f134cf8b462f8b422b846aa0e474: Deleting WAL directory at /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786142418640232-23377-0/minicluster-data/ts-2/wal/wals/4043c8c6b45f4d1daaee49b4c314221b
I20260807 22:44:32.466602 23049 ts_tablet_manager.cc:1939] T 4043c8c6b45f4d1daaee49b4c314221b P b4f4f134cf8b462f8b422b846aa0e474: Deleting consensus metadata
I20260807 22:44:32.466982 22215 catalog_manager.cc:4841] TS b4f4f134cf8b462f8b422b846aa0e474 (127.22.212.67:34193): tablet 4043c8c6b45f4d1daaee49b4c314221b (table test-table [id=beabb46a8e3b4c61ba533dc2a08e54e2]) successfully deleted
W20260807 22:44:32.467767 22215 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.212.65:42521 (error 108)
I20260807 22:44:32.467993 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 22547
I20260807 22:44:32.468290 22993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:32.468149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.65:42521 (local address 127.0.0.1:58688)
0807 22:44:32.468195 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0807 22:44:32.468230 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.65:42521: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260807 22:44:32.468386 22215 catalog_manager.cc:4584] TS 152eccf354de431494f0a3d05aae41a5 (127.22.212.65:42521): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4043c8c6b45f4d1daaee49b4c314221b: Network error: Client connection negotiation failed: client connection to 127.22.212.65:42521: connect: Connection refused (error 111)
I20260807 22:44:32.481037 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 22765
I20260807 22:44:32.497113 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 22187
2026-08-07T22:44:32Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (807 ms)
[----------] 6 tests from EncryptionPolicyTest (9150 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142418640232-23377-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:44:32 dist-test-slave-2d19 krb5kdc[23059](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:44:32 dist-test-slave-2d19 krb5kdc[23059](info): set up 2 sockets
Aug 07 22:44:32 dist-test-slave-2d19 krb5kdc[23059](info): commencing operation
krb5kdc: starting...
W20260807 22:44:33.752022 23377 mini_kdc.cc:121] Time spent starting KDC: real 1.228s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Aug 07 22:44:33 dist-test-slave-2d19 krb5kdc[23059](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142673, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:44:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:44:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 22:44:33.879207 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34293
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34293
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:44:33.963050 23078 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:44:33.963311 23078 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:44:33.963351 23078 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:44:33.964547 23078 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:44:33.964614 23078 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:44:33.964639 23078 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:44:33.964661 23078 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:44:33.964700 23078 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:44:33.966216 23078 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34293
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34293
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23078
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:44:33.966498 23078 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:44:33.966720 23078 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:44:33.971742 23092 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:33.971766 23088 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:33.971889 23078 server_base.cc:1034] running on GCE node
W20260807 22:44:33.971782 23089 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:33.972219 23078 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:44:33.972576 23078 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:44:33.973762 23078 hybrid_clock.cc:648] HybridClock initialized: now 1786142673973747 us; error 42 us; skew 500 ppm
Aug 07 22:44:33 dist-test-slave-2d19 krb5kdc[23059](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142673, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:44:33.983057 23078 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 22:44:33.983493 23078 webserver.cc:460] Webserver started at http://127.0.0.1:41879/ using document root <none> and password file <none>
I20260807 22:44:33.983706 23078 fs_manager.cc:359] Metadata directory not provided
I20260807 22:44:33.983749 23078 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:44:33.983844 23078 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:44:33.984990 23078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "db69e841538649bf87ee99dd0086fbf5"
format_stamp: "Formatted at 2026-08-07 22:44:33 on dist-test-slave-2d19"
server_key: "311cf83bb0a13981b2d2a339facb496e"
server_key_iv: "fdac552a9a9c1b69271887d998bd882a"
server_key_version: "encryptionkey@0"
I20260807 22:44:33.985324 23078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "db69e841538649bf87ee99dd0086fbf5"
format_stamp: "Formatted at 2026-08-07 22:44:33 on dist-test-slave-2d19"
server_key: "311cf83bb0a13981b2d2a339facb496e"
server_key_iv: "fdac552a9a9c1b69271887d998bd882a"
server_key_version: "encryptionkey@0"
I20260807 22:44:33.987067 23078 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260807 22:44:33.987882 23110 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:33.988147 23078 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:44:33.988247 23078 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "db69e841538649bf87ee99dd0086fbf5"
format_stamp: "Formatted at 2026-08-07 22:44:33 on dist-test-slave-2d19"
server_key: "311cf83bb0a13981b2d2a339facb496e"
server_key_iv: "fdac552a9a9c1b69271887d998bd882a"
server_key_version: "encryptionkey@0"
I20260807 22:44:33.988368 23078 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:44:33.996764 23078 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:44:33.998575 23078 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:44:33.998687 23078 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:44:34.002681 23078 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34293
I20260807 22:44:34.002734 23191 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34293 every 8 connection(s)
I20260807 22:44:34.003109 23078 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:44:34.004061 23192 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:44:34.004705 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 23078
I20260807 22:44:34.004823 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:44:34.005043 23377 external_mini_cluster.cc:1428] Setting key 1b36d2119a8b13ab98f88913d0e16344
I20260807 22:44:34.006917 23192 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db69e841538649bf87ee99dd0086fbf5: Bootstrap starting.
I20260807 22:44:34.007535 23192 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P db69e841538649bf87ee99dd0086fbf5: Neither blocks nor log segments found. Creating new log.
I20260807 22:44:34.007815 23192 log.cc:824] T 00000000000000000000000000000000 P db69e841538649bf87ee99dd0086fbf5: Log is configured to *not* fsync() on all Append() calls
I20260807 22:44:34.008543 23192 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db69e841538649bf87ee99dd0086fbf5: No bootstrap required, opened a new log
I20260807 22:44:34.010629 23192 raft_consensus.cc:348] T 00000000000000000000000000000000 P db69e841538649bf87ee99dd0086fbf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db69e841538649bf87ee99dd0086fbf5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34293 } }
I20260807 22:44:34.010787 23192 raft_consensus.cc:374] T 00000000000000000000000000000000 P db69e841538649bf87ee99dd0086fbf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:44:34.010847 23192 raft_consensus.cc:729] T 00000000000000000000000000000000 P db69e841538649bf87ee99dd0086fbf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db69e841538649bf87ee99dd0086fbf5, State: Initialized, Role: FOLLOWER
I20260807 22:44:34.010998 23192 consensus_queue.cc:260] T 00000000000000000000000000000000 P db69e841538649bf87ee99dd0086fbf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db69e841538649bf87ee99dd0086fbf5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34293 } }
I20260807 22:44:34.011093 23192 raft_consensus.cc:388] T 00000000000000000000000000000000 P db69e841538649bf87ee99dd0086fbf5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:44:34.011127 23192 raft_consensus.cc:482] T 00000000000000000000000000000000 P db69e841538649bf87ee99dd0086fbf5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:44:34.011186 23192 raft_consensus.cc:3037] T 00000000000000000000000000000000 P db69e841538649bf87ee99dd0086fbf5 [term 0 FOLLOWER]: Advancing to term 1
Aug 07 22:44:34 dist-test-slave-2d19 krb5kdc[23059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142673, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 22:44:34.011943 23192 raft_consensus.cc:504] T 00000000000000000000000000000000 P db69e841538649bf87ee99dd0086fbf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db69e841538649bf87ee99dd0086fbf5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34293 } }
I20260807 22:44:34.012066 23192 leader_election.cc:302] T 00000000000000000000000000000000 P db69e841538649bf87ee99dd0086fbf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: db69e841538649bf87ee99dd0086fbf5; no voters:
I20260807 22:44:34.012238 23192 leader_election.cc:288] T 00000000000000000000000000000000 P db69e841538649bf87ee99dd0086fbf5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:44:34.012324 23202 raft_consensus.cc:2781] T 00000000000000000000000000000000 P db69e841538649bf87ee99dd0086fbf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:44:34.012486 23202 raft_consensus.cc:686] T 00000000000000000000000000000000 P db69e841538649bf87ee99dd0086fbf5 [term 1 LEADER]: Becoming Leader. State: Replica: db69e841538649bf87ee99dd0086fbf5, State: Running, Role: LEADER
I20260807 22:44:34.012579 23192 sys_catalog.cc:564] T 00000000000000000000000000000000 P db69e841538649bf87ee99dd0086fbf5 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:44:34.012605 23202 consensus_queue.cc:237] T 00000000000000000000000000000000 P db69e841538649bf87ee99dd0086fbf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db69e841538649bf87ee99dd0086fbf5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34293 } }
I20260807 22:44:34.012946 23202 sys_catalog.cc:455] T 00000000000000000000000000000000 P db69e841538649bf87ee99dd0086fbf5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader db69e841538649bf87ee99dd0086fbf5. Latest consensus state: current_term: 1 leader_uuid: "db69e841538649bf87ee99dd0086fbf5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db69e841538649bf87ee99dd0086fbf5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34293 } } }
I20260807 22:44:34.013055 23202 sys_catalog.cc:458] T 00000000000000000000000000000000 P db69e841538649bf87ee99dd0086fbf5 [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:34.012956 23205 sys_catalog.cc:455] T 00000000000000000000000000000000 P db69e841538649bf87ee99dd0086fbf5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "db69e841538649bf87ee99dd0086fbf5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db69e841538649bf87ee99dd0086fbf5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34293 } } }
I20260807 22:44:34.013211 23205 sys_catalog.cc:458] T 00000000000000000000000000000000 P db69e841538649bf87ee99dd0086fbf5 [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:34.013345 23212 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:44:34.013933 23212 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:44:34.015707 23212 catalog_manager.cc:1347] Generated new cluster ID: 438f7d3964f94cfe977836a529b1e2e0
I20260807 22:44:34.015761 23212 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:44:34.016554 23197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:34.005588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44273 (local address 127.0.0.1:34293)
0807 22:44:34.005787 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:34.005801 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:34.005827 (+ 26us) server_negotiation.cc:407] Connection header received
0807 22:44:34.006243 (+ 416us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:34.006251 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:34.006297 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:34.006442 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:34.007111 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:34.008058 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:34.008973 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:34.009387 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:34.009527 (+ 140us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:34.012450 (+ 2923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:34.012454 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:34.012454 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:44:34.012466 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:34.014809 (+ 2343us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:34.015252 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:34.015255 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:34.015255 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:34.015335 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:34.015588 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:34.015589 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:34.015589 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:34.015935 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:34.016081 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:34.016244 (+ 163us) server_negotiation.cc:299] Negotiation successful
0807 22:44:34.016361 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":94,"threads_started":1}
I20260807 22:44:34.021046 23377 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:44:34.031579 23197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:34.022676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58709 (local address 127.0.0.1:34293)
0807 22:44:34.022717 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:34.022719 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:34.024430 (+ 1711us) server_negotiation.cc:407] Connection header received
0807 22:44:34.024494 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:34.024495 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:34.024505 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:34.024557 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:34.025214 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:34.025960 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:34.026984 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:34.027288 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:34.027351 (+ 63us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:34.028787 (+ 1436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:34.028788 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:34.028788 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:44:34.028795 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:34.030312 (+ 1517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:34.030727 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:34.030728 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:34.030728 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:34.030783 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:34.031031 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:34.031031 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:34.031032 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:34.031150 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:34.031241 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:34.031413 (+ 172us) server_negotiation.cc:299] Negotiation successful
0807 22:44:34.031477 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":19}
I20260807 22:44:34.032697 23212 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:44:34.033380 23212 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:44:34.036780 23212 catalog_manager.cc:5868] T 00000000000000000000000000000000 P db69e841538649bf87ee99dd0086fbf5: Generated new TSK 0
I20260807 22:44:34.036952 23212 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:44:34.042755 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 23078
W20260807 22:44:34.058024 23053 connection.cc:535] client connection to 127.0.0.1:34293 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34293): Connection reset by peer (error 104)
2026-08-07T22:44:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1547 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142418640232-23377-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:44:34 dist-test-slave-2d19 krb5kdc[23238](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:44:34 dist-test-slave-2d19 krb5kdc[23238](info): set up 2 sockets
Aug 07 22:44:34 dist-test-slave-2d19 krb5kdc[23238](info): commencing operation
krb5kdc: starting...
W20260807 22:44:35.304798 23377 mini_kdc.cc:121] Time spent starting KDC: real 1.233s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Aug 07 22:44:35 dist-test-slave-2d19 krb5kdc[23238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142675, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:44:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:44:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 22:44:35.431360 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43765
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43765
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:44:35.516402 23261 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:44:35.516613 23261 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:44:35.516637 23261 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:44:35.517709 23261 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:44:35.517747 23261 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:44:35.517761 23261 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:44:35.517774 23261 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:44:35.517786 23261 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:44:35.519204 23261 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43765
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43765
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23261
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:44:35.519388 23261 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:44:35.519567 23261 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:44:35.524641 23274 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:35.524761 23261 server_base.cc:1034] running on GCE node
W20260807 22:44:35.524855 23271 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:35.524605 23272 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:35.525172 23261 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:44:35.525484 23261 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:44:35.526657 23261 hybrid_clock.cc:648] HybridClock initialized: now 1786142675526644 us; error 40 us; skew 500 ppm
Aug 07 22:44:35 dist-test-slave-2d19 krb5kdc[23238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142675, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:44:35.529232 23261 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 22:44:35.529700 23261 webserver.cc:460] Webserver started at http://127.0.0.1:34399/ using document root <none> and password file <none>
I20260807 22:44:35.529954 23261 fs_manager.cc:359] Metadata directory not provided
I20260807 22:44:35.530023 23261 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:44:35.530164 23261 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:44:35.531487 23261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "4a6b039f67f041fd879fb8c81aec4d68"
format_stamp: "Formatted at 2026-08-07 22:44:35 on dist-test-slave-2d19"
server_key: "547794eefb7f29a5b419ac769e69587e"
server_key_iv: "82bfbf2d9fdab49290797e4aa68f3a4e"
server_key_version: "encryptionkey@0"
I20260807 22:44:35.532022 23261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "4a6b039f67f041fd879fb8c81aec4d68"
format_stamp: "Formatted at 2026-08-07 22:44:35 on dist-test-slave-2d19"
server_key: "547794eefb7f29a5b419ac769e69587e"
server_key_iv: "82bfbf2d9fdab49290797e4aa68f3a4e"
server_key_version: "encryptionkey@0"
I20260807 22:44:35.534052 23261 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260807 22:44:35.534847 23284 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:35.535059 23261 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:44:35.535158 23261 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "4a6b039f67f041fd879fb8c81aec4d68"
format_stamp: "Formatted at 2026-08-07 22:44:35 on dist-test-slave-2d19"
server_key: "547794eefb7f29a5b419ac769e69587e"
server_key_iv: "82bfbf2d9fdab49290797e4aa68f3a4e"
server_key_version: "encryptionkey@0"
I20260807 22:44:35.535246 23261 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:44:35.543177 23261 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:44:35.545089 23261 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:44:35.545246 23261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:44:35.549330 23261 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43765
I20260807 22:44:35.549369 23374 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43765 every 8 connection(s)
I20260807 22:44:35.549712 23261 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:44:35.550581 23376 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:44:35.553023 23376 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a6b039f67f041fd879fb8c81aec4d68: Bootstrap starting.
I20260807 22:44:35.553622 23376 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4a6b039f67f041fd879fb8c81aec4d68: Neither blocks nor log segments found. Creating new log.
I20260807 22:44:35.553901 23376 log.cc:824] T 00000000000000000000000000000000 P 4a6b039f67f041fd879fb8c81aec4d68: Log is configured to *not* fsync() on all Append() calls
I20260807 22:44:35.554598 23376 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a6b039f67f041fd879fb8c81aec4d68: No bootstrap required, opened a new log
I20260807 22:44:35.556221 23376 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4a6b039f67f041fd879fb8c81aec4d68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a6b039f67f041fd879fb8c81aec4d68" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43765 } }
I20260807 22:44:35.556424 23376 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4a6b039f67f041fd879fb8c81aec4d68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:44:35.556452 23376 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4a6b039f67f041fd879fb8c81aec4d68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a6b039f67f041fd879fb8c81aec4d68, State: Initialized, Role: FOLLOWER
I20260807 22:44:35.556644 23376 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4a6b039f67f041fd879fb8c81aec4d68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a6b039f67f041fd879fb8c81aec4d68" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43765 } }
I20260807 22:44:35.556736 23376 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4a6b039f67f041fd879fb8c81aec4d68 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:44:35.556761 23376 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4a6b039f67f041fd879fb8c81aec4d68 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:44:35.556824 23376 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4a6b039f67f041fd879fb8c81aec4d68 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:44:35.556885 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 23261
I20260807 22:44:35.557018 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:44:35.557217 23377 external_mini_cluster.cc:1428] Setting key 7e5dbec4d155038f9e33865cb4437254
I20260807 22:44:35.557550 23376 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4a6b039f67f041fd879fb8c81aec4d68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a6b039f67f041fd879fb8c81aec4d68" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43765 } }
I20260807 22:44:35.557703 23376 leader_election.cc:302] T 00000000000000000000000000000000 P 4a6b039f67f041fd879fb8c81aec4d68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4a6b039f67f041fd879fb8c81aec4d68; no voters:
I20260807 22:44:35.557888 23376 leader_election.cc:288] T 00000000000000000000000000000000 P 4a6b039f67f041fd879fb8c81aec4d68 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:44:35.557914 23393 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4a6b039f67f041fd879fb8c81aec4d68 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:44:35.558064 23393 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4a6b039f67f041fd879fb8c81aec4d68 [term 1 LEADER]: Becoming Leader. State: Replica: 4a6b039f67f041fd879fb8c81aec4d68, State: Running, Role: LEADER
I20260807 22:44:35.558171 23376 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4a6b039f67f041fd879fb8c81aec4d68 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:44:35.558158 23393 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4a6b039f67f041fd879fb8c81aec4d68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a6b039f67f041fd879fb8c81aec4d68" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43765 } }
I20260807 22:44:35.558491 23393 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a6b039f67f041fd879fb8c81aec4d68 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4a6b039f67f041fd879fb8c81aec4d68. Latest consensus state: current_term: 1 leader_uuid: "4a6b039f67f041fd879fb8c81aec4d68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a6b039f67f041fd879fb8c81aec4d68" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43765 } } }
I20260807 22:44:35.558606 23393 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a6b039f67f041fd879fb8c81aec4d68 [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:35.558908 23399 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a6b039f67f041fd879fb8c81aec4d68 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4a6b039f67f041fd879fb8c81aec4d68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a6b039f67f041fd879fb8c81aec4d68" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43765 } } }
I20260807 22:44:35.559026 23399 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a6b039f67f041fd879fb8c81aec4d68 [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:35.559476 23404 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:44:35.560091 23404 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:44:35.561677 23404 catalog_manager.cc:1347] Generated new cluster ID: 0d43d80aae5b42d9bc088195cf78d0f4
I20260807 22:44:35.561734 23404 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:44:35.570745 23391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:35.557703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35995 (local address 127.0.0.1:43765)
0807 22:44:35.557900 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:35.557911 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:35.558033 (+ 122us) server_negotiation.cc:407] Connection header received
0807 22:44:35.558250 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:35.558259 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:35.558318 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:35.558474 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:35.558736 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:35.560575 (+ 1839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:35.568345 (+ 7770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:35.568994 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:35.569126 (+ 132us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:35.569995 (+ 869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:35.570000 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:35.570000 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:44:35.570223 (+ 223us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:35.570263 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:44:35.570278 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:35.570363 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:35.570466 (+ 103us) server_negotiation.cc:299] Negotiation successful
0807 22:44:35.570496 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":106,"threads_started":1}
I20260807 22:44:35.571784 23377 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:44:35.576917 23391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:35.573350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35691 (local address 127.0.0.1:43765)
0807 22:44:35.573386 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:35.573388 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:35.573515 (+ 127us) server_negotiation.cc:407] Connection header received
0807 22:44:35.573577 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:35.573577 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:35.573588 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:35.573654 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:35.573791 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:35.574511 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:35.575557 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:35.575877 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:35.575931 (+ 54us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:35.576667 (+ 736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:35.576668 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:35.576669 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:44:35.576673 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:35.576689 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:44:35.576693 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:35.576751 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:35.576830 (+ 79us) server_negotiation.cc:299] Negotiation successful
0807 22:44:35.576843 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260807 22:44:35.579090 23404 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:44:35.579576 23404 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:44:35.586395 23404 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4a6b039f67f041fd879fb8c81aec4d68: Generated new TSK 0
I20260807 22:44:35.586580 23404 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:44:35.588389 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 23261
W20260807 22:44:35.604393 23236 connection.cc:535] client connection to 127.0.0.1:43765 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43765): Connection reset by peer (error 104)
2026-08-07T22:44:35Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1546 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142418640232-23377-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:44:35 dist-test-slave-2d19 krb5kdc[23432](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:44:35 dist-test-slave-2d19 krb5kdc[23432](info): set up 2 sockets
Aug 07 22:44:35 dist-test-slave-2d19 krb5kdc[23432](info): commencing operation
krb5kdc: starting...
W20260807 22:44:36.853428 23377 mini_kdc.cc:121] Time spent starting KDC: real 1.235s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Aug 07 22:44:36 dist-test-slave-2d19 krb5kdc[23432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142676, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:44:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:44:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 22:44:36.985076 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40883
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40883
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:44:37.070401 23451 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:44:37.070663 23451 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:44:37.070688 23451 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:44:37.072238 23451 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:44:37.072324 23451 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:44:37.072338 23451 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:44:37.072351 23451 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:44:37.072425 23451 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:44:37.074082 23451 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40883
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40883
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23451
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:44:37.074361 23451 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:44:37.074610 23451 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:44:37.079873 23460 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:37.079895 23469 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:37.079955 23458 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:37.079924 23451 server_base.cc:1034] running on GCE node
I20260807 22:44:37.080435 23451 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:44:37.080796 23451 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:44:37.081974 23451 hybrid_clock.cc:648] HybridClock initialized: now 1786142677081947 us; error 46 us; skew 500 ppm
Aug 07 22:44:37 dist-test-slave-2d19 krb5kdc[23432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142677, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:44:37.084681 23451 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 22:44:37.085210 23451 webserver.cc:460] Webserver started at http://127.0.0.1:42973/ using document root <none> and password file <none>
I20260807 22:44:37.085450 23451 fs_manager.cc:359] Metadata directory not provided
I20260807 22:44:37.085518 23451 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:44:37.085683 23451 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:44:37.086802 23451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "74346b0e994d4f158f19c35d8dc7e009"
format_stamp: "Formatted at 2026-08-07 22:44:37 on dist-test-slave-2d19"
server_key: "4c3d5d25352ff764ac4cc642811fa88f"
server_key_iv: "247c31ba7facbc563b72a7bb9ce77e79"
server_key_version: "encryptionkey@0"
I20260807 22:44:37.087194 23451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "74346b0e994d4f158f19c35d8dc7e009"
format_stamp: "Formatted at 2026-08-07 22:44:37 on dist-test-slave-2d19"
server_key: "4c3d5d25352ff764ac4cc642811fa88f"
server_key_iv: "247c31ba7facbc563b72a7bb9ce77e79"
server_key_version: "encryptionkey@0"
I20260807 22:44:37.088670 23451 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 22:44:37.089417 23484 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:37.089591 23451 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 22:44:37.089712 23451 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "74346b0e994d4f158f19c35d8dc7e009"
format_stamp: "Formatted at 2026-08-07 22:44:37 on dist-test-slave-2d19"
server_key: "4c3d5d25352ff764ac4cc642811fa88f"
server_key_iv: "247c31ba7facbc563b72a7bb9ce77e79"
server_key_version: "encryptionkey@0"
I20260807 22:44:37.089789 23451 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:44:37.093266 23451 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:44:37.095125 23451 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:44:37.095285 23451 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:44:37.099473 23451 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40883
I20260807 22:44:37.099515 23569 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40883 every 8 connection(s)
I20260807 22:44:37.099886 23451 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:44:37.101055 23573 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:44:37.101039 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 23451
I20260807 22:44:37.101172 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:44:37.101387 23377 external_mini_cluster.cc:1428] Setting key 6617770f1f05dd4e8666ec68ab3582a5
I20260807 22:44:37.103888 23577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:37.101936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33741 (local address 127.0.0.1:40883)
0807 22:44:37.102144 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:37.102153 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:37.102178 (+ 25us) server_negotiation.cc:407] Connection header received
0807 22:44:37.102640 (+ 462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:37.102647 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:37.102676 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:37.102792 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:37.103445 (+ 653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:37.103448 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:37.103448 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:44:37.103452 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:37.103492 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:44:37.103503 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:37.103558 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:37.103645 (+ 87us) server_negotiation.cc:299] Negotiation successful
0807 22:44:37.103701 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":106,"threads_started":1}
I20260807 22:44:37.104743 23573 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74346b0e994d4f158f19c35d8dc7e009: Bootstrap starting.
I20260807 22:44:37.104918 23377 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:44:37.105475 23573 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 74346b0e994d4f158f19c35d8dc7e009: Neither blocks nor log segments found. Creating new log.
I20260807 22:44:37.105822 23573 log.cc:824] T 00000000000000000000000000000000 P 74346b0e994d4f158f19c35d8dc7e009: Log is configured to *not* fsync() on all Append() calls
I20260807 22:44:37.106575 23573 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74346b0e994d4f158f19c35d8dc7e009: No bootstrap required, opened a new log
I20260807 22:44:37.107599 23577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:37.106597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48641 (local address 127.0.0.1:40883)
0807 22:44:37.106692 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:37.106694 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:37.106743 (+ 49us) server_negotiation.cc:407] Connection header received
0807 22:44:37.106819 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:37.106820 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:37.106825 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:37.106882 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:37.107406 (+ 524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:37.107407 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:37.107407 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:44:37.107413 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:37.107427 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:44:37.107432 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:37.107491 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:37.107526 (+ 35us) server_negotiation.cc:299] Negotiation successful
0807 22:44:37.107539 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 22:44:37.108999 23573 raft_consensus.cc:348] T 00000000000000000000000000000000 P 74346b0e994d4f158f19c35d8dc7e009 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74346b0e994d4f158f19c35d8dc7e009" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40883 } }
I20260807 22:44:37.109153 23573 raft_consensus.cc:374] T 00000000000000000000000000000000 P 74346b0e994d4f158f19c35d8dc7e009 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:44:37.109200 23573 raft_consensus.cc:729] T 00000000000000000000000000000000 P 74346b0e994d4f158f19c35d8dc7e009 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74346b0e994d4f158f19c35d8dc7e009, State: Initialized, Role: FOLLOWER
I20260807 22:44:37.109325 23573 consensus_queue.cc:260] T 00000000000000000000000000000000 P 74346b0e994d4f158f19c35d8dc7e009 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74346b0e994d4f158f19c35d8dc7e009" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40883 } }
I20260807 22:44:37.109437 23573 raft_consensus.cc:388] T 00000000000000000000000000000000 P 74346b0e994d4f158f19c35d8dc7e009 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:44:37.109484 23573 raft_consensus.cc:482] T 00000000000000000000000000000000 P 74346b0e994d4f158f19c35d8dc7e009 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:44:37.109536 23573 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 74346b0e994d4f158f19c35d8dc7e009 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:44:37.110090 23573 raft_consensus.cc:504] T 00000000000000000000000000000000 P 74346b0e994d4f158f19c35d8dc7e009 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74346b0e994d4f158f19c35d8dc7e009" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40883 } }
I20260807 22:44:37.110216 23573 leader_election.cc:302] T 00000000000000000000000000000000 P 74346b0e994d4f158f19c35d8dc7e009 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 74346b0e994d4f158f19c35d8dc7e009; no voters:
I20260807 22:44:37.110409 23573 leader_election.cc:288] T 00000000000000000000000000000000 P 74346b0e994d4f158f19c35d8dc7e009 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:44:37.110464 23590 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 74346b0e994d4f158f19c35d8dc7e009 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:44:37.110642 23590 raft_consensus.cc:686] T 00000000000000000000000000000000 P 74346b0e994d4f158f19c35d8dc7e009 [term 1 LEADER]: Becoming Leader. State: Replica: 74346b0e994d4f158f19c35d8dc7e009, State: Running, Role: LEADER
I20260807 22:44:37.110666 23573 sys_catalog.cc:564] T 00000000000000000000000000000000 P 74346b0e994d4f158f19c35d8dc7e009 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:44:37.110734 23590 consensus_queue.cc:237] T 00000000000000000000000000000000 P 74346b0e994d4f158f19c35d8dc7e009 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74346b0e994d4f158f19c35d8dc7e009" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40883 } }
I20260807 22:44:37.111136 23591 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74346b0e994d4f158f19c35d8dc7e009 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "74346b0e994d4f158f19c35d8dc7e009" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74346b0e994d4f158f19c35d8dc7e009" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40883 } } }
I20260807 22:44:37.111299 23591 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74346b0e994d4f158f19c35d8dc7e009 [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:37.111138 23593 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74346b0e994d4f158f19c35d8dc7e009 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 74346b0e994d4f158f19c35d8dc7e009. Latest consensus state: current_term: 1 leader_uuid: "74346b0e994d4f158f19c35d8dc7e009" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74346b0e994d4f158f19c35d8dc7e009" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40883 } } }
I20260807 22:44:37.111438 23593 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74346b0e994d4f158f19c35d8dc7e009 [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:37.111657 23605 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:44:37.112401 23605 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:44:37.114001 23605 catalog_manager.cc:1347] Generated new cluster ID: 3203703ffa484f9387dbf9963a680804
I20260807 22:44:37.114058 23605 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:44:37.126852 23605 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:44:37.127036 23605 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:44:37.136196 23605 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 74346b0e994d4f158f19c35d8dc7e009: Generated new TSK 0
I20260807 22:44:37.136438 23605 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:44:37.142030 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 23451
2026-08-07T22:44:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1547 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142418640232-23377-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:44:37 dist-test-slave-2d19 krb5kdc[23620](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:44:37 dist-test-slave-2d19 krb5kdc[23620](info): set up 2 sockets
Aug 07 22:44:37 dist-test-slave-2d19 krb5kdc[23620](info): commencing operation
krb5kdc: starting...
W20260807 22:44:38.428840 23377 mini_kdc.cc:121] Time spent starting KDC: real 1.263s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Aug 07 22:44:38 dist-test-slave-2d19 krb5kdc[23620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142678, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:44:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:44:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 22:44:38.559128 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46597
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46597
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:44:38.644212 23639 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:44:38.644524 23639 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:44:38.644567 23639 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:44:38.645710 23639 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:44:38.645781 23639 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:44:38.645804 23639 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:44:38.645825 23639 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:44:38.645853 23639 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:44:38.647348 23639 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46597
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46597
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23639
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:44:38.647636 23639 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:44:38.647874 23639 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:44:38.653334 23652 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:38.653369 23649 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:38.653517 23639 server_base.cc:1034] running on GCE node
W20260807 22:44:38.653357 23648 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:38.653836 23639 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:44:38.654156 23639 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:44:38.655331 23639 hybrid_clock.cc:648] HybridClock initialized: now 1786142678655309 us; error 43 us; skew 500 ppm
Aug 07 22:44:38 dist-test-slave-2d19 krb5kdc[23620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142678, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:44:38.657876 23639 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 22:44:38.658329 23639 webserver.cc:460] Webserver started at http://127.0.0.1:44531/ using document root <none> and password file <none>
I20260807 22:44:38.658592 23639 fs_manager.cc:359] Metadata directory not provided
I20260807 22:44:38.658667 23639 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:44:38.658823 23639 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:44:38.659955 23639 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "9b61b6f090ba4e788d90e8371eb3361b"
format_stamp: "Formatted at 2026-08-07 22:44:38 on dist-test-slave-2d19"
server_key: "d5cebd1c445e0d893ca66f5df943062e"
server_key_iv: "23836a8c0eed232c546e6e954d1f82a5"
server_key_version: "encryptionkey@0"
I20260807 22:44:38.660389 23639 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "9b61b6f090ba4e788d90e8371eb3361b"
format_stamp: "Formatted at 2026-08-07 22:44:38 on dist-test-slave-2d19"
server_key: "d5cebd1c445e0d893ca66f5df943062e"
server_key_iv: "23836a8c0eed232c546e6e954d1f82a5"
server_key_version: "encryptionkey@0"
I20260807 22:44:38.661764 23639 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:44:38.662554 23666 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:38.662741 23639 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:44:38.662858 23639 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "9b61b6f090ba4e788d90e8371eb3361b"
format_stamp: "Formatted at 2026-08-07 22:44:38 on dist-test-slave-2d19"
server_key: "d5cebd1c445e0d893ca66f5df943062e"
server_key_iv: "23836a8c0eed232c546e6e954d1f82a5"
server_key_version: "encryptionkey@0"
I20260807 22:44:38.662936 23639 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:44:38.673383 23639 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:44:38.675511 23639 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:44:38.675681 23639 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:44:38.679796 23639 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46597
I20260807 22:44:38.679883 23743 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46597 every 8 connection(s)
I20260807 22:44:38.680236 23639 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:44:38.681257 23746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:44:38.683708 23746 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b61b6f090ba4e788d90e8371eb3361b: Bootstrap starting.
I20260807 22:44:38.684408 23746 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9b61b6f090ba4e788d90e8371eb3361b: Neither blocks nor log segments found. Creating new log.
I20260807 22:44:38.684705 23746 log.cc:824] T 00000000000000000000000000000000 P 9b61b6f090ba4e788d90e8371eb3361b: Log is configured to *not* fsync() on all Append() calls
I20260807 22:44:38.684896 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 23639
I20260807 22:44:38.685021 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:44:38.685205 23377 external_mini_cluster.cc:1428] Setting key ffe497366e7427a3168c4577d3692c04
I20260807 22:44:38.685598 23746 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b61b6f090ba4e788d90e8371eb3361b: No bootstrap required, opened a new log
I20260807 22:44:38.687801 23746 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9b61b6f090ba4e788d90e8371eb3361b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b61b6f090ba4e788d90e8371eb3361b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46597 } }
I20260807 22:44:38.688002 23746 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9b61b6f090ba4e788d90e8371eb3361b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:44:38.688045 23746 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9b61b6f090ba4e788d90e8371eb3361b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b61b6f090ba4e788d90e8371eb3361b, State: Initialized, Role: FOLLOWER
I20260807 22:44:38.688199 23746 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9b61b6f090ba4e788d90e8371eb3361b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b61b6f090ba4e788d90e8371eb3361b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46597 } }
I20260807 22:44:38.688310 23746 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9b61b6f090ba4e788d90e8371eb3361b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:44:38.688351 23746 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9b61b6f090ba4e788d90e8371eb3361b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:44:38.688400 23746 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9b61b6f090ba4e788d90e8371eb3361b [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:44:38.689109 23746 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9b61b6f090ba4e788d90e8371eb3361b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b61b6f090ba4e788d90e8371eb3361b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46597 } }
I20260807 22:44:38.689229 23746 leader_election.cc:302] T 00000000000000000000000000000000 P 9b61b6f090ba4e788d90e8371eb3361b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9b61b6f090ba4e788d90e8371eb3361b; no voters:
I20260807 22:44:38.689381 23746 leader_election.cc:288] T 00000000000000000000000000000000 P 9b61b6f090ba4e788d90e8371eb3361b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:44:38.689435 23754 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9b61b6f090ba4e788d90e8371eb3361b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:44:38.689589 23754 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9b61b6f090ba4e788d90e8371eb3361b [term 1 LEADER]: Becoming Leader. State: Replica: 9b61b6f090ba4e788d90e8371eb3361b, State: Running, Role: LEADER
I20260807 22:44:38.689632 23746 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9b61b6f090ba4e788d90e8371eb3361b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:44:38.689740 23754 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9b61b6f090ba4e788d90e8371eb3361b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b61b6f090ba4e788d90e8371eb3361b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46597 } }
I20260807 22:44:38.690069 23754 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b61b6f090ba4e788d90e8371eb3361b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9b61b6f090ba4e788d90e8371eb3361b. Latest consensus state: current_term: 1 leader_uuid: "9b61b6f090ba4e788d90e8371eb3361b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b61b6f090ba4e788d90e8371eb3361b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46597 } } }
I20260807 22:44:38.690201 23754 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b61b6f090ba4e788d90e8371eb3361b [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:38.690459 23765 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:44:38.690971 23755 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b61b6f090ba4e788d90e8371eb3361b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9b61b6f090ba4e788d90e8371eb3361b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b61b6f090ba4e788d90e8371eb3361b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46597 } } }
I20260807 22:44:38.691099 23755 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b61b6f090ba4e788d90e8371eb3361b [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:38.691308 23765 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:44:38.693019 23765 catalog_manager.cc:1347] Generated new cluster ID: ef3614e64dc34d73b095ac3dbdc62a47
I20260807 22:44:38.693073 23765 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 22:44:38 dist-test-slave-2d19 krb5kdc[23620](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142678, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 22:44:38.698673 23753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:38.685780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58893 (local address 127.0.0.1:46597)
0807 22:44:38.685978 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:38.685988 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:38.686021 (+ 33us) server_negotiation.cc:407] Connection header received
0807 22:44:38.686978 (+ 957us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:38.686988 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:38.687053 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:38.687211 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:38.687802 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:38.689576 (+ 1774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:38.690713 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:38.691391 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:38.691504 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:38.694405 (+ 2901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:38.694410 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:38.694410 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:44:38.694422 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:38.696444 (+ 2022us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:38.696802 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:38.696805 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:38.696805 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:38.696900 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:38.697069 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:38.697070 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:38.697070 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:38.697336 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:38.697840 (+ 504us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:38.698330 (+ 490us) server_negotiation.cc:299] Negotiation successful
0807 22:44:38.698468 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":96,"threads_started":1}
I20260807 22:44:38.699735 23377 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:44:38.703078 23765 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:44:38.703716 23765 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:44:38.708487 23753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:38.701303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43459 (local address 127.0.0.1:46597)
0807 22:44:38.701342 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:38.701344 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:38.701473 (+ 129us) server_negotiation.cc:407] Connection header received
0807 22:44:38.701504 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:38.701505 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:38.701515 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:38.701585 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:38.702187 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:38.702937 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:38.703906 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:38.704241 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:38.704335 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:38.705725 (+ 1390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:38.705726 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:38.705727 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:44:38.705734 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:38.707261 (+ 1527us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:38.707649 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:38.707650 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:38.707650 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:38.707710 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:38.707917 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:38.707918 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:38.707918 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:38.708031 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:38.708117 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:38.708310 (+ 193us) server_negotiation.cc:299] Negotiation successful
0807 22:44:38.708404 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 22:44:38.710853 23765 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9b61b6f090ba4e788d90e8371eb3361b: Generated new TSK 0
I20260807 22:44:38.711041 23765 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:44:38.713474 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 23639
2026-08-07T22:44:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1581 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142418640232-23377-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:44:38 dist-test-slave-2d19 krb5kdc[23800](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:44:38 dist-test-slave-2d19 krb5kdc[23800](info): set up 2 sockets
Aug 07 22:44:38 dist-test-slave-2d19 krb5kdc[23800](info): commencing operation
krb5kdc: starting...
W20260807 22:44:39.974015 23377 mini_kdc.cc:121] Time spent starting KDC: real 1.227s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Aug 07 22:44:40 dist-test-slave-2d19 krb5kdc[23800](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142680, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:44:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:44:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 22:44:40.103569 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42067
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42067
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:44:40.187392 23825 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:44:40.187664 23825 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:44:40.187705 23825 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:44:40.189335 23825 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:44:40.189422 23825 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:44:40.189450 23825 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:44:40.189482 23825 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:44:40.189507 23825 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:44:40.191093 23825 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42067
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42067
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23825
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:44:40.191385 23825 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:44:40.191622 23825 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:44:40.196897 23837 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:40.196909 23841 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:40.196916 23844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:40.197021 23825 server_base.cc:1034] running on GCE node
I20260807 22:44:40.197412 23825 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:44:40.197692 23825 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:44:40.198871 23825 hybrid_clock.cc:648] HybridClock initialized: now 1786142680198849 us; error 38 us; skew 500 ppm
Aug 07 22:44:40 dist-test-slave-2d19 krb5kdc[23800](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142680, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:44:40.205592 23825 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 22:44:40.206100 23825 webserver.cc:460] Webserver started at http://127.0.0.1:33431/ using document root <none> and password file <none>
I20260807 22:44:40.206303 23825 fs_manager.cc:359] Metadata directory not provided
I20260807 22:44:40.206346 23825 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:44:40.206437 23825 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:44:40.207484 23825 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "34aaec7f907f4ef182adac360886156f"
format_stamp: "Formatted at 2026-08-07 22:44:40 on dist-test-slave-2d19"
server_key: "e8ba53eb46ff31bf805644fc07733ba5"
server_key_iv: "41ddc509dff407bc192163a3f2079d70"
server_key_version: "encryptionkey@0"
I20260807 22:44:40.207811 23825 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "34aaec7f907f4ef182adac360886156f"
format_stamp: "Formatted at 2026-08-07 22:44:40 on dist-test-slave-2d19"
server_key: "e8ba53eb46ff31bf805644fc07733ba5"
server_key_iv: "41ddc509dff407bc192163a3f2079d70"
server_key_version: "encryptionkey@0"
I20260807 22:44:40.209265 23825 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 22:44:40.210083 23855 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:40.210374 23825 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260807 22:44:40.210460 23825 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "34aaec7f907f4ef182adac360886156f"
format_stamp: "Formatted at 2026-08-07 22:44:40 on dist-test-slave-2d19"
server_key: "e8ba53eb46ff31bf805644fc07733ba5"
server_key_iv: "41ddc509dff407bc192163a3f2079d70"
server_key_version: "encryptionkey@0"
I20260807 22:44:40.210554 23825 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:44:40.223177 23825 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:44:40.225343 23825 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:44:40.225514 23825 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:44:40.229802 23825 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42067
I20260807 22:44:40.230038 23934 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42067 every 8 connection(s)
I20260807 22:44:40.230297 23825 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:44:40.231231 23937 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:44:40.233769 23937 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34aaec7f907f4ef182adac360886156f: Bootstrap starting.
I20260807 22:44:40.234391 23937 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 34aaec7f907f4ef182adac360886156f: Neither blocks nor log segments found. Creating new log.
I20260807 22:44:40.234690 23937 log.cc:824] T 00000000000000000000000000000000 P 34aaec7f907f4ef182adac360886156f: Log is configured to *not* fsync() on all Append() calls
I20260807 22:44:40.235508 23937 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34aaec7f907f4ef182adac360886156f: No bootstrap required, opened a new log
I20260807 22:44:40.237185 23937 raft_consensus.cc:348] T 00000000000000000000000000000000 P 34aaec7f907f4ef182adac360886156f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34aaec7f907f4ef182adac360886156f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42067 } }
I20260807 22:44:40.237349 23937 raft_consensus.cc:374] T 00000000000000000000000000000000 P 34aaec7f907f4ef182adac360886156f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:44:40.237399 23937 raft_consensus.cc:729] T 00000000000000000000000000000000 P 34aaec7f907f4ef182adac360886156f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34aaec7f907f4ef182adac360886156f, State: Initialized, Role: FOLLOWER
I20260807 22:44:40.237548 23937 consensus_queue.cc:260] T 00000000000000000000000000000000 P 34aaec7f907f4ef182adac360886156f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34aaec7f907f4ef182adac360886156f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42067 } }
I20260807 22:44:40.237632 23937 raft_consensus.cc:388] T 00000000000000000000000000000000 P 34aaec7f907f4ef182adac360886156f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:44:40.237679 23937 raft_consensus.cc:482] T 00000000000000000000000000000000 P 34aaec7f907f4ef182adac360886156f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:44:40.237730 23937 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 34aaec7f907f4ef182adac360886156f [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:44:40.238272 23937 raft_consensus.cc:504] T 00000000000000000000000000000000 P 34aaec7f907f4ef182adac360886156f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34aaec7f907f4ef182adac360886156f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42067 } }
I20260807 22:44:40.238394 23937 leader_election.cc:302] T 00000000000000000000000000000000 P 34aaec7f907f4ef182adac360886156f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 34aaec7f907f4ef182adac360886156f; no voters:
I20260807 22:44:40.238569 23937 leader_election.cc:288] T 00000000000000000000000000000000 P 34aaec7f907f4ef182adac360886156f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:44:40.238617 23943 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 34aaec7f907f4ef182adac360886156f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:44:40.238811 23943 raft_consensus.cc:686] T 00000000000000000000000000000000 P 34aaec7f907f4ef182adac360886156f [term 1 LEADER]: Becoming Leader. State: Replica: 34aaec7f907f4ef182adac360886156f, State: Running, Role: LEADER
I20260807 22:44:40.238853 23937 sys_catalog.cc:564] T 00000000000000000000000000000000 P 34aaec7f907f4ef182adac360886156f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:44:40.238971 23943 consensus_queue.cc:237] T 00000000000000000000000000000000 P 34aaec7f907f4ef182adac360886156f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34aaec7f907f4ef182adac360886156f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42067 } }
I20260807 22:44:40.239159 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 23825
I20260807 22:44:40.239297 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:44:40.239529 23377 external_mini_cluster.cc:1428] Setting key c29079c16cd51b95aa7c6ed62d59118f
I20260807 22:44:40.240059 23947 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34aaec7f907f4ef182adac360886156f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 34aaec7f907f4ef182adac360886156f. Latest consensus state: current_term: 1 leader_uuid: "34aaec7f907f4ef182adac360886156f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34aaec7f907f4ef182adac360886156f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42067 } } }
I20260807 22:44:40.240224 23946 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34aaec7f907f4ef182adac360886156f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "34aaec7f907f4ef182adac360886156f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34aaec7f907f4ef182adac360886156f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42067 } } }
I20260807 22:44:40.240357 23946 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34aaec7f907f4ef182adac360886156f [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:40.240234 23947 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34aaec7f907f4ef182adac360886156f [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:40.240731 23960 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:44:40.241285 23960 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:44:40.242851 23960 catalog_manager.cc:1347] Generated new cluster ID: ccdaa52c68d74d59b86934a53c15ac56
I20260807 22:44:40.242902 23960 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:44:40.246091 23959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:40.240037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55619 (local address 127.0.0.1:42067)
0807 22:44:40.240240 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:40.240273 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:40.240620 (+ 347us) server_negotiation.cc:407] Connection header received
0807 22:44:40.240790 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:40.240798 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:40.240881 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:40.241030 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:40.241205 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:40.242724 (+ 1519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:40.243877 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:40.244526 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:40.244641 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:40.245381 (+ 740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:40.245385 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:40.245385 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:44:40.245604 (+ 219us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:40.245645 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:44:40.245663 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:40.245735 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:40.245801 (+ 66us) server_negotiation.cc:299] Negotiation successful
0807 22:44:40.245868 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":86,"threads_started":1}
I20260807 22:44:40.247123 23377 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:44:40.252983 23960 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:44:40.253693 23960 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:44:40.255966 23959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:40.252713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54629 (local address 127.0.0.1:42067)
0807 22:44:40.252758 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:40.252760 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:40.252934 (+ 174us) server_negotiation.cc:407] Connection header received
0807 22:44:40.253046 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:40.253047 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:40.253070 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:40.253099 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:40.253304 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:40.253858 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:40.254602 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:40.254811 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:40.254898 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:40.255673 (+ 775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:40.255674 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:40.255675 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:44:40.255681 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:40.255695 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:44:40.255699 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:40.255764 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:40.255824 (+ 60us) server_negotiation.cc:299] Negotiation successful
0807 22:44:40.255865 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 22:44:40.259707 23960 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 34aaec7f907f4ef182adac360886156f: Generated new TSK 0
I20260807 22:44:40.259917 23960 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:44:40.264281 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 23825
2026-08-07T22:44:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1553 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142418640232-23377-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:44:40 dist-test-slave-2d19 krb5kdc[23983](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:44:40 dist-test-slave-2d19 krb5kdc[23983](info): set up 2 sockets
Aug 07 22:44:40 dist-test-slave-2d19 krb5kdc[23983](info): commencing operation
krb5kdc: starting...
W20260807 22:44:41.545177 23377 mini_kdc.cc:121] Time spent starting KDC: real 1.244s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Aug 07 22:44:41 dist-test-slave-2d19 krb5kdc[23983](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142681, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:44:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:44:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 22:44:41.675618 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44565
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44565
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:44:41.758704 24016 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:44:41.758948 24016 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:44:41.758986 24016 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:44:41.760130 24016 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:44:41.760205 24016 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:44:41.760228 24016 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:44:41.760248 24016 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:44:41.760267 24016 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:44:41.761854 24016 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44565
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44565
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24016
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:44:41.762143 24016 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:44:41.762387 24016 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:44:41.767437 24029 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:41.767418 24025 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:41.767428 24023 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:41.767733 24016 server_base.cc:1034] running on GCE node
I20260807 22:44:41.768090 24016 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:44:41.768412 24016 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:44:41.769562 24016 hybrid_clock.cc:648] HybridClock initialized: now 1786142681769536 us; error 43 us; skew 500 ppm
Aug 07 22:44:41 dist-test-slave-2d19 krb5kdc[23983](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142681, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:44:41.772176 24016 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 22:44:41.772716 24016 webserver.cc:460] Webserver started at http://127.0.0.1:38767/ using document root <none> and password file <none>
I20260807 22:44:41.772974 24016 fs_manager.cc:359] Metadata directory not provided
I20260807 22:44:41.773021 24016 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:44:41.773196 24016 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:44:41.774263 24016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "374e031d449d446b931c4824b2a962a3"
format_stamp: "Formatted at 2026-08-07 22:44:41 on dist-test-slave-2d19"
server_key: "928b0e5bbb6eafa42e7a8046735ba8c6"
server_key_iv: "5cb1a4e930b2223281b35a6988b6c197"
server_key_version: "encryptionkey@0"
I20260807 22:44:41.774644 24016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "374e031d449d446b931c4824b2a962a3"
format_stamp: "Formatted at 2026-08-07 22:44:41 on dist-test-slave-2d19"
server_key: "928b0e5bbb6eafa42e7a8046735ba8c6"
server_key_iv: "5cb1a4e930b2223281b35a6988b6c197"
server_key_version: "encryptionkey@0"
I20260807 22:44:41.776010 24016 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 22:44:41.776912 24041 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:41.777125 24016 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260807 22:44:41.777248 24016 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "374e031d449d446b931c4824b2a962a3"
format_stamp: "Formatted at 2026-08-07 22:44:41 on dist-test-slave-2d19"
server_key: "928b0e5bbb6eafa42e7a8046735ba8c6"
server_key_iv: "5cb1a4e930b2223281b35a6988b6c197"
server_key_version: "encryptionkey@0"
I20260807 22:44:41.777328 24016 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:44:41.780740 24016 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:44:41.783110 24016 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:44:41.783275 24016 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:44:41.787545 24016 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44565
I20260807 22:44:41.787575 24121 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44565 every 8 connection(s)
I20260807 22:44:41.787930 24016 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:44:41.789039 24122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:44:41.790997 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 24016
I20260807 22:44:41.791136 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:44:41.791322 23377 external_mini_cluster.cc:1428] Setting key b8a124719144858e0450aa6c597182ec
I20260807 22:44:41.791682 24122 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 374e031d449d446b931c4824b2a962a3: Bootstrap starting.
I20260807 22:44:41.792423 24122 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 374e031d449d446b931c4824b2a962a3: Neither blocks nor log segments found. Creating new log.
I20260807 22:44:41.792730 24122 log.cc:824] T 00000000000000000000000000000000 P 374e031d449d446b931c4824b2a962a3: Log is configured to *not* fsync() on all Append() calls
I20260807 22:44:41.793548 24122 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 374e031d449d446b931c4824b2a962a3: No bootstrap required, opened a new log
I20260807 22:44:41.794045 24132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:41.791837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44357 (local address 127.0.0.1:44565)
0807 22:44:41.792063 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:41.792075 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:41.792127 (+ 52us) server_negotiation.cc:407] Connection header received
0807 22:44:41.792707 (+ 580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:41.792716 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:41.792744 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:41.792912 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:41.793551 (+ 639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:41.793555 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:41.793555 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:44:41.793559 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:41.793618 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:44:41.793635 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:41.793737 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:41.793839 (+ 102us) server_negotiation.cc:299] Negotiation successful
0807 22:44:41.793885 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":110,"threads_started":1}
I20260807 22:44:41.795059 23377 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:44:41.796003 24122 raft_consensus.cc:348] T 00000000000000000000000000000000 P 374e031d449d446b931c4824b2a962a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "374e031d449d446b931c4824b2a962a3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44565 } }
I20260807 22:44:41.796182 24122 raft_consensus.cc:374] T 00000000000000000000000000000000 P 374e031d449d446b931c4824b2a962a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:44:41.796231 24122 raft_consensus.cc:729] T 00000000000000000000000000000000 P 374e031d449d446b931c4824b2a962a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 374e031d449d446b931c4824b2a962a3, State: Initialized, Role: FOLLOWER
I20260807 22:44:41.796381 24122 consensus_queue.cc:260] T 00000000000000000000000000000000 P 374e031d449d446b931c4824b2a962a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "374e031d449d446b931c4824b2a962a3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44565 } }
I20260807 22:44:41.796500 24122 raft_consensus.cc:388] T 00000000000000000000000000000000 P 374e031d449d446b931c4824b2a962a3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:44:41.796548 24122 raft_consensus.cc:482] T 00000000000000000000000000000000 P 374e031d449d446b931c4824b2a962a3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:44:41.796595 24122 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 374e031d449d446b931c4824b2a962a3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:44:41.797219 24122 raft_consensus.cc:504] T 00000000000000000000000000000000 P 374e031d449d446b931c4824b2a962a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "374e031d449d446b931c4824b2a962a3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44565 } }
I20260807 22:44:41.797358 24122 leader_election.cc:302] T 00000000000000000000000000000000 P 374e031d449d446b931c4824b2a962a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 374e031d449d446b931c4824b2a962a3; no voters:
I20260807 22:44:41.797541 24122 leader_election.cc:288] T 00000000000000000000000000000000 P 374e031d449d446b931c4824b2a962a3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:44:41.797587 24151 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 374e031d449d446b931c4824b2a962a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:44:41.797676 24132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:41.796459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53377 (local address 127.0.0.1:44565)
0807 22:44:41.796497 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:41.796499 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:41.796606 (+ 107us) server_negotiation.cc:407] Connection header received
0807 22:44:41.796677 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:41.796678 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:41.796684 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:41.796752 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:41.797365 (+ 613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:41.797367 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:41.797367 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:44:41.797372 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:41.797387 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:44:41.797392 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:41.797458 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:41.797551 (+ 93us) server_negotiation.cc:299] Negotiation successful
0807 22:44:41.797565 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 22:44:41.797798 24151 raft_consensus.cc:686] T 00000000000000000000000000000000 P 374e031d449d446b931c4824b2a962a3 [term 1 LEADER]: Becoming Leader. State: Replica: 374e031d449d446b931c4824b2a962a3, State: Running, Role: LEADER
I20260807 22:44:41.797880 24122 sys_catalog.cc:564] T 00000000000000000000000000000000 P 374e031d449d446b931c4824b2a962a3 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:44:41.797915 24151 consensus_queue.cc:237] T 00000000000000000000000000000000 P 374e031d449d446b931c4824b2a962a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "374e031d449d446b931c4824b2a962a3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44565 } }
I20260807 22:44:41.798275 24151 sys_catalog.cc:455] T 00000000000000000000000000000000 P 374e031d449d446b931c4824b2a962a3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 374e031d449d446b931c4824b2a962a3. Latest consensus state: current_term: 1 leader_uuid: "374e031d449d446b931c4824b2a962a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "374e031d449d446b931c4824b2a962a3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44565 } } }
I20260807 22:44:41.798292 24152 sys_catalog.cc:455] T 00000000000000000000000000000000 P 374e031d449d446b931c4824b2a962a3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "374e031d449d446b931c4824b2a962a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "374e031d449d446b931c4824b2a962a3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44565 } } }
I20260807 22:44:41.798429 24151 sys_catalog.cc:458] T 00000000000000000000000000000000 P 374e031d449d446b931c4824b2a962a3 [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:41.798435 24152 sys_catalog.cc:458] T 00000000000000000000000000000000 P 374e031d449d446b931c4824b2a962a3 [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:41.798693 24166 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:44:41.799203 24166 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:44:41.800812 24166 catalog_manager.cc:1347] Generated new cluster ID: 217a7e3f8ac543aebb95422c9ee0b76c
I20260807 22:44:41.800866 24166 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:44:41.816745 24166 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:44:41.816974 24166 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:44:41.826784 24166 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 374e031d449d446b931c4824b2a962a3: Generated new TSK 0
I20260807 22:44:41.827009 24166 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:44:41.834122 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 24016
2026-08-07T22:44:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1560 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142418640232-23377-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:44:41 dist-test-slave-2d19 krb5kdc[24189](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:44:41 dist-test-slave-2d19 krb5kdc[24189](info): set up 2 sockets
Aug 07 22:44:41 dist-test-slave-2d19 krb5kdc[24189](info): commencing operation
krb5kdc: starting...
W20260807 22:44:43.086745 23377 mini_kdc.cc:121] Time spent starting KDC: real 1.226s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Aug 07 22:44:43 dist-test-slave-2d19 krb5kdc[24189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142683, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:44:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:44:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 22:44:43.219745 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46753
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46753
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:44:43.309499 24209 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:44:43.309736 24209 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:44:43.309772 24209 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:44:43.310920 24209 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:44:43.310986 24209 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:44:43.311009 24209 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:44:43.311030 24209 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:44:43.311061 24209 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:44:43.312585 24209 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46753
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46753
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24209
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:44:43.312871 24209 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:44:43.313098 24209 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 22:44:43.318290 24209 server_base.cc:1034] running on GCE node
W20260807 22:44:43.318238 24216 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:43.318249 24223 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:43.318249 24217 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:43.318744 24209 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:44:43.319083 24209 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:44:43.320322 24209 hybrid_clock.cc:648] HybridClock initialized: now 1786142683320292 us; error 36 us; skew 500 ppm
Aug 07 22:44:43 dist-test-slave-2d19 krb5kdc[24189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142683, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:44:43.322894 24209 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 22:44:43.323344 24209 webserver.cc:460] Webserver started at http://127.0.0.1:46111/ using document root <none> and password file <none>
I20260807 22:44:43.323618 24209 fs_manager.cc:359] Metadata directory not provided
I20260807 22:44:43.323693 24209 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:44:43.323846 24209 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:44:43.325095 24209 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "9378bdde11e247f0a0e113bc19beac48"
format_stamp: "Formatted at 2026-08-07 22:44:43 on dist-test-slave-2d19"
server_key: "adc57d7986bfc3d5e2b44d1aa165de9a"
server_key_iv: "9df317a03b0b520da478406cc9fe418a"
server_key_version: "encryptionkey@0"
I20260807 22:44:43.325480 24209 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "9378bdde11e247f0a0e113bc19beac48"
format_stamp: "Formatted at 2026-08-07 22:44:43 on dist-test-slave-2d19"
server_key: "adc57d7986bfc3d5e2b44d1aa165de9a"
server_key_iv: "9df317a03b0b520da478406cc9fe418a"
server_key_version: "encryptionkey@0"
I20260807 22:44:43.326853 24209 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 22:44:43.327646 24231 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:43.327848 24209 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 22:44:43.327946 24209 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "9378bdde11e247f0a0e113bc19beac48"
format_stamp: "Formatted at 2026-08-07 22:44:43 on dist-test-slave-2d19"
server_key: "adc57d7986bfc3d5e2b44d1aa165de9a"
server_key_iv: "9df317a03b0b520da478406cc9fe418a"
server_key_version: "encryptionkey@0"
I20260807 22:44:43.328037 24209 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:44:43.338778 24209 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:44:43.340670 24209 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:44:43.340831 24209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:44:43.344800 24209 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46753
I20260807 22:44:43.344862 24316 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46753 every 8 connection(s)
I20260807 22:44:43.345284 24209 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:44:43.346261 24317 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:44:43.348680 24317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9378bdde11e247f0a0e113bc19beac48: Bootstrap starting.
I20260807 22:44:43.349305 24317 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9378bdde11e247f0a0e113bc19beac48: Neither blocks nor log segments found. Creating new log.
I20260807 22:44:43.349606 24317 log.cc:824] T 00000000000000000000000000000000 P 9378bdde11e247f0a0e113bc19beac48: Log is configured to *not* fsync() on all Append() calls
I20260807 22:44:43.350359 24317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9378bdde11e247f0a0e113bc19beac48: No bootstrap required, opened a new log
I20260807 22:44:43.352061 24317 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9378bdde11e247f0a0e113bc19beac48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9378bdde11e247f0a0e113bc19beac48" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46753 } }
I20260807 22:44:43.352203 24317 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9378bdde11e247f0a0e113bc19beac48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:44:43.352227 24317 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9378bdde11e247f0a0e113bc19beac48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9378bdde11e247f0a0e113bc19beac48, State: Initialized, Role: FOLLOWER
I20260807 22:44:43.352442 24317 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9378bdde11e247f0a0e113bc19beac48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9378bdde11e247f0a0e113bc19beac48" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46753 } }
I20260807 22:44:43.352533 24317 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9378bdde11e247f0a0e113bc19beac48 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:44:43.352557 24317 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9378bdde11e247f0a0e113bc19beac48 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:44:43.352615 24317 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9378bdde11e247f0a0e113bc19beac48 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:44:43.353147 24317 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9378bdde11e247f0a0e113bc19beac48 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9378bdde11e247f0a0e113bc19beac48" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46753 } }
I20260807 22:44:43.353262 24317 leader_election.cc:302] T 00000000000000000000000000000000 P 9378bdde11e247f0a0e113bc19beac48 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9378bdde11e247f0a0e113bc19beac48; no voters:
I20260807 22:44:43.353456 24317 leader_election.cc:288] T 00000000000000000000000000000000 P 9378bdde11e247f0a0e113bc19beac48 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:44:43.353505 24320 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9378bdde11e247f0a0e113bc19beac48 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:44:43.353700 24320 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9378bdde11e247f0a0e113bc19beac48 [term 1 LEADER]: Becoming Leader. State: Replica: 9378bdde11e247f0a0e113bc19beac48, State: Running, Role: LEADER
I20260807 22:44:43.353749 24317 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9378bdde11e247f0a0e113bc19beac48 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:44:43.353883 24320 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9378bdde11e247f0a0e113bc19beac48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9378bdde11e247f0a0e113bc19beac48" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46753 } }
I20260807 22:44:43.354305 24325 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9378bdde11e247f0a0e113bc19beac48 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9378bdde11e247f0a0e113bc19beac48" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9378bdde11e247f0a0e113bc19beac48" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46753 } } }
I20260807 22:44:43.354404 24325 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9378bdde11e247f0a0e113bc19beac48 [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:43.354310 24326 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9378bdde11e247f0a0e113bc19beac48 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9378bdde11e247f0a0e113bc19beac48. Latest consensus state: current_term: 1 leader_uuid: "9378bdde11e247f0a0e113bc19beac48" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9378bdde11e247f0a0e113bc19beac48" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46753 } } }
I20260807 22:44:43.354524 24326 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9378bdde11e247f0a0e113bc19beac48 [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:43.354686 24328 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:44:43.355257 24328 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:44:43.355528 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 24209
I20260807 22:44:43.355662 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:44:43.355849 23377 external_mini_cluster.cc:1428] Setting key 87ef5753ac95e9ffc89e67308b4ff4b0
I20260807 22:44:43.357101 24328 catalog_manager.cc:1347] Generated new cluster ID: 4f359b472ecd4fec828a6a1f72ca3433
I20260807 22:44:43.357158 24328 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 22:44:43 dist-test-slave-2d19 krb5kdc[24189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142683, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 22:44:43.368943 24353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:43.356377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.12:54633 (local address 127.0.0.1:46753)
0807 22:44:43.356674 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:43.356683 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:43.356720 (+ 37us) server_negotiation.cc:407] Connection header received
0807 22:44:43.356848 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:43.356855 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:43.356926 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:43.357078 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:43.357988 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:43.359446 (+ 1458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:43.360638 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:43.361293 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:43.361401 (+ 108us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:43.364697 (+ 3296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:43.364701 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:43.364702 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:44:43.364717 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:43.366916 (+ 2199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:43.367410 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:43.367413 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:43.367414 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:43.367544 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:43.367802 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:43.367803 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:43.367804 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:43.368152 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:43.368346 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:43.368600 (+ 254us) server_negotiation.cc:299] Negotiation successful
0807 22:44:43.368712 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":252,"thread_start_us":92,"threads_started":1}
I20260807 22:44:43.370103 23377 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:44:43.370920 24328 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:44:43.371631 24328 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:44:43.378262 24328 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9378bdde11e247f0a0e113bc19beac48: Generated new TSK 0
I20260807 22:44:43.378472 24328 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:44:43.380105 24353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:43.371802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.12:47759 (local address 127.0.0.1:46753)
0807 22:44:43.371838 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:43.371839 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:43.372413 (+ 574us) server_negotiation.cc:407] Connection header received
0807 22:44:43.372510 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:43.372511 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:43.372522 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:43.372551 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:43.373282 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:43.374120 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:43.375206 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:43.375547 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:43.375587 (+ 40us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:43.377230 (+ 1643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:43.377231 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:43.377232 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:44:43.377239 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:43.378909 (+ 1670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:43.379291 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:43.379292 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:43.379292 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:43.379374 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:43.379607 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:43.379608 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:43.379608 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:43.379738 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:43.379838 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:43.379945 (+ 107us) server_negotiation.cc:299] Negotiation successful
0807 22:44:43.380012 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260807 22:44:43.382285 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 24209
W20260807 22:44:43.398998 24182 connection.cc:535] client connection to 127.0.0.1:46753 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46753): Connection reset by peer (error 104)
2026-08-07T22:44:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1552 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142418640232-23377-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:44:43 dist-test-slave-2d19 krb5kdc[24364](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:44:43 dist-test-slave-2d19 krb5kdc[24364](info): set up 2 sockets
Aug 07 22:44:43 dist-test-slave-2d19 krb5kdc[24364](info): commencing operation
krb5kdc: starting...
W20260807 22:44:44.650216 23377 mini_kdc.cc:121] Time spent starting KDC: real 1.237s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Aug 07 22:44:44 dist-test-slave-2d19 krb5kdc[24364](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142684, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:44:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:44:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 22:44:44.782887 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46751
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46751
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:44:44.868032 24380 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:44:44.868316 24380 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:44:44.868356 24380 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:44:44.869527 24380 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:44:44.869606 24380 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:44:44.869632 24380 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:44:44.869659 24380 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:44:44.869688 24380 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:44:44.871220 24380 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46751
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46751
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24380
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:44:44.871520 24380 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:44:44.871762 24380 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:44:44.876996 24398 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:44.877053 24402 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:44.877246 24380 server_base.cc:1034] running on GCE node
W20260807 22:44:44.877251 24396 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:44.877584 24380 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:44:44.877902 24380 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:44:44.879069 24380 hybrid_clock.cc:648] HybridClock initialized: now 1786142684879051 us; error 30 us; skew 500 ppm
Aug 07 22:44:44 dist-test-slave-2d19 krb5kdc[24364](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142684, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:44:44.881650 24380 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 22:44:44.882134 24380 webserver.cc:460] Webserver started at http://127.0.0.1:37735/ using document root <none> and password file <none>
I20260807 22:44:44.882403 24380 fs_manager.cc:359] Metadata directory not provided
I20260807 22:44:44.882452 24380 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:44:44.882588 24380 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:44:44.883744 24380 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "91c85e896c08444d8ed394cc2eeede04"
format_stamp: "Formatted at 2026-08-07 22:44:44 on dist-test-slave-2d19"
server_key: "e4db371ab2efdf4fac20b60c6d2a1c1b"
server_key_iv: "3978cdfe58d0e879f6fcd3ae2bb43567"
server_key_version: "encryptionkey@0"
I20260807 22:44:44.884120 24380 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "91c85e896c08444d8ed394cc2eeede04"
format_stamp: "Formatted at 2026-08-07 22:44:44 on dist-test-slave-2d19"
server_key: "e4db371ab2efdf4fac20b60c6d2a1c1b"
server_key_iv: "3978cdfe58d0e879f6fcd3ae2bb43567"
server_key_version: "encryptionkey@0"
I20260807 22:44:44.885663 24380 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 22:44:44.886488 24415 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:44.886711 24380 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 22:44:44.886803 24380 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "91c85e896c08444d8ed394cc2eeede04"
format_stamp: "Formatted at 2026-08-07 22:44:44 on dist-test-slave-2d19"
server_key: "e4db371ab2efdf4fac20b60c6d2a1c1b"
server_key_iv: "3978cdfe58d0e879f6fcd3ae2bb43567"
server_key_version: "encryptionkey@0"
I20260807 22:44:44.886861 24380 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:44:44.911496 24380 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:44:44.913625 24380 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:44:44.913746 24380 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:44:44.917804 24380 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46751
I20260807 22:44:44.917865 24492 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46751 every 8 connection(s)
I20260807 22:44:44.918243 24380 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:44:44.918613 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 24380
I20260807 22:44:44.918738 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:44:44.918936 23377 external_mini_cluster.cc:1428] Setting key cef11d3098c5f565860a9c2647003631
I20260807 22:44:44.919471 24493 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:44:44.922390 24493 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91c85e896c08444d8ed394cc2eeede04: Bootstrap starting.
I20260807 22:44:44.922924 24493 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 91c85e896c08444d8ed394cc2eeede04: Neither blocks nor log segments found. Creating new log.
I20260807 22:44:44.923228 24493 log.cc:824] T 00000000000000000000000000000000 P 91c85e896c08444d8ed394cc2eeede04: Log is configured to *not* fsync() on all Append() calls
I20260807 22:44:44.924031 24493 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91c85e896c08444d8ed394cc2eeede04: No bootstrap required, opened a new log
I20260807 22:44:44.924919 24502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:44.919637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.12:39607 (local address 127.0.0.1:46751)
0807 22:44:44.919830 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:44.919838 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:44.919863 (+ 25us) server_negotiation.cc:407] Connection header received
0807 22:44:44.920671 (+ 808us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:44.920679 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:44.920738 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:44.920900 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:44.921090 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:44.921962 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:44.922846 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:44.923350 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:44.923495 (+ 145us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:44.924289 (+ 794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:44.924294 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:44.924295 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:44:44.924477 (+ 182us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:44.924507 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:44:44.924518 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:44.924612 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:44.924694 (+ 82us) server_negotiation.cc:299] Negotiation successful
0807 22:44:44.924722 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":96,"threads_started":1}
I20260807 22:44:44.926059 23377 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:44:44.926496 24493 raft_consensus.cc:348] T 00000000000000000000000000000000 P 91c85e896c08444d8ed394cc2eeede04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91c85e896c08444d8ed394cc2eeede04" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46751 } }
I20260807 22:44:44.926661 24493 raft_consensus.cc:374] T 00000000000000000000000000000000 P 91c85e896c08444d8ed394cc2eeede04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:44:44.926751 24493 raft_consensus.cc:729] T 00000000000000000000000000000000 P 91c85e896c08444d8ed394cc2eeede04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91c85e896c08444d8ed394cc2eeede04, State: Initialized, Role: FOLLOWER
I20260807 22:44:44.926903 24493 consensus_queue.cc:260] T 00000000000000000000000000000000 P 91c85e896c08444d8ed394cc2eeede04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91c85e896c08444d8ed394cc2eeede04" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46751 } }
I20260807 22:44:44.927001 24493 raft_consensus.cc:388] T 00000000000000000000000000000000 P 91c85e896c08444d8ed394cc2eeede04 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:44:44.927062 24493 raft_consensus.cc:482] T 00000000000000000000000000000000 P 91c85e896c08444d8ed394cc2eeede04 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:44:44.927115 24493 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 91c85e896c08444d8ed394cc2eeede04 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:44:44.927873 24493 raft_consensus.cc:504] T 00000000000000000000000000000000 P 91c85e896c08444d8ed394cc2eeede04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91c85e896c08444d8ed394cc2eeede04" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46751 } }
I20260807 22:44:44.927991 24493 leader_election.cc:302] T 00000000000000000000000000000000 P 91c85e896c08444d8ed394cc2eeede04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 91c85e896c08444d8ed394cc2eeede04; no voters:
I20260807 22:44:44.928151 24493 leader_election.cc:288] T 00000000000000000000000000000000 P 91c85e896c08444d8ed394cc2eeede04 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:44:44.928220 24518 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 91c85e896c08444d8ed394cc2eeede04 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:44:44.928411 24493 sys_catalog.cc:564] T 00000000000000000000000000000000 P 91c85e896c08444d8ed394cc2eeede04 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:44:44.928442 24518 raft_consensus.cc:686] T 00000000000000000000000000000000 P 91c85e896c08444d8ed394cc2eeede04 [term 1 LEADER]: Becoming Leader. State: Replica: 91c85e896c08444d8ed394cc2eeede04, State: Running, Role: LEADER
I20260807 22:44:44.928578 24518 consensus_queue.cc:237] T 00000000000000000000000000000000 P 91c85e896c08444d8ed394cc2eeede04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91c85e896c08444d8ed394cc2eeede04" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46751 } }
I20260807 22:44:44.928891 24518 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91c85e896c08444d8ed394cc2eeede04 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 91c85e896c08444d8ed394cc2eeede04. Latest consensus state: current_term: 1 leader_uuid: "91c85e896c08444d8ed394cc2eeede04" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91c85e896c08444d8ed394cc2eeede04" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46751 } } }
I20260807 22:44:44.928964 24518 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91c85e896c08444d8ed394cc2eeede04 [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:44.929081 24519 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91c85e896c08444d8ed394cc2eeede04 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "91c85e896c08444d8ed394cc2eeede04" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91c85e896c08444d8ed394cc2eeede04" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46751 } } }
I20260807 22:44:44.929171 24519 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91c85e896c08444d8ed394cc2eeede04 [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:44.929960 24522 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:44:44.930521 24522 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:44:44.931180 24502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:44.927621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.12:56653 (local address 127.0.0.1:46751)
0807 22:44:44.927678 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:44.927681 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:44.927705 (+ 24us) server_negotiation.cc:407] Connection header received
0807 22:44:44.927779 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:44.927780 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:44.927792 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:44.927858 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:44.927998 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:44.928715 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:44.929717 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:44.930020 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:44.930083 (+ 63us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:44.930847 (+ 764us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:44.930849 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:44.930849 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:44:44.930854 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:44.930870 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:44:44.930874 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:44.930928 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:44.931074 (+ 146us) server_negotiation.cc:299] Negotiation successful
0807 22:44:44.931084 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260807 22:44:44.932101 24522 catalog_manager.cc:1347] Generated new cluster ID: a419d2533ddc490989a5cdd81ef97f8d
I20260807 22:44:44.932155 24522 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:44:44.937999 24522 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:44:44.938742 24522 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:44:44.941138 24522 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 91c85e896c08444d8ed394cc2eeede04: Generated new TSK 0
I20260807 22:44:44.941300 24522 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:44:44.948915 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 24380
W20260807 22:44:44.959543 24362 connection.cc:535] client connection to 127.0.0.1:46751 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46751): Connection reset by peer (error 104)
2026-08-07T22:44:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1560 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142418640232-23377-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:44:45 dist-test-slave-2d19 krb5kdc[24551](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:44:45 dist-test-slave-2d19 krb5kdc[24551](info): set up 2 sockets
Aug 07 22:44:45 dist-test-slave-2d19 krb5kdc[24551](info): commencing operation
krb5kdc: starting...
W20260807 22:44:46.235140 23377 mini_kdc.cc:121] Time spent starting KDC: real 1.262s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Aug 07 22:44:46 dist-test-slave-2d19 krb5kdc[24551](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142686, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:44:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:44:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 22:44:46.367174 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39315
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39315
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:44:46.453522 24573 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:44:46.453756 24573 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:44:46.453794 24573 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:44:46.454929 24573 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:44:46.454998 24573 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:44:46.455020 24573 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:44:46.455041 24573 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:44:46.455067 24573 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:44:46.456600 24573 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39315
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39315
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24573
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:44:46.456884 24573 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:44:46.457118 24573 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:44:46.462198 24581 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:46.462212 24582 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:46.462267 24573 server_base.cc:1034] running on GCE node
W20260807 22:44:46.462212 24584 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:46.462694 24573 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:44:46.462941 24573 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:44:46.464090 24573 hybrid_clock.cc:648] HybridClock initialized: now 1786142686464067 us; error 36 us; skew 500 ppm
Aug 07 22:44:46 dist-test-slave-2d19 krb5kdc[24551](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142686, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:44:46.473647 24573 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 22:44:46.474112 24573 webserver.cc:460] Webserver started at http://127.0.0.1:34931/ using document root <none> and password file <none>
I20260807 22:44:46.474362 24573 fs_manager.cc:359] Metadata directory not provided
I20260807 22:44:46.474411 24573 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:44:46.474550 24573 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:44:46.475661 24573 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "7d488b9f0b714a3693f125e02788a30f"
format_stamp: "Formatted at 2026-08-07 22:44:46 on dist-test-slave-2d19"
server_key: "a0f1edd84e66ca7943c7f00d186c662c"
server_key_iv: "edb74ad16d382de95baab79fc61729dd"
server_key_version: "encryptionkey@0"
I20260807 22:44:46.476032 24573 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "7d488b9f0b714a3693f125e02788a30f"
format_stamp: "Formatted at 2026-08-07 22:44:46 on dist-test-slave-2d19"
server_key: "a0f1edd84e66ca7943c7f00d186c662c"
server_key_iv: "edb74ad16d382de95baab79fc61729dd"
server_key_version: "encryptionkey@0"
I20260807 22:44:46.477519 24573 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 22:44:46.478340 24595 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:46.478562 24573 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:44:46.478690 24573 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "7d488b9f0b714a3693f125e02788a30f"
format_stamp: "Formatted at 2026-08-07 22:44:46 on dist-test-slave-2d19"
server_key: "a0f1edd84e66ca7943c7f00d186c662c"
server_key_iv: "edb74ad16d382de95baab79fc61729dd"
server_key_version: "encryptionkey@0"
I20260807 22:44:46.478770 24573 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:44:46.482227 24573 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:44:46.484215 24573 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:44:46.484403 24573 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:44:46.488380 24573 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39315
I20260807 22:44:46.488432 24678 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39315 every 8 connection(s)
I20260807 22:44:46.488790 24573 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:44:46.489779 24679 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:44:46.492080 24679 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d488b9f0b714a3693f125e02788a30f: Bootstrap starting.
I20260807 22:44:46.492730 24679 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7d488b9f0b714a3693f125e02788a30f: Neither blocks nor log segments found. Creating new log.
I20260807 22:44:46.493039 24679 log.cc:824] T 00000000000000000000000000000000 P 7d488b9f0b714a3693f125e02788a30f: Log is configured to *not* fsync() on all Append() calls
I20260807 22:44:46.493064 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 24573
I20260807 22:44:46.493197 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:44:46.493391 23377 external_mini_cluster.cc:1428] Setting key 8adbc7f2644ce05369edda2732464c06
I20260807 22:44:46.493772 24679 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d488b9f0b714a3693f125e02788a30f: No bootstrap required, opened a new log
I20260807 22:44:46.496096 24679 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7d488b9f0b714a3693f125e02788a30f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d488b9f0b714a3693f125e02788a30f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39315 } }
I20260807 22:44:46.496328 24679 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7d488b9f0b714a3693f125e02788a30f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:44:46.496397 24679 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7d488b9f0b714a3693f125e02788a30f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d488b9f0b714a3693f125e02788a30f, State: Initialized, Role: FOLLOWER
I20260807 22:44:46.496534 24679 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7d488b9f0b714a3693f125e02788a30f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d488b9f0b714a3693f125e02788a30f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39315 } }
I20260807 22:44:46.496613 24679 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7d488b9f0b714a3693f125e02788a30f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:44:46.496634 24679 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7d488b9f0b714a3693f125e02788a30f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:44:46.496696 24679 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7d488b9f0b714a3693f125e02788a30f [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:44:46.496760 24692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:46.493929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.12:35071 (local address 127.0.0.1:39315)
0807 22:44:46.494149 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:46.494158 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:46.494184 (+ 26us) server_negotiation.cc:407] Connection header received
0807 22:44:46.495044 (+ 860us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:46.495051 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:46.495078 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:46.495210 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:46.495920 (+ 710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:46.495924 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:46.495924 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:44:46.495928 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:46.495967 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:44:46.495978 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:46.496035 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:46.496155 (+ 120us) server_negotiation.cc:299] Negotiation successful
0807 22:44:46.496226 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":110,"threads_started":1}
I20260807 22:44:46.497463 24679 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7d488b9f0b714a3693f125e02788a30f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d488b9f0b714a3693f125e02788a30f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39315 } }
I20260807 22:44:46.497571 24679 leader_election.cc:302] T 00000000000000000000000000000000 P 7d488b9f0b714a3693f125e02788a30f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7d488b9f0b714a3693f125e02788a30f; no voters:
I20260807 22:44:46.497747 24679 leader_election.cc:288] T 00000000000000000000000000000000 P 7d488b9f0b714a3693f125e02788a30f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:44:46.497840 23377 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:44:46.497848 24693 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7d488b9f0b714a3693f125e02788a30f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:44:46.497987 24693 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7d488b9f0b714a3693f125e02788a30f [term 1 LEADER]: Becoming Leader. State: Replica: 7d488b9f0b714a3693f125e02788a30f, State: Running, Role: LEADER
I20260807 22:44:46.498026 24679 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7d488b9f0b714a3693f125e02788a30f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:44:46.498071 24693 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7d488b9f0b714a3693f125e02788a30f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d488b9f0b714a3693f125e02788a30f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39315 } }
I20260807 22:44:46.498392 24693 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d488b9f0b714a3693f125e02788a30f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7d488b9f0b714a3693f125e02788a30f. Latest consensus state: current_term: 1 leader_uuid: "7d488b9f0b714a3693f125e02788a30f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d488b9f0b714a3693f125e02788a30f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39315 } } }
I20260807 22:44:46.498404 24694 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d488b9f0b714a3693f125e02788a30f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7d488b9f0b714a3693f125e02788a30f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d488b9f0b714a3693f125e02788a30f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39315 } } }
I20260807 22:44:46.498479 24693 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d488b9f0b714a3693f125e02788a30f [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:46.498515 24694 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d488b9f0b714a3693f125e02788a30f [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:46.498685 24699 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:44:46.499660 24699 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:44:46.500981 24692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:46.499629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.12:49093 (local address 127.0.0.1:39315)
0807 22:44:46.499672 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:46.499674 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:46.499813 (+ 139us) server_negotiation.cc:407] Connection header received
0807 22:44:46.499947 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:46.499948 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:46.499954 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:46.500017 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:46.500743 (+ 726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:46.500744 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:46.500744 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:44:46.500749 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:46.500763 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:44:46.500767 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:46.500825 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:46.500885 (+ 60us) server_negotiation.cc:299] Negotiation successful
0807 22:44:46.500899 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 22:44:46.501549 24699 catalog_manager.cc:1347] Generated new cluster ID: 77c3fced28be4474b929ec18fa450706
I20260807 22:44:46.501598 24699 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:44:46.511803 24699 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:44:46.511992 24699 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:44:46.516273 24699 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7d488b9f0b714a3693f125e02788a30f: Generated new TSK 0
I20260807 22:44:46.516444 24699 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:44:46.519315 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 24573
2026-08-07T22:44:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1581 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142418640232-23377-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:44:46 dist-test-slave-2d19 krb5kdc[24731](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:44:46 dist-test-slave-2d19 krb5kdc[24731](info): set up 2 sockets
Aug 07 22:44:46 dist-test-slave-2d19 krb5kdc[24731](info): commencing operation
krb5kdc: starting...
W20260807 22:44:47.791983 23377 mini_kdc.cc:121] Time spent starting KDC: real 1.237s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Aug 07 22:44:47 dist-test-slave-2d19 krb5kdc[24731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142687, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:44:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:44:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 22:44:47.923463 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44541
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44541
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:44:48.009198 24754 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:44:48.009409 24754 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:44:48.009433 24754 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:44:48.010846 24754 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:44:48.010946 24754 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:44:48.010964 24754 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:44:48.010978 24754 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:44:48.010991 24754 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:44:48.012746 24754 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44541
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44541
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24754
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:44:48.013020 24754 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:44:48.013276 24754 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:44:48.018599 24761 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:48.018594 24766 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:48.018685 24754 server_base.cc:1034] running on GCE node
W20260807 22:44:48.018591 24762 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:48.019236 24754 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:44:48.019593 24754 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:44:48.020768 24754 hybrid_clock.cc:648] HybridClock initialized: now 1786142688020755 us; error 28 us; skew 500 ppm
Aug 07 22:44:48 dist-test-slave-2d19 krb5kdc[24731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142688, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:44:48.023548 24754 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 22:44:48.024055 24754 webserver.cc:460] Webserver started at http://127.0.0.1:33605/ using document root <none> and password file <none>
I20260807 22:44:48.024391 24754 fs_manager.cc:359] Metadata directory not provided
I20260807 22:44:48.024469 24754 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:44:48.024629 24754 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:44:48.025723 24754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "cfcb42b8624a4e56a600ceb35c2cbfd1"
format_stamp: "Formatted at 2026-08-07 22:44:48 on dist-test-slave-2d19"
server_key: "b91ea2aed7bed9f0ad7cc5b88505e0e3"
server_key_iv: "dfa02b957d89846bcba4ea19de597bf7"
server_key_version: "encryptionkey@0"
I20260807 22:44:48.026108 24754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "cfcb42b8624a4e56a600ceb35c2cbfd1"
format_stamp: "Formatted at 2026-08-07 22:44:48 on dist-test-slave-2d19"
server_key: "b91ea2aed7bed9f0ad7cc5b88505e0e3"
server_key_iv: "dfa02b957d89846bcba4ea19de597bf7"
server_key_version: "encryptionkey@0"
I20260807 22:44:48.027537 24754 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 22:44:48.028476 24777 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:48.028695 24754 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:44:48.028810 24754 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "cfcb42b8624a4e56a600ceb35c2cbfd1"
format_stamp: "Formatted at 2026-08-07 22:44:48 on dist-test-slave-2d19"
server_key: "b91ea2aed7bed9f0ad7cc5b88505e0e3"
server_key_iv: "dfa02b957d89846bcba4ea19de597bf7"
server_key_version: "encryptionkey@0"
I20260807 22:44:48.028888 24754 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:44:48.042613 24754 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:44:48.045183 24754 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:44:48.045359 24754 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:44:48.049374 24754 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44541
I20260807 22:44:48.049422 24859 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44541 every 8 connection(s)
I20260807 22:44:48.049824 24754 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:44:48.050851 24860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:44:48.053234 24860 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cfcb42b8624a4e56a600ceb35c2cbfd1: Bootstrap starting.
I20260807 22:44:48.053848 24860 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cfcb42b8624a4e56a600ceb35c2cbfd1: Neither blocks nor log segments found. Creating new log.
I20260807 22:44:48.054147 24860 log.cc:824] T 00000000000000000000000000000000 P cfcb42b8624a4e56a600ceb35c2cbfd1: Log is configured to *not* fsync() on all Append() calls
I20260807 22:44:48.054924 24860 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cfcb42b8624a4e56a600ceb35c2cbfd1: No bootstrap required, opened a new log
I20260807 22:44:48.056630 24860 raft_consensus.cc:348] T 00000000000000000000000000000000 P cfcb42b8624a4e56a600ceb35c2cbfd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfcb42b8624a4e56a600ceb35c2cbfd1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44541 } }
I20260807 22:44:48.056777 24860 raft_consensus.cc:374] T 00000000000000000000000000000000 P cfcb42b8624a4e56a600ceb35c2cbfd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:44:48.056798 24860 raft_consensus.cc:729] T 00000000000000000000000000000000 P cfcb42b8624a4e56a600ceb35c2cbfd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfcb42b8624a4e56a600ceb35c2cbfd1, State: Initialized, Role: FOLLOWER
I20260807 22:44:48.056989 24860 consensus_queue.cc:260] T 00000000000000000000000000000000 P cfcb42b8624a4e56a600ceb35c2cbfd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfcb42b8624a4e56a600ceb35c2cbfd1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44541 } }
I20260807 22:44:48.057077 24860 raft_consensus.cc:388] T 00000000000000000000000000000000 P cfcb42b8624a4e56a600ceb35c2cbfd1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:44:48.057120 24860 raft_consensus.cc:482] T 00000000000000000000000000000000 P cfcb42b8624a4e56a600ceb35c2cbfd1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:44:48.057170 24860 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cfcb42b8624a4e56a600ceb35c2cbfd1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:44:48.057714 24860 raft_consensus.cc:504] T 00000000000000000000000000000000 P cfcb42b8624a4e56a600ceb35c2cbfd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfcb42b8624a4e56a600ceb35c2cbfd1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44541 } }
I20260807 22:44:48.057834 24860 leader_election.cc:302] T 00000000000000000000000000000000 P cfcb42b8624a4e56a600ceb35c2cbfd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cfcb42b8624a4e56a600ceb35c2cbfd1; no voters:
I20260807 22:44:48.058032 24860 leader_election.cc:288] T 00000000000000000000000000000000 P cfcb42b8624a4e56a600ceb35c2cbfd1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:44:48.058064 24867 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cfcb42b8624a4e56a600ceb35c2cbfd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:44:48.058288 24867 raft_consensus.cc:686] T 00000000000000000000000000000000 P cfcb42b8624a4e56a600ceb35c2cbfd1 [term 1 LEADER]: Becoming Leader. State: Replica: cfcb42b8624a4e56a600ceb35c2cbfd1, State: Running, Role: LEADER
I20260807 22:44:48.058322 24860 sys_catalog.cc:564] T 00000000000000000000000000000000 P cfcb42b8624a4e56a600ceb35c2cbfd1 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:44:48.058405 24867 consensus_queue.cc:237] T 00000000000000000000000000000000 P cfcb42b8624a4e56a600ceb35c2cbfd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfcb42b8624a4e56a600ceb35c2cbfd1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44541 } }
I20260807 22:44:48.058795 24870 sys_catalog.cc:455] T 00000000000000000000000000000000 P cfcb42b8624a4e56a600ceb35c2cbfd1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cfcb42b8624a4e56a600ceb35c2cbfd1. Latest consensus state: current_term: 1 leader_uuid: "cfcb42b8624a4e56a600ceb35c2cbfd1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfcb42b8624a4e56a600ceb35c2cbfd1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44541 } } }
I20260807 22:44:48.058885 24870 sys_catalog.cc:458] T 00000000000000000000000000000000 P cfcb42b8624a4e56a600ceb35c2cbfd1 [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:48.058933 24868 sys_catalog.cc:455] T 00000000000000000000000000000000 P cfcb42b8624a4e56a600ceb35c2cbfd1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cfcb42b8624a4e56a600ceb35c2cbfd1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfcb42b8624a4e56a600ceb35c2cbfd1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44541 } } }
I20260807 22:44:48.059157 24868 sys_catalog.cc:458] T 00000000000000000000000000000000 P cfcb42b8624a4e56a600ceb35c2cbfd1 [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:48.059262 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 24754
I20260807 22:44:48.059373 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:44:48.059549 23377 external_mini_cluster.cc:1428] Setting key 93348884fd94f3da8756ef92af2fcac9
I20260807 22:44:48.060472 24881 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:44:48.061082 24881 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:44:48.062587 24881 catalog_manager.cc:1347] Generated new cluster ID: 21e97aad9c414c3bbdf3c4e3c66ba957
I20260807 22:44:48.062642 24881 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 22:44:48 dist-test-slave-2d19 krb5kdc[24731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142687, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 22:44:48.071382 24890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:48.060307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.12:38361 (local address 127.0.0.1:44541)
0807 22:44:48.060474 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:48.060484 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:48.060520 (+ 36us) server_negotiation.cc:407] Connection header received
0807 22:44:48.060646 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:48.060654 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:48.060715 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:48.060878 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:48.061545 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:48.062985 (+ 1440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:48.063784 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:48.064230 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:48.064437 (+ 207us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:48.066806 (+ 2369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:48.066810 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:48.066810 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:44:48.066823 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:48.069707 (+ 2884us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:48.070152 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:48.070155 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:48.070156 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:48.070274 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:48.070523 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:48.070524 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:48.070524 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:48.070785 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:48.070957 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:48.071089 (+ 132us) server_negotiation.cc:299] Negotiation successful
0807 22:44:48.071201 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":77,"threads_started":1}
I20260807 22:44:48.072412 23377 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:44:48.082273 24881 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:44:48.082885 24881 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:44:48.087280 24881 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cfcb42b8624a4e56a600ceb35c2cbfd1: Generated new TSK 0
I20260807 22:44:48.087481 24881 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:44:48.087916 24890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:48.076598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.12:52047 (local address 127.0.0.1:44541)
0807 22:44:48.076645 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:48.076648 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:48.080470 (+ 3822us) server_negotiation.cc:407] Connection header received
0807 22:44:48.080552 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:48.080553 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:48.080565 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:48.080622 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:48.081216 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:48.081748 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:48.082816 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:48.083092 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:48.083163 (+ 71us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:48.084810 (+ 1647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:48.084811 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:48.084811 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:44:48.084819 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:48.086452 (+ 1633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:48.086943 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:48.086944 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:48.086945 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:48.087013 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:48.087299 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:48.087300 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:48.087300 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:48.087432 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:48.087514 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:48.087749 (+ 235us) server_negotiation.cc:299] Negotiation successful
0807 22:44:48.087818 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 22:44:48.089816 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 24754
W20260807 22:44:48.102916 24728 connection.cc:535] client connection to 127.0.0.1:44541 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44541): Connection reset by peer (error 104)
2026-08-07T22:44:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1561 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142418640232-23377-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:44:48 dist-test-slave-2d19 krb5kdc[24908](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:44:48 dist-test-slave-2d19 krb5kdc[24908](info): set up 2 sockets
Aug 07 22:44:48 dist-test-slave-2d19 krb5kdc[24908](info): commencing operation
krb5kdc: starting...
W20260807 22:44:49.356657 23377 mini_kdc.cc:121] Time spent starting KDC: real 1.240s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Aug 07 22:44:49 dist-test-slave-2d19 krb5kdc[24908](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142689, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:44:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:44:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 22:44:49.491153 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36347
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36347
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:44:49.577203 24928 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:44:49.577418 24928 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:44:49.577441 24928 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:44:49.578524 24928 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:44:49.578562 24928 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:44:49.578576 24928 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:44:49.578588 24928 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:44:49.578600 24928 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:44:49.580034 24928 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36347
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36347
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24928
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:44:49.580231 24928 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:44:49.580492 24928 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:44:49.585376 24939 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:49.585474 24934 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:49.585529 24935 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:49.585880 24928 server_base.cc:1034] running on GCE node
I20260807 22:44:49.586140 24928 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:44:49.586462 24928 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:44:49.587641 24928 hybrid_clock.cc:648] HybridClock initialized: now 1786142689587622 us; error 43 us; skew 500 ppm
Aug 07 22:44:49 dist-test-slave-2d19 krb5kdc[24908](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142689, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:44:49.590376 24928 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 22:44:49.590816 24928 webserver.cc:460] Webserver started at http://127.0.0.1:41451/ using document root <none> and password file <none>
I20260807 22:44:49.591063 24928 fs_manager.cc:359] Metadata directory not provided
I20260807 22:44:49.591137 24928 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:44:49.591281 24928 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:44:49.592442 24928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "de10f95b66794210b03ffd4ea00c34ef"
format_stamp: "Formatted at 2026-08-07 22:44:49 on dist-test-slave-2d19"
server_key: "04c4283574b525fac3c4ba45acbf3b3c"
server_key_iv: "af75ca182a0b916e59844e2fc638672d"
server_key_version: "encryptionkey@0"
I20260807 22:44:49.592811 24928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "de10f95b66794210b03ffd4ea00c34ef"
format_stamp: "Formatted at 2026-08-07 22:44:49 on dist-test-slave-2d19"
server_key: "04c4283574b525fac3c4ba45acbf3b3c"
server_key_iv: "af75ca182a0b916e59844e2fc638672d"
server_key_version: "encryptionkey@0"
I20260807 22:44:49.594156 24928 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:44:49.594883 24949 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:49.595106 24928 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:44:49.595213 24928 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "de10f95b66794210b03ffd4ea00c34ef"
format_stamp: "Formatted at 2026-08-07 22:44:49 on dist-test-slave-2d19"
server_key: "04c4283574b525fac3c4ba45acbf3b3c"
server_key_iv: "af75ca182a0b916e59844e2fc638672d"
server_key_version: "encryptionkey@0"
I20260807 22:44:49.595286 24928 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:44:49.608541 24928 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:44:49.610589 24928 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:44:49.610750 24928 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:44:49.614775 24928 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36347
I20260807 22:44:49.614812 25040 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36347 every 8 connection(s)
I20260807 22:44:49.615181 24928 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:44:49.616051 25041 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:44:49.616690 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 24928
I20260807 22:44:49.616816 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:44:49.616997 23377 external_mini_cluster.cc:1428] Setting key 2eee021f5e9f0fd0e9ee906f86951116
I20260807 22:44:49.619431 25041 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de10f95b66794210b03ffd4ea00c34ef: Bootstrap starting.
I20260807 22:44:49.620162 25041 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P de10f95b66794210b03ffd4ea00c34ef: Neither blocks nor log segments found. Creating new log.
I20260807 22:44:49.620496 25041 log.cc:824] T 00000000000000000000000000000000 P de10f95b66794210b03ffd4ea00c34ef: Log is configured to *not* fsync() on all Append() calls
I20260807 22:44:49.621234 25041 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de10f95b66794210b03ffd4ea00c34ef: No bootstrap required, opened a new log
I20260807 22:44:49.622995 25046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:49.617553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.12:42819 (local address 127.0.0.1:36347)
0807 22:44:49.617770 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:49.617780 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:49.617814 (+ 34us) server_negotiation.cc:407] Connection header received
0807 22:44:49.618335 (+ 521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:49.618345 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:49.618421 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:49.618575 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:49.618745 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:49.620108 (+ 1363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:49.620947 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:49.621419 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:49.621512 (+ 93us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:49.622279 (+ 767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:49.622282 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:49.622282 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:44:49.622446 (+ 164us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:49.622476 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:44:49.622487 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:49.622553 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:49.622668 (+ 115us) server_negotiation.cc:299] Negotiation successful
0807 22:44:49.622712 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":106,"threads_started":1}
I20260807 22:44:49.623517 25041 raft_consensus.cc:348] T 00000000000000000000000000000000 P de10f95b66794210b03ffd4ea00c34ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de10f95b66794210b03ffd4ea00c34ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36347 } }
I20260807 22:44:49.623685 25041 raft_consensus.cc:374] T 00000000000000000000000000000000 P de10f95b66794210b03ffd4ea00c34ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:44:49.623729 25041 raft_consensus.cc:729] T 00000000000000000000000000000000 P de10f95b66794210b03ffd4ea00c34ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de10f95b66794210b03ffd4ea00c34ef, State: Initialized, Role: FOLLOWER
I20260807 22:44:49.623896 25041 consensus_queue.cc:260] T 00000000000000000000000000000000 P de10f95b66794210b03ffd4ea00c34ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de10f95b66794210b03ffd4ea00c34ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36347 } }
I20260807 22:44:49.623992 25041 raft_consensus.cc:388] T 00000000000000000000000000000000 P de10f95b66794210b03ffd4ea00c34ef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:44:49.624028 25041 raft_consensus.cc:482] T 00000000000000000000000000000000 P de10f95b66794210b03ffd4ea00c34ef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:44:49.624051 23377 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:44:49.624083 25041 raft_consensus.cc:3037] T 00000000000000000000000000000000 P de10f95b66794210b03ffd4ea00c34ef [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:44:49.624693 25041 raft_consensus.cc:504] T 00000000000000000000000000000000 P de10f95b66794210b03ffd4ea00c34ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de10f95b66794210b03ffd4ea00c34ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36347 } }
I20260807 22:44:49.624814 25041 leader_election.cc:302] T 00000000000000000000000000000000 P de10f95b66794210b03ffd4ea00c34ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: de10f95b66794210b03ffd4ea00c34ef; no voters:
I20260807 22:44:49.624993 25041 leader_election.cc:288] T 00000000000000000000000000000000 P de10f95b66794210b03ffd4ea00c34ef [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:44:49.625051 25048 raft_consensus.cc:2781] T 00000000000000000000000000000000 P de10f95b66794210b03ffd4ea00c34ef [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:44:49.625211 25048 raft_consensus.cc:686] T 00000000000000000000000000000000 P de10f95b66794210b03ffd4ea00c34ef [term 1 LEADER]: Becoming Leader. State: Replica: de10f95b66794210b03ffd4ea00c34ef, State: Running, Role: LEADER
I20260807 22:44:49.625249 25041 sys_catalog.cc:564] T 00000000000000000000000000000000 P de10f95b66794210b03ffd4ea00c34ef [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:44:49.625378 25048 consensus_queue.cc:237] T 00000000000000000000000000000000 P de10f95b66794210b03ffd4ea00c34ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de10f95b66794210b03ffd4ea00c34ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36347 } }
I20260807 22:44:49.625720 25048 sys_catalog.cc:455] T 00000000000000000000000000000000 P de10f95b66794210b03ffd4ea00c34ef [sys.catalog]: SysCatalogTable state changed. Reason: New leader de10f95b66794210b03ffd4ea00c34ef. Latest consensus state: current_term: 1 leader_uuid: "de10f95b66794210b03ffd4ea00c34ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de10f95b66794210b03ffd4ea00c34ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36347 } } }
I20260807 22:44:49.625753 25051 sys_catalog.cc:455] T 00000000000000000000000000000000 P de10f95b66794210b03ffd4ea00c34ef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "de10f95b66794210b03ffd4ea00c34ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de10f95b66794210b03ffd4ea00c34ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36347 } } }
I20260807 22:44:49.625869 25048 sys_catalog.cc:458] T 00000000000000000000000000000000 P de10f95b66794210b03ffd4ea00c34ef [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:49.625881 25051 sys_catalog.cc:458] T 00000000000000000000000000000000 P de10f95b66794210b03ffd4ea00c34ef [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:49.626133 25063 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:44:49.626662 25063 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:44:49.628549 25063 catalog_manager.cc:1347] Generated new cluster ID: 98c432f6cb364517baffaac354434706
I20260807 22:44:49.628607 25063 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:44:49.630734 25046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:49.627694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.12:34701 (local address 127.0.0.1:36347)
0807 22:44:49.627731 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:49.627733 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:49.627861 (+ 128us) server_negotiation.cc:407] Connection header received
0807 22:44:49.627940 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:49.627941 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:49.627950 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:49.627999 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:49.628145 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:49.628823 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:49.629548 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:49.629769 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:49.629844 (+ 75us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:49.630505 (+ 661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:49.630506 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:49.630506 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:44:49.630511 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:49.630524 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:44:49.630528 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:49.630589 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:49.630649 (+ 60us) server_negotiation.cc:299] Negotiation successful
0807 22:44:49.630658 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 22:44:49.652177 25063 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:44:49.652741 25063 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:44:49.654549 25063 catalog_manager.cc:5868] T 00000000000000000000000000000000 P de10f95b66794210b03ffd4ea00c34ef: Generated new TSK 0
I20260807 22:44:49.654731 25063 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:44:49.657842 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 24928
W20260807 22:44:49.667588 24904 connection.cc:535] client connection to 127.0.0.1:36347 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36347): Connection reset by peer (error 104)
2026-08-07T22:44:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1564 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142418640232-23377-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:44:49 dist-test-slave-2d19 krb5kdc[25087](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:44:49 dist-test-slave-2d19 krb5kdc[25087](info): set up 2 sockets
Aug 07 22:44:49 dist-test-slave-2d19 krb5kdc[25087](info): commencing operation
krb5kdc: starting...
W20260807 22:44:50.944370 23377 mini_kdc.cc:121] Time spent starting KDC: real 1.263s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Aug 07 22:44:51 dist-test-slave-2d19 krb5kdc[25087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142691, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:44:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:44:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 22:44:51.080914 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42175
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42175
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:44:51.167147 25105 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:44:51.167403 25105 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:44:51.167447 25105 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:44:51.168609 25105 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:44:51.168681 25105 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:44:51.168705 25105 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:44:51.168727 25105 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:44:51.168756 25105 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:44:51.170269 25105 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42175
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142418640232-23377-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42175
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25105
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:44:51.170555 25105 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:44:51.170799 25105 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:44:51.175976 25113 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:51.175987 25114 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:51.175999 25117 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:51.176131 25105 server_base.cc:1034] running on GCE node
I20260807 22:44:51.176515 25105 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:44:51.176829 25105 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:44:51.178009 25105 hybrid_clock.cc:648] HybridClock initialized: now 1786142691177990 us; error 49 us; skew 500 ppm
Aug 07 22:44:51 dist-test-slave-2d19 krb5kdc[25087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142691, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:44:51.180719 25105 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 22:44:51.181371 25105 webserver.cc:460] Webserver started at http://127.0.0.1:36379/ using document root <none> and password file <none>
I20260807 22:44:51.181672 25105 fs_manager.cc:359] Metadata directory not provided
I20260807 22:44:51.181751 25105 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:44:51.181910 25105 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:44:51.183022 25105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "e51dfb266eb945a59ca42946d32fcd33"
format_stamp: "Formatted at 2026-08-07 22:44:51 on dist-test-slave-2d19"
server_key: "f42941c015b8a04e371eaa69181a93b3"
server_key_iv: "437fa5cd56802ab5b8581d61bade668b"
server_key_version: "encryptionkey@0"
I20260807 22:44:51.183409 25105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "e51dfb266eb945a59ca42946d32fcd33"
format_stamp: "Formatted at 2026-08-07 22:44:51 on dist-test-slave-2d19"
server_key: "f42941c015b8a04e371eaa69181a93b3"
server_key_iv: "437fa5cd56802ab5b8581d61bade668b"
server_key_version: "encryptionkey@0"
I20260807 22:44:51.184859 25105 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 22:44:51.185626 25130 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:51.185801 25105 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 22:44:51.185911 25105 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "e51dfb266eb945a59ca42946d32fcd33"
format_stamp: "Formatted at 2026-08-07 22:44:51 on dist-test-slave-2d19"
server_key: "f42941c015b8a04e371eaa69181a93b3"
server_key_iv: "437fa5cd56802ab5b8581d61bade668b"
server_key_version: "encryptionkey@0"
I20260807 22:44:51.185988 25105 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:44:51.189409 25105 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:44:51.191200 25105 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:44:51.191357 25105 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:44:51.195379 25105 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42175
I20260807 22:44:51.195410 25222 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42175 every 8 connection(s)
I20260807 22:44:51.195744 25105 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:44:51.196712 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 25105
I20260807 22:44:51.196849 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:44:51.196938 25223 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:44:51.197048 23377 external_mini_cluster.cc:1428] Setting key de036bea3f928a641d3480433230b999
I20260807 22:44:51.199693 25229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:51.197592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.12:36571 (local address 127.0.0.1:42175)
0807 22:44:51.197800 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:51.197807 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:51.197832 (+ 25us) server_negotiation.cc:407] Connection header received
0807 22:44:51.198386 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:51.198393 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:51.198419 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:51.198541 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:51.199220 (+ 679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:51.199224 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:51.199224 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:44:51.199228 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:51.199265 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:44:51.199275 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:51.199331 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:51.199421 (+ 90us) server_negotiation.cc:299] Negotiation successful
0807 22:44:51.199491 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":98,"threads_started":1}
I20260807 22:44:51.200332 25223 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e51dfb266eb945a59ca42946d32fcd33: Bootstrap starting.
I20260807 22:44:51.200743 23377 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:44:51.201068 25223 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e51dfb266eb945a59ca42946d32fcd33: Neither blocks nor log segments found. Creating new log.
I20260807 22:44:51.201400 25223 log.cc:824] T 00000000000000000000000000000000 P e51dfb266eb945a59ca42946d32fcd33: Log is configured to *not* fsync() on all Append() calls
I20260807 22:44:51.202200 25223 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e51dfb266eb945a59ca42946d32fcd33: No bootstrap required, opened a new log
I20260807 22:44:51.203393 25229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:51.202423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.12:53857 (local address 127.0.0.1:42175)
0807 22:44:51.202462 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:51.202464 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:51.202588 (+ 124us) server_negotiation.cc:407] Connection header received
0807 22:44:51.202627 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:51.202628 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:51.202632 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:51.202678 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:51.203182 (+ 504us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:51.203183 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:51.203183 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:44:51.203187 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:51.203198 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:44:51.203201 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:51.203238 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:51.203300 (+ 62us) server_negotiation.cc:299] Negotiation successful
0807 22:44:51.203310 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 22:44:51.204695 25223 raft_consensus.cc:348] T 00000000000000000000000000000000 P e51dfb266eb945a59ca42946d32fcd33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e51dfb266eb945a59ca42946d32fcd33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42175 } }
I20260807 22:44:51.204855 25223 raft_consensus.cc:374] T 00000000000000000000000000000000 P e51dfb266eb945a59ca42946d32fcd33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:44:51.204927 25223 raft_consensus.cc:729] T 00000000000000000000000000000000 P e51dfb266eb945a59ca42946d32fcd33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51dfb266eb945a59ca42946d32fcd33, State: Initialized, Role: FOLLOWER
I20260807 22:44:51.205062 25223 consensus_queue.cc:260] T 00000000000000000000000000000000 P e51dfb266eb945a59ca42946d32fcd33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e51dfb266eb945a59ca42946d32fcd33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42175 } }
I20260807 22:44:51.205166 25223 raft_consensus.cc:388] T 00000000000000000000000000000000 P e51dfb266eb945a59ca42946d32fcd33 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:44:51.205212 25223 raft_consensus.cc:482] T 00000000000000000000000000000000 P e51dfb266eb945a59ca42946d32fcd33 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:44:51.205263 25223 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e51dfb266eb945a59ca42946d32fcd33 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:44:51.205801 25223 raft_consensus.cc:504] T 00000000000000000000000000000000 P e51dfb266eb945a59ca42946d32fcd33 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e51dfb266eb945a59ca42946d32fcd33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42175 } }
I20260807 22:44:51.205935 25223 leader_election.cc:302] T 00000000000000000000000000000000 P e51dfb266eb945a59ca42946d32fcd33 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e51dfb266eb945a59ca42946d32fcd33; no voters:
I20260807 22:44:51.206141 25223 leader_election.cc:288] T 00000000000000000000000000000000 P e51dfb266eb945a59ca42946d32fcd33 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:44:51.206175 25241 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e51dfb266eb945a59ca42946d32fcd33 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:44:51.206363 25241 raft_consensus.cc:686] T 00000000000000000000000000000000 P e51dfb266eb945a59ca42946d32fcd33 [term 1 LEADER]: Becoming Leader. State: Replica: e51dfb266eb945a59ca42946d32fcd33, State: Running, Role: LEADER
I20260807 22:44:51.206394 25223 sys_catalog.cc:564] T 00000000000000000000000000000000 P e51dfb266eb945a59ca42946d32fcd33 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:44:51.206513 25241 consensus_queue.cc:237] T 00000000000000000000000000000000 P e51dfb266eb945a59ca42946d32fcd33 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e51dfb266eb945a59ca42946d32fcd33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42175 } }
I20260807 22:44:51.209084 25244 sys_catalog.cc:455] T 00000000000000000000000000000000 P e51dfb266eb945a59ca42946d32fcd33 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e51dfb266eb945a59ca42946d32fcd33. Latest consensus state: current_term: 1 leader_uuid: "e51dfb266eb945a59ca42946d32fcd33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e51dfb266eb945a59ca42946d32fcd33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42175 } } }
I20260807 22:44:51.209081 25243 sys_catalog.cc:455] T 00000000000000000000000000000000 P e51dfb266eb945a59ca42946d32fcd33 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e51dfb266eb945a59ca42946d32fcd33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e51dfb266eb945a59ca42946d32fcd33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42175 } } }
I20260807 22:44:51.209240 25244 sys_catalog.cc:458] T 00000000000000000000000000000000 P e51dfb266eb945a59ca42946d32fcd33 [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:51.209249 25243 sys_catalog.cc:458] T 00000000000000000000000000000000 P e51dfb266eb945a59ca42946d32fcd33 [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:51.209511 25254 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:44:51.210104 25254 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:44:51.211752 25254 catalog_manager.cc:1347] Generated new cluster ID: 687df2003d634982b7cb039c65be8493
I20260807 22:44:51.211813 25254 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:44:51.241160 25254 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:44:51.241392 25254 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:44:51.248210 25254 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e51dfb266eb945a59ca42946d32fcd33: Generated new TSK 0
I20260807 22:44:51.248441 25254 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:44:51.252004 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 25105
2026-08-07T22:44:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1597 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142418640232-23377-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:44:51 dist-test-slave-2d19 krb5kdc[25270](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:44:51 dist-test-slave-2d19 krb5kdc[25270](info): set up 2 sockets
Aug 07 22:44:51 dist-test-slave-2d19 krb5kdc[25270](info): commencing operation
krb5kdc: starting...
W20260807 22:44:52.505384 23377 mini_kdc.cc:121] Time spent starting KDC: real 1.226s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Aug 07 22:44:52 dist-test-slave-2d19 krb5kdc[25270](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142692, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:44:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:44:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.212.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
I20260807 22:44:52.635713 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:38917
--webserver_interface=127.22.212.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:32871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:38917
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:44:52.719877 25292 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:44:52.720124 25292 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:44:52.720163 25292 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:44:52.721354 25292 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:44:52.721429 25292 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:44:52.721453 25292 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:44:52.721474 25292 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:44:52.721503 25292 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:44:52.723022 25292 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:32871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:38917
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:38917
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25292
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:44:52.723297 25292 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:44:52.723558 25292 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:44:52.728559 25302 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:52.728554 25300 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:52.728554 25304 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:52.728813 25292 server_base.cc:1034] running on GCE node
I20260807 22:44:52.729044 25292 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:44:52.729341 25292 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:44:52.730491 25292 hybrid_clock.cc:648] HybridClock initialized: now 1786142692730481 us; error 32 us; skew 500 ppm
Aug 07 22:44:52 dist-test-slave-2d19 krb5kdc[25270](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142692, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:44:52.739142 25292 init.cc:377] Logged in from keytab as kudu/127.22.212.126@KRBTEST.COM (short username kudu)
I20260807 22:44:52.739573 25292 webserver.cc:460] Webserver started at http://127.22.212.126:38235/ using document root <none> and password file <none>
I20260807 22:44:52.739830 25292 fs_manager.cc:359] Metadata directory not provided
I20260807 22:44:52.739874 25292 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:44:52.740039 25292 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:44:52.741209 25292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "c9060cc775204ccbaa5fc760aa5bebbd"
format_stamp: "Formatted at 2026-08-07 22:44:52 on dist-test-slave-2d19"
server_key: "ea3a12103231cdf4f9bd4f7eae1b0d86"
server_key_iv: "b66e741afc3537f030c63dd266d81682"
server_key_version: "encryptionkey@0"
I20260807 22:44:52.741575 25292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "c9060cc775204ccbaa5fc760aa5bebbd"
format_stamp: "Formatted at 2026-08-07 22:44:52 on dist-test-slave-2d19"
server_key: "ea3a12103231cdf4f9bd4f7eae1b0d86"
server_key_iv: "b66e741afc3537f030c63dd266d81682"
server_key_version: "encryptionkey@0"
I20260807 22:44:52.742925 25292 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 22:44:52.743709 25315 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:52.743919 25292 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:44:52.744026 25292 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "c9060cc775204ccbaa5fc760aa5bebbd"
format_stamp: "Formatted at 2026-08-07 22:44:52 on dist-test-slave-2d19"
server_key: "ea3a12103231cdf4f9bd4f7eae1b0d86"
server_key_iv: "b66e741afc3537f030c63dd266d81682"
server_key_version: "encryptionkey@0"
I20260807 22:44:52.744113 25292 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:44:52.764824 25292 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:44:52.766755 25292 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:44:52.766918 25292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:44:52.771166 25292 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:38917
I20260807 22:44:52.771268 25411 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:38917 every 8 connection(s)
I20260807 22:44:52.771608 25292 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:44:52.772718 25412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:44:52.775329 25412 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9060cc775204ccbaa5fc760aa5bebbd: Bootstrap starting.
I20260807 22:44:52.776015 25412 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c9060cc775204ccbaa5fc760aa5bebbd: Neither blocks nor log segments found. Creating new log.
I20260807 22:44:52.776371 25412 log.cc:824] T 00000000000000000000000000000000 P c9060cc775204ccbaa5fc760aa5bebbd: Log is configured to *not* fsync() on all Append() calls
I20260807 22:44:52.777153 25412 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9060cc775204ccbaa5fc760aa5bebbd: No bootstrap required, opened a new log
I20260807 22:44:52.778927 25412 raft_consensus.cc:348] T 00000000000000000000000000000000 P c9060cc775204ccbaa5fc760aa5bebbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9060cc775204ccbaa5fc760aa5bebbd" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 38917 } }
I20260807 22:44:52.779106 25412 raft_consensus.cc:374] T 00000000000000000000000000000000 P c9060cc775204ccbaa5fc760aa5bebbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:44:52.779160 25412 raft_consensus.cc:729] T 00000000000000000000000000000000 P c9060cc775204ccbaa5fc760aa5bebbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9060cc775204ccbaa5fc760aa5bebbd, State: Initialized, Role: FOLLOWER
I20260807 22:44:52.779330 25412 consensus_queue.cc:260] T 00000000000000000000000000000000 P c9060cc775204ccbaa5fc760aa5bebbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9060cc775204ccbaa5fc760aa5bebbd" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 38917 } }
I20260807 22:44:52.779402 25412 raft_consensus.cc:388] T 00000000000000000000000000000000 P c9060cc775204ccbaa5fc760aa5bebbd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:44:52.779433 25412 raft_consensus.cc:482] T 00000000000000000000000000000000 P c9060cc775204ccbaa5fc760aa5bebbd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:44:52.779465 25412 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c9060cc775204ccbaa5fc760aa5bebbd [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:44:52.780422 25412 raft_consensus.cc:504] T 00000000000000000000000000000000 P c9060cc775204ccbaa5fc760aa5bebbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9060cc775204ccbaa5fc760aa5bebbd" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 38917 } }
I20260807 22:44:52.780521 25412 leader_election.cc:302] T 00000000000000000000000000000000 P c9060cc775204ccbaa5fc760aa5bebbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c9060cc775204ccbaa5fc760aa5bebbd; no voters:
I20260807 22:44:52.780675 25412 leader_election.cc:288] T 00000000000000000000000000000000 P c9060cc775204ccbaa5fc760aa5bebbd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:44:52.780740 25419 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c9060cc775204ccbaa5fc760aa5bebbd [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:44:52.780946 25419 raft_consensus.cc:686] T 00000000000000000000000000000000 P c9060cc775204ccbaa5fc760aa5bebbd [term 1 LEADER]: Becoming Leader. State: Replica: c9060cc775204ccbaa5fc760aa5bebbd, State: Running, Role: LEADER
I20260807 22:44:52.781040 25419 consensus_queue.cc:237] T 00000000000000000000000000000000 P c9060cc775204ccbaa5fc760aa5bebbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9060cc775204ccbaa5fc760aa5bebbd" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 38917 } }
I20260807 22:44:52.781210 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 25292
I20260807 22:44:52.781378 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:44:52.781421 25422 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9060cc775204ccbaa5fc760aa5bebbd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c9060cc775204ccbaa5fc760aa5bebbd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9060cc775204ccbaa5fc760aa5bebbd" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 38917 } } }
I20260807 22:44:52.781446 25423 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9060cc775204ccbaa5fc760aa5bebbd [sys.catalog]: SysCatalogTable state changed. Reason: New leader c9060cc775204ccbaa5fc760aa5bebbd. Latest consensus state: current_term: 1 leader_uuid: "c9060cc775204ccbaa5fc760aa5bebbd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9060cc775204ccbaa5fc760aa5bebbd" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 38917 } } }
I20260807 22:44:52.781507 25422 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9060cc775204ccbaa5fc760aa5bebbd [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:52.781519 25423 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9060cc775204ccbaa5fc760aa5bebbd [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:52.781625 23377 external_mini_cluster.cc:1428] Setting key c010383a181be7ded3976554843127ac
I20260807 22:44:52.781805 25412 sys_catalog.cc:564] T 00000000000000000000000000000000 P c9060cc775204ccbaa5fc760aa5bebbd [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:44:52.781949 25426 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:44:52.782513 25426 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:44:52.784726 25426 catalog_manager.cc:1347] Generated new cluster ID: 8e96954380394f3b9863fbbea4292863
I20260807 22:44:52.784799 25426 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 22:44:52 dist-test-slave-2d19 krb5kdc[25270](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142692, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:44:52.794564 25437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:52.782300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44915 (local address 127.22.212.126:38917)
0807 22:44:52.782525 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:52.782535 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:52.782570 (+ 35us) server_negotiation.cc:407] Connection header received
0807 22:44:52.782690 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:52.782698 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:52.782765 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:52.782933 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:52.783897 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:52.785325 (+ 1428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:52.786499 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:52.787136 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:52.787250 (+ 114us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:52.790312 (+ 3062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:52.790316 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:52.790317 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:44:52.790331 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:52.792594 (+ 2263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:52.793067 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:52.793071 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:52.793072 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:52.793211 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:52.793476 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:52.793477 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:52.793477 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:52.793828 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:52.794012 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:52.794136 (+ 124us) server_negotiation.cc:299] Negotiation successful
0807 22:44:52.794258 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":82,"threads_started":1}
I20260807 22:44:52.794751 25426 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:44:52.795460 25426 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:44:52.795648 23377 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:44:52.804586 25437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:52.797244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37059 (local address 127.22.212.126:38917)
0807 22:44:52.797285 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:52.797288 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:52.797401 (+ 113us) server_negotiation.cc:407] Connection header received
0807 22:44:52.797484 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:52.797485 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:52.797496 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:52.797557 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:52.798223 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:52.798802 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:52.799669 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:52.799921 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:52.800005 (+ 84us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:52.801596 (+ 1591us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:52.801597 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:52.801598 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:44:52.801605 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:52.803208 (+ 1603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:52.803623 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:52.803624 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:52.803625 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:52.803690 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:52.803957 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:52.803958 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:52.803958 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:52.804080 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:52.804203 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:52.804374 (+ 171us) server_negotiation.cc:299] Negotiation successful
0807 22:44:52.804454 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 22:44:52.806365 25426 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c9060cc775204ccbaa5fc760aa5bebbd: Generated new TSK 0
I20260807 22:44:52.806541 25426 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:44:52.812795 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 25292
W20260807 22:44:52.825618 25267 connection.cc:535] client connection to 127.22.212.126:38917 recv error: Network error: failed to read from TLS socket (remote: 127.22.212.126:38917): Connection reset by peer (error 104)
2026-08-07T22:44:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1559 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142418640232-23377-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:44:52 dist-test-slave-2d19 krb5kdc[25466](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:44:52 dist-test-slave-2d19 krb5kdc[25466](info): set up 2 sockets
Aug 07 22:44:52 dist-test-slave-2d19 krb5kdc[25466](info): commencing operation
krb5kdc: starting...
W20260807 22:44:54.062026 23377 mini_kdc.cc:121] Time spent starting KDC: real 1.223s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Aug 07 22:44:54 dist-test-slave-2d19 krb5kdc[25466](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142694, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:44:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:44:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.212.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
I20260807 22:44:54.190810 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:40263
--webserver_interface=127.22.212.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:35245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:40263
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:44:54.274814 25504 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:44:54.275053 25504 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:44:54.275101 25504 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:44:54.276297 25504 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:44:54.276368 25504 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:44:54.276396 25504 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:44:54.276428 25504 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:44:54.276453 25504 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:44:54.277906 25504 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:35245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:40263
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:40263
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25504
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:44:54.278195 25504 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:44:54.278424 25504 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:44:54.284155 25513 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:54.284109 25512 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:54.284401 25516 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:54.284629 25504 server_base.cc:1034] running on GCE node
I20260807 22:44:54.284876 25504 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:44:54.285126 25504 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:44:54.286262 25504 hybrid_clock.cc:648] HybridClock initialized: now 1786142694286246 us; error 40 us; skew 500 ppm
Aug 07 22:44:54 dist-test-slave-2d19 krb5kdc[25466](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142694, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:44:54.288686 25504 init.cc:377] Logged in from keytab as kudu/127.22.212.126@KRBTEST.COM (short username kudu)
I20260807 22:44:54.289131 25504 webserver.cc:460] Webserver started at http://127.22.212.126:40053/ using document root <none> and password file <none>
I20260807 22:44:54.289362 25504 fs_manager.cc:359] Metadata directory not provided
I20260807 22:44:54.289407 25504 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:44:54.289558 25504 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:44:54.290652 25504 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "1fb6318f765842d9a3ec80f693ada52a"
format_stamp: "Formatted at 2026-08-07 22:44:54 on dist-test-slave-2d19"
server_key: "8a48051dad4ce5d1729636e93c4bc4a2"
server_key_iv: "22772e623c0e0b6ad985273852011df0"
server_key_version: "encryptionkey@0"
I20260807 22:44:54.291020 25504 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "1fb6318f765842d9a3ec80f693ada52a"
format_stamp: "Formatted at 2026-08-07 22:44:54 on dist-test-slave-2d19"
server_key: "8a48051dad4ce5d1729636e93c4bc4a2"
server_key_iv: "22772e623c0e0b6ad985273852011df0"
server_key_version: "encryptionkey@0"
I20260807 22:44:54.292465 25504 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260807 22:44:54.293219 25527 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:54.293407 25504 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 22:44:54.293504 25504 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "1fb6318f765842d9a3ec80f693ada52a"
format_stamp: "Formatted at 2026-08-07 22:44:54 on dist-test-slave-2d19"
server_key: "8a48051dad4ce5d1729636e93c4bc4a2"
server_key_iv: "22772e623c0e0b6ad985273852011df0"
server_key_version: "encryptionkey@0"
I20260807 22:44:54.293586 25504 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:44:54.313174 25504 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:44:54.315344 25504 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:44:54.315531 25504 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:44:54.319808 25504 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:40263
I20260807 22:44:54.319878 25608 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:40263 every 8 connection(s)
I20260807 22:44:54.320238 25504 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:44:54.321283 25609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:44:54.323688 25609 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1fb6318f765842d9a3ec80f693ada52a: Bootstrap starting.
I20260807 22:44:54.324402 25609 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1fb6318f765842d9a3ec80f693ada52a: Neither blocks nor log segments found. Creating new log.
I20260807 22:44:54.324694 25609 log.cc:824] T 00000000000000000000000000000000 P 1fb6318f765842d9a3ec80f693ada52a: Log is configured to *not* fsync() on all Append() calls
I20260807 22:44:54.325433 25609 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1fb6318f765842d9a3ec80f693ada52a: No bootstrap required, opened a new log
I20260807 22:44:54.326632 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 25504
I20260807 22:44:54.326752 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:44:54.326952 23377 external_mini_cluster.cc:1428] Setting key a0622f378766cffb58bc1cc31661ee88
I20260807 22:44:54.327553 25609 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1fb6318f765842d9a3ec80f693ada52a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fb6318f765842d9a3ec80f693ada52a" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 40263 } }
I20260807 22:44:54.327770 25609 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1fb6318f765842d9a3ec80f693ada52a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:44:54.327826 25609 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1fb6318f765842d9a3ec80f693ada52a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fb6318f765842d9a3ec80f693ada52a, State: Initialized, Role: FOLLOWER
I20260807 22:44:54.327966 25609 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1fb6318f765842d9a3ec80f693ada52a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fb6318f765842d9a3ec80f693ada52a" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 40263 } }
I20260807 22:44:54.328051 25609 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1fb6318f765842d9a3ec80f693ada52a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:44:54.328116 25609 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1fb6318f765842d9a3ec80f693ada52a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:44:54.328177 25609 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1fb6318f765842d9a3ec80f693ada52a [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:44:54.328773 25609 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1fb6318f765842d9a3ec80f693ada52a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fb6318f765842d9a3ec80f693ada52a" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 40263 } }
I20260807 22:44:54.328863 25609 leader_election.cc:302] T 00000000000000000000000000000000 P 1fb6318f765842d9a3ec80f693ada52a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1fb6318f765842d9a3ec80f693ada52a; no voters:
I20260807 22:44:54.329087 25609 leader_election.cc:288] T 00000000000000000000000000000000 P 1fb6318f765842d9a3ec80f693ada52a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:44:54.329118 25616 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1fb6318f765842d9a3ec80f693ada52a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:44:54.329226 25616 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1fb6318f765842d9a3ec80f693ada52a [term 1 LEADER]: Becoming Leader. State: Replica: 1fb6318f765842d9a3ec80f693ada52a, State: Running, Role: LEADER
I20260807 22:44:54.329363 25609 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1fb6318f765842d9a3ec80f693ada52a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:44:54.329375 25616 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1fb6318f765842d9a3ec80f693ada52a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fb6318f765842d9a3ec80f693ada52a" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 40263 } }
I20260807 22:44:54.329854 25618 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1fb6318f765842d9a3ec80f693ada52a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1fb6318f765842d9a3ec80f693ada52a. Latest consensus state: current_term: 1 leader_uuid: "1fb6318f765842d9a3ec80f693ada52a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fb6318f765842d9a3ec80f693ada52a" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 40263 } } }
I20260807 22:44:54.329952 25618 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1fb6318f765842d9a3ec80f693ada52a [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:54.330166 25617 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1fb6318f765842d9a3ec80f693ada52a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1fb6318f765842d9a3ec80f693ada52a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fb6318f765842d9a3ec80f693ada52a" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 40263 } } }
I20260807 22:44:54.330478 25617 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1fb6318f765842d9a3ec80f693ada52a [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:54.330752 25623 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:44:54.331292 25623 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:44:54.333259 25615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:54.327511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56797 (local address 127.22.212.126:40263)
0807 22:44:54.327699 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:54.327709 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:54.327743 (+ 34us) server_negotiation.cc:407] Connection header received
0807 22:44:54.327872 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:54.327879 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:54.327935 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:54.328114 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:54.328367 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:54.329803 (+ 1436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:54.330952 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:54.331558 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:54.331674 (+ 116us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:54.332483 (+ 809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:54.332488 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:54.332488 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:44:54.332707 (+ 219us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:54.332749 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:44:54.332765 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:54.332855 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:54.332939 (+ 84us) server_negotiation.cc:299] Negotiation successful
0807 22:44:54.333021 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":107,"threads_started":1}
I20260807 22:44:54.333294 25623 catalog_manager.cc:1347] Generated new cluster ID: 1af5f349ec124256b34c3fcc5f68344a
I20260807 22:44:54.333328 25623 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:44:54.334241 23377 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:44:54.339733 25615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:54.335587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53801 (local address 127.22.212.126:40263)
0807 22:44:54.335626 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:54.335628 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:54.336411 (+ 783us) server_negotiation.cc:407] Connection header received
0807 22:44:54.336443 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:54.336444 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:54.336455 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:54.336526 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:54.336646 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:54.337394 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:54.338396 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:54.338717 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:54.338790 (+ 73us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:54.339481 (+ 691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:54.339483 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:54.339483 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:44:54.339488 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:54.339504 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:44:54.339508 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:54.339582 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:54.339646 (+ 64us) server_negotiation.cc:299] Negotiation successful
0807 22:44:54.339659 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":11,"server-negotiator.queue_time_us":19}
I20260807 22:44:54.341521 25623 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:44:54.341957 25623 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:44:54.352120 25623 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1fb6318f765842d9a3ec80f693ada52a: Generated new TSK 0
I20260807 22:44:54.352381 25623 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:44:54.360877 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 25504
W20260807 22:44:54.377223 25462 connection.cc:535] client connection to 127.22.212.126:40263 recv error: Network error: failed to read from TLS socket (remote: 127.22.212.126:40263): Connection reset by peer (error 104)
2026-08-07T22:44:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1551 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142418640232-23377-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:44:54 dist-test-slave-2d19 krb5kdc[25650](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:44:54 dist-test-slave-2d19 krb5kdc[25650](info): set up 2 sockets
Aug 07 22:44:54 dist-test-slave-2d19 krb5kdc[25650](info): commencing operation
krb5kdc: starting...
W20260807 22:44:55.619503 23377 mini_kdc.cc:121] Time spent starting KDC: real 1.228s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Aug 07 22:44:55 dist-test-slave-2d19 krb5kdc[25650](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142695, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:44:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:44:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.212.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
I20260807 22:44:55.747985 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:44545
--webserver_interface=127.22.212.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:33327
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:44545
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:44:55.831979 25677 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:44:55.832186 25677 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:44:55.832209 25677 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:44:55.833370 25677 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:44:55.833420 25677 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:44:55.833436 25677 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:44:55.833448 25677 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:44:55.833460 25677 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:44:55.834870 25677 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:33327
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:44545
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:44545
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25677
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:44:55.835071 25677 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:44:55.835238 25677 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:44:55.840248 25690 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:55.840312 25699 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:55.840387 25688 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:55.840487 25677 server_base.cc:1034] running on GCE node
I20260807 22:44:55.840766 25677 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:44:55.841084 25677 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:44:55.842232 25677 hybrid_clock.cc:648] HybridClock initialized: now 1786142695842216 us; error 27 us; skew 500 ppm
Aug 07 22:44:55 dist-test-slave-2d19 krb5kdc[25650](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142695, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:44:55.844952 25677 init.cc:377] Logged in from keytab as kudu/127.22.212.126@KRBTEST.COM (short username kudu)
I20260807 22:44:55.845446 25677 webserver.cc:460] Webserver started at http://127.22.212.126:36103/ using document root <none> and password file <none>
I20260807 22:44:55.845691 25677 fs_manager.cc:359] Metadata directory not provided
I20260807 22:44:55.845763 25677 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:44:55.845922 25677 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:44:55.846992 25677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "fc3be0313b5147ef886705cea79320da"
format_stamp: "Formatted at 2026-08-07 22:44:55 on dist-test-slave-2d19"
server_key: "82462b8615a20a8eb199c13b4a60e439"
server_key_iv: "aeebee64c7dd714e9ecb6d784a155739"
server_key_version: "encryptionkey@0"
I20260807 22:44:55.847362 25677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "fc3be0313b5147ef886705cea79320da"
format_stamp: "Formatted at 2026-08-07 22:44:55 on dist-test-slave-2d19"
server_key: "82462b8615a20a8eb199c13b4a60e439"
server_key_iv: "aeebee64c7dd714e9ecb6d784a155739"
server_key_version: "encryptionkey@0"
I20260807 22:44:55.848804 25677 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 22:44:55.849583 25711 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:55.849757 25677 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 22:44:55.849869 25677 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "fc3be0313b5147ef886705cea79320da"
format_stamp: "Formatted at 2026-08-07 22:44:55 on dist-test-slave-2d19"
server_key: "82462b8615a20a8eb199c13b4a60e439"
server_key_iv: "aeebee64c7dd714e9ecb6d784a155739"
server_key_version: "encryptionkey@0"
I20260807 22:44:55.849951 25677 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:44:55.853437 25677 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:44:55.855751 25677 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:44:55.855909 25677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:44:55.860394 25677 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:44545
I20260807 22:44:55.860431 25789 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:44545 every 8 connection(s)
I20260807 22:44:55.860769 25677 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:44:55.861824 25792 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:44:55.863627 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 25677
I20260807 22:44:55.863746 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:44:55.863914 23377 external_mini_cluster.cc:1428] Setting key a86c01ac3f8820a49bb3eb11604ace13
I20260807 22:44:55.864666 25792 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc3be0313b5147ef886705cea79320da: Bootstrap starting.
I20260807 22:44:55.865275 25792 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fc3be0313b5147ef886705cea79320da: Neither blocks nor log segments found. Creating new log.
I20260807 22:44:55.865634 25792 log.cc:824] T 00000000000000000000000000000000 P fc3be0313b5147ef886705cea79320da: Log is configured to *not* fsync() on all Append() calls
I20260807 22:44:55.866674 25796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:55.864549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48343 (local address 127.22.212.126:44545)
0807 22:44:55.864711 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:55.864721 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:55.864755 (+ 34us) server_negotiation.cc:407] Connection header received
0807 22:44:55.865213 (+ 458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:55.865220 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:55.865247 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:55.865424 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:55.866115 (+ 691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:55.866119 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:55.866120 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:44:55.866125 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:55.866172 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:44:55.866186 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:55.866285 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:55.866429 (+ 144us) server_negotiation.cc:299] Negotiation successful
0807 22:44:55.866483 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":82,"threads_started":1}
I20260807 22:44:55.866684 25792 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc3be0313b5147ef886705cea79320da: No bootstrap required, opened a new log
I20260807 22:44:55.867739 23377 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:44:55.869407 25792 raft_consensus.cc:348] T 00000000000000000000000000000000 P fc3be0313b5147ef886705cea79320da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc3be0313b5147ef886705cea79320da" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 44545 } }
I20260807 22:44:55.869622 25792 raft_consensus.cc:374] T 00000000000000000000000000000000 P fc3be0313b5147ef886705cea79320da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:44:55.869691 25792 raft_consensus.cc:729] T 00000000000000000000000000000000 P fc3be0313b5147ef886705cea79320da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc3be0313b5147ef886705cea79320da, State: Initialized, Role: FOLLOWER
I20260807 22:44:55.869823 25792 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc3be0313b5147ef886705cea79320da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc3be0313b5147ef886705cea79320da" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 44545 } }
I20260807 22:44:55.869947 25792 raft_consensus.cc:388] T 00000000000000000000000000000000 P fc3be0313b5147ef886705cea79320da [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:44:55.869992 25792 raft_consensus.cc:482] T 00000000000000000000000000000000 P fc3be0313b5147ef886705cea79320da [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:44:55.870041 25792 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fc3be0313b5147ef886705cea79320da [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:44:55.870293 25796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:55.869146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60213 (local address 127.22.212.126:44545)
0807 22:44:55.869184 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:55.869186 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:55.869313 (+ 127us) server_negotiation.cc:407] Connection header received
0807 22:44:55.869407 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:55.869408 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:55.869414 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:55.869481 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:55.870093 (+ 612us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:55.870095 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:55.870095 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:44:55.870099 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:55.870112 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:44:55.870115 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:55.870161 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:55.870216 (+ 55us) server_negotiation.cc:299] Negotiation successful
0807 22:44:55.870229 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260807 22:44:55.870867 25792 raft_consensus.cc:504] T 00000000000000000000000000000000 P fc3be0313b5147ef886705cea79320da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc3be0313b5147ef886705cea79320da" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 44545 } }
I20260807 22:44:55.870963 25792 leader_election.cc:302] T 00000000000000000000000000000000 P fc3be0313b5147ef886705cea79320da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fc3be0313b5147ef886705cea79320da; no voters:
I20260807 22:44:55.871089 25792 leader_election.cc:288] T 00000000000000000000000000000000 P fc3be0313b5147ef886705cea79320da [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:44:55.871161 25806 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fc3be0313b5147ef886705cea79320da [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:44:55.871335 25806 raft_consensus.cc:686] T 00000000000000000000000000000000 P fc3be0313b5147ef886705cea79320da [term 1 LEADER]: Becoming Leader. State: Replica: fc3be0313b5147ef886705cea79320da, State: Running, Role: LEADER
I20260807 22:44:55.871367 25792 sys_catalog.cc:564] T 00000000000000000000000000000000 P fc3be0313b5147ef886705cea79320da [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:44:55.871435 25806 consensus_queue.cc:237] T 00000000000000000000000000000000 P fc3be0313b5147ef886705cea79320da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc3be0313b5147ef886705cea79320da" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 44545 } }
I20260807 22:44:55.871811 25807 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc3be0313b5147ef886705cea79320da [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fc3be0313b5147ef886705cea79320da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc3be0313b5147ef886705cea79320da" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 44545 } } }
I20260807 22:44:55.871920 25807 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc3be0313b5147ef886705cea79320da [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:55.872094 25808 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc3be0313b5147ef886705cea79320da [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc3be0313b5147ef886705cea79320da. Latest consensus state: current_term: 1 leader_uuid: "fc3be0313b5147ef886705cea79320da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc3be0313b5147ef886705cea79320da" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 44545 } } }
I20260807 22:44:55.872164 25808 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc3be0313b5147ef886705cea79320da [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:55.872270 25813 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:44:55.872802 25813 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:44:55.874532 25813 catalog_manager.cc:1347] Generated new cluster ID: 1b39b3323d4841d6968f20670fbf03f2
I20260807 22:44:55.874583 25813 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:44:55.901731 25813 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:44:55.902022 25813 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:44:55.905813 25813 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fc3be0313b5147ef886705cea79320da: Generated new TSK 0
I20260807 22:44:55.906080 25813 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:44:55.912328 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 25677
2026-08-07T22:44:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1552 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142418640232-23377-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:44:55 dist-test-slave-2d19 krb5kdc[25836](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:44:55 dist-test-slave-2d19 krb5kdc[25836](info): set up 2 sockets
Aug 07 22:44:55 dist-test-slave-2d19 krb5kdc[25836](info): commencing operation
krb5kdc: starting...
W20260807 22:44:57.178364 23377 mini_kdc.cc:121] Time spent starting KDC: real 1.235s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Aug 07 22:44:57 dist-test-slave-2d19 krb5kdc[25836](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142697, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:44:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:44:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.212.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
I20260807 22:44:57.308802 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:43291
--webserver_interface=127.22.212.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:39873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:43291
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:44:57.392378 25863 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:44:57.392580 25863 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:44:57.392603 25863 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:44:57.393671 25863 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:44:57.393705 25863 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:44:57.393718 25863 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:44:57.393731 25863 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:44:57.393743 25863 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:44:57.395156 25863 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:39873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:43291
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:43291
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25863
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:44:57.395355 25863 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:44:57.395519 25863 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:44:57.401484 25872 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:57.401540 25875 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:57.401554 25871 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:57.401723 25863 server_base.cc:1034] running on GCE node
I20260807 22:44:57.402002 25863 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:44:57.402305 25863 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:44:57.403468 25863 hybrid_clock.cc:648] HybridClock initialized: now 1786142697403427 us; error 42 us; skew 500 ppm
Aug 07 22:44:57 dist-test-slave-2d19 krb5kdc[25836](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142697, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:44:57.408164 25863 init.cc:377] Logged in from keytab as kudu/127.22.212.126@KRBTEST.COM (short username kudu)
I20260807 22:44:57.408715 25863 webserver.cc:460] Webserver started at http://127.22.212.126:38055/ using document root <none> and password file <none>
I20260807 22:44:57.409022 25863 fs_manager.cc:359] Metadata directory not provided
I20260807 22:44:57.409102 25863 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:44:57.409250 25863 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:44:57.410702 25863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "303b5110ff5244e8a2d84a4bd9312da6"
format_stamp: "Formatted at 2026-08-07 22:44:57 on dist-test-slave-2d19"
server_key: "258bd78a2a4db2b7614422030c3827bf"
server_key_iv: "fc890883083dce6ff4f6a8c395080644"
server_key_version: "encryptionkey@0"
I20260807 22:44:57.411166 25863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "303b5110ff5244e8a2d84a4bd9312da6"
format_stamp: "Formatted at 2026-08-07 22:44:57 on dist-test-slave-2d19"
server_key: "258bd78a2a4db2b7614422030c3827bf"
server_key_iv: "fc890883083dce6ff4f6a8c395080644"
server_key_version: "encryptionkey@0"
I20260807 22:44:57.413079 25863 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260807 22:44:57.414152 25886 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:57.414350 25863 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:44:57.414458 25863 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "303b5110ff5244e8a2d84a4bd9312da6"
format_stamp: "Formatted at 2026-08-07 22:44:57 on dist-test-slave-2d19"
server_key: "258bd78a2a4db2b7614422030c3827bf"
server_key_iv: "fc890883083dce6ff4f6a8c395080644"
server_key_version: "encryptionkey@0"
I20260807 22:44:57.414531 25863 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:44:57.448144 25863 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:44:57.451231 25863 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:44:57.451400 25863 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:44:57.457013 25863 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:43291
I20260807 22:44:57.457075 25964 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:43291 every 8 connection(s)
I20260807 22:44:57.457422 25863 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:44:57.458369 25966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:44:57.460841 25966 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 303b5110ff5244e8a2d84a4bd9312da6: Bootstrap starting.
I20260807 22:44:57.461437 25966 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 303b5110ff5244e8a2d84a4bd9312da6: Neither blocks nor log segments found. Creating new log.
I20260807 22:44:57.461730 25966 log.cc:824] T 00000000000000000000000000000000 P 303b5110ff5244e8a2d84a4bd9312da6: Log is configured to *not* fsync() on all Append() calls
I20260807 22:44:57.462466 25966 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 303b5110ff5244e8a2d84a4bd9312da6: No bootstrap required, opened a new log
I20260807 22:44:57.464114 25966 raft_consensus.cc:348] T 00000000000000000000000000000000 P 303b5110ff5244e8a2d84a4bd9312da6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "303b5110ff5244e8a2d84a4bd9312da6" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43291 } }
I20260807 22:44:57.464299 25966 raft_consensus.cc:374] T 00000000000000000000000000000000 P 303b5110ff5244e8a2d84a4bd9312da6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:44:57.464375 25966 raft_consensus.cc:729] T 00000000000000000000000000000000 P 303b5110ff5244e8a2d84a4bd9312da6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 303b5110ff5244e8a2d84a4bd9312da6, State: Initialized, Role: FOLLOWER
I20260807 22:44:57.464545 25966 consensus_queue.cc:260] T 00000000000000000000000000000000 P 303b5110ff5244e8a2d84a4bd9312da6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "303b5110ff5244e8a2d84a4bd9312da6" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43291 } }
I20260807 22:44:57.464629 25966 raft_consensus.cc:388] T 00000000000000000000000000000000 P 303b5110ff5244e8a2d84a4bd9312da6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:44:57.464674 25966 raft_consensus.cc:482] T 00000000000000000000000000000000 P 303b5110ff5244e8a2d84a4bd9312da6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:44:57.464721 25966 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 303b5110ff5244e8a2d84a4bd9312da6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:44:57.465561 25966 raft_consensus.cc:504] T 00000000000000000000000000000000 P 303b5110ff5244e8a2d84a4bd9312da6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "303b5110ff5244e8a2d84a4bd9312da6" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43291 } }
I20260807 22:44:57.465682 25966 leader_election.cc:302] T 00000000000000000000000000000000 P 303b5110ff5244e8a2d84a4bd9312da6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 303b5110ff5244e8a2d84a4bd9312da6; no voters:
I20260807 22:44:57.465869 25966 leader_election.cc:288] T 00000000000000000000000000000000 P 303b5110ff5244e8a2d84a4bd9312da6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:44:57.465907 25970 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 303b5110ff5244e8a2d84a4bd9312da6 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:44:57.466100 25970 raft_consensus.cc:686] T 00000000000000000000000000000000 P 303b5110ff5244e8a2d84a4bd9312da6 [term 1 LEADER]: Becoming Leader. State: Replica: 303b5110ff5244e8a2d84a4bd9312da6, State: Running, Role: LEADER
I20260807 22:44:57.466162 25966 sys_catalog.cc:564] T 00000000000000000000000000000000 P 303b5110ff5244e8a2d84a4bd9312da6 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:44:57.466194 25970 consensus_queue.cc:237] T 00000000000000000000000000000000 P 303b5110ff5244e8a2d84a4bd9312da6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "303b5110ff5244e8a2d84a4bd9312da6" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43291 } }
I20260807 22:44:57.466579 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 25863
I20260807 22:44:57.466565 25971 sys_catalog.cc:455] T 00000000000000000000000000000000 P 303b5110ff5244e8a2d84a4bd9312da6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "303b5110ff5244e8a2d84a4bd9312da6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "303b5110ff5244e8a2d84a4bd9312da6" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43291 } } }
I20260807 22:44:57.466578 25973 sys_catalog.cc:455] T 00000000000000000000000000000000 P 303b5110ff5244e8a2d84a4bd9312da6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 303b5110ff5244e8a2d84a4bd9312da6. Latest consensus state: current_term: 1 leader_uuid: "303b5110ff5244e8a2d84a4bd9312da6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "303b5110ff5244e8a2d84a4bd9312da6" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 43291 } } }
I20260807 22:44:57.466679 25971 sys_catalog.cc:458] T 00000000000000000000000000000000 P 303b5110ff5244e8a2d84a4bd9312da6 [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:57.466684 25973 sys_catalog.cc:458] T 00000000000000000000000000000000 P 303b5110ff5244e8a2d84a4bd9312da6 [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:57.466702 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:44:57.466915 23377 external_mini_cluster.cc:1428] Setting key 0fa1fda00067989d4b6e082926120d95
I20260807 22:44:57.466917 25982 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:44:57.467433 25982 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:44:57.469195 25982 catalog_manager.cc:1347] Generated new cluster ID: e503afd7494747a382456b70d577c808
I20260807 22:44:57.469256 25982 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:44:57.476967 25982 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:44:57.477655 25982 catalog_manager.cc:1504] Loading token signing keys...
Aug 07 22:44:57 dist-test-slave-2d19 krb5kdc[25836](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142697, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:44:57.483345 26006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:57.467740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37513 (local address 127.22.212.126:43291)
0807 22:44:57.472590 (+ 4850us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:57.472598 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:57.472626 (+ 28us) server_negotiation.cc:407] Connection header received
0807 22:44:57.472723 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:57.472728 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:57.472778 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:57.472932 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:57.473724 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:57.475154 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:57.476295 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:57.476980 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:57.477137 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:57.479599 (+ 2462us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:57.479603 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:57.479603 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:44:57.479623 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:57.481376 (+ 1753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:57.481767 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:57.481771 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:57.481771 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:57.481864 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:57.482093 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:57.482094 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:57.482094 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:57.482336 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:57.482493 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:57.482943 (+ 450us) server_negotiation.cc:299] Negotiation successful
0807 22:44:57.483107 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4790,"thread_start_us":101,"threads_started":1}
I20260807 22:44:57.483435 25982 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 303b5110ff5244e8a2d84a4bd9312da6: Generated new TSK 0
I20260807 22:44:57.483560 25982 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:44:57.484367 23377 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:44:57.492640 26006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:57.485784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45183 (local address 127.22.212.126:43291)
0807 22:44:57.485824 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:57.485826 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:57.485937 (+ 111us) server_negotiation.cc:407] Connection header received
0807 22:44:57.485985 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:57.485986 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:57.485996 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:57.486054 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:57.486572 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:57.487350 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:57.488069 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:57.488410 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:57.488481 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:57.489621 (+ 1140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:57.489622 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:57.489623 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:44:57.489629 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:57.491204 (+ 1575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:57.491541 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:57.491542 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:57.491543 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:57.491603 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:44:57.491762 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:44:57.491763 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:44:57.491764 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:44:57.491899 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:57.492008 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:57.492417 (+ 409us) server_negotiation.cc:299] Negotiation successful
0807 22:44:57.492518 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 22:44:57.494882 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 25863
2026-08-07T22:44:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1581 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142418640232-23377-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:44:57 dist-test-slave-2d19 krb5kdc[26022](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:44:57 dist-test-slave-2d19 krb5kdc[26022](info): set up 2 sockets
Aug 07 22:44:57 dist-test-slave-2d19 krb5kdc[26022](info): commencing operation
krb5kdc: starting...
W20260807 22:44:58.742954 23377 mini_kdc.cc:121] Time spent starting KDC: real 1.218s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Aug 07 22:44:58 dist-test-slave-2d19 krb5kdc[26022](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142698, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:44:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:44:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.212.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
I20260807 22:44:58.869457 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:42643
--webserver_interface=127.22.212.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:44869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:42643
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:44:58.952472 26040 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:44:58.952680 26040 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:44:58.952703 26040 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:44:58.953848 26040 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:44:58.953891 26040 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:44:58.953907 26040 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:44:58.953946 26040 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:44:58.953975 26040 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:44:58.955566 26040 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:44869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:42643
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:42643
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26040
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:44:58.955819 26040 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:44:58.956063 26040 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:44:58.961272 26049 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:58.961294 26040 server_base.cc:1034] running on GCE node
W20260807 22:44:58.961263 26046 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:44:58.961264 26047 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:44:58.961705 26040 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:44:58.962033 26040 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:44:58.963204 26040 hybrid_clock.cc:648] HybridClock initialized: now 1786142698963182 us; error 38 us; skew 500 ppm
Aug 07 22:44:58 dist-test-slave-2d19 krb5kdc[26022](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142698, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:44:58.970091 26040 init.cc:377] Logged in from keytab as kudu/127.22.212.126@KRBTEST.COM (short username kudu)
I20260807 22:44:58.970575 26040 webserver.cc:460] Webserver started at http://127.22.212.126:42799/ using document root <none> and password file <none>
I20260807 22:44:58.970865 26040 fs_manager.cc:359] Metadata directory not provided
I20260807 22:44:58.970935 26040 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:44:58.971100 26040 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:44:58.972345 26040 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "4ef486136c6c4ef6aa53508f3cb397e1"
format_stamp: "Formatted at 2026-08-07 22:44:58 on dist-test-slave-2d19"
server_key: "f4843a72737afcea5f6676ae68cb082f"
server_key_iv: "522d430c68a437ac5b559cb346d49a62"
server_key_version: "encryptionkey@0"
I20260807 22:44:58.972720 26040 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "4ef486136c6c4ef6aa53508f3cb397e1"
format_stamp: "Formatted at 2026-08-07 22:44:58 on dist-test-slave-2d19"
server_key: "f4843a72737afcea5f6676ae68cb082f"
server_key_iv: "522d430c68a437ac5b559cb346d49a62"
server_key_version: "encryptionkey@0"
I20260807 22:44:58.974064 26040 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260807 22:44:58.974846 26067 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:44:58.975023 26040 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 22:44:58.975140 26040 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "4ef486136c6c4ef6aa53508f3cb397e1"
format_stamp: "Formatted at 2026-08-07 22:44:58 on dist-test-slave-2d19"
server_key: "f4843a72737afcea5f6676ae68cb082f"
server_key_iv: "522d430c68a437ac5b559cb346d49a62"
server_key_version: "encryptionkey@0"
I20260807 22:44:58.975221 26040 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:44:59.012692 26040 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:44:59.014837 26040 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:44:59.015059 26040 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:44:59.019414 26040 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:42643
I20260807 22:44:59.019448 26166 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:42643 every 8 connection(s)
I20260807 22:44:59.019825 26040 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:44:59.020819 26167 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:44:59.023252 26167 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ef486136c6c4ef6aa53508f3cb397e1: Bootstrap starting.
I20260807 22:44:59.023880 26167 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4ef486136c6c4ef6aa53508f3cb397e1: Neither blocks nor log segments found. Creating new log.
I20260807 22:44:59.024230 26167 log.cc:824] T 00000000000000000000000000000000 P 4ef486136c6c4ef6aa53508f3cb397e1: Log is configured to *not* fsync() on all Append() calls
I20260807 22:44:59.024992 26167 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ef486136c6c4ef6aa53508f3cb397e1: No bootstrap required, opened a new log
I20260807 22:44:59.025295 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 26040
I20260807 22:44:59.025414 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:44:59.025669 23377 external_mini_cluster.cc:1428] Setting key deae10585950d6c0754c5c8442e12205
I20260807 22:44:59.028009 26167 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4ef486136c6c4ef6aa53508f3cb397e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ef486136c6c4ef6aa53508f3cb397e1" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 42643 } }
I20260807 22:44:59.028190 26167 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4ef486136c6c4ef6aa53508f3cb397e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:44:59.028223 26167 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4ef486136c6c4ef6aa53508f3cb397e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ef486136c6c4ef6aa53508f3cb397e1, State: Initialized, Role: FOLLOWER
I20260807 22:44:59.028379 26167 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4ef486136c6c4ef6aa53508f3cb397e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ef486136c6c4ef6aa53508f3cb397e1" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 42643 } }
I20260807 22:44:59.028461 26167 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4ef486136c6c4ef6aa53508f3cb397e1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:44:59.028491 26167 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4ef486136c6c4ef6aa53508f3cb397e1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:44:59.028527 26167 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4ef486136c6c4ef6aa53508f3cb397e1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:44:59.029209 26167 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4ef486136c6c4ef6aa53508f3cb397e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ef486136c6c4ef6aa53508f3cb397e1" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 42643 } }
I20260807 22:44:59.029340 26167 leader_election.cc:302] T 00000000000000000000000000000000 P 4ef486136c6c4ef6aa53508f3cb397e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4ef486136c6c4ef6aa53508f3cb397e1; no voters:
I20260807 22:44:59.029524 26167 leader_election.cc:288] T 00000000000000000000000000000000 P 4ef486136c6c4ef6aa53508f3cb397e1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:44:59.029575 26177 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4ef486136c6c4ef6aa53508f3cb397e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:44:59.029723 26177 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4ef486136c6c4ef6aa53508f3cb397e1 [term 1 LEADER]: Becoming Leader. State: Replica: 4ef486136c6c4ef6aa53508f3cb397e1, State: Running, Role: LEADER
I20260807 22:44:59.029801 26167 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4ef486136c6c4ef6aa53508f3cb397e1 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:44:59.029824 26177 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4ef486136c6c4ef6aa53508f3cb397e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ef486136c6c4ef6aa53508f3cb397e1" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 42643 } }
I20260807 22:44:59.030155 26179 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ef486136c6c4ef6aa53508f3cb397e1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4ef486136c6c4ef6aa53508f3cb397e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ef486136c6c4ef6aa53508f3cb397e1" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 42643 } } }
I20260807 22:44:59.030244 26179 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ef486136c6c4ef6aa53508f3cb397e1 [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:59.030475 26183 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ef486136c6c4ef6aa53508f3cb397e1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4ef486136c6c4ef6aa53508f3cb397e1. Latest consensus state: current_term: 1 leader_uuid: "4ef486136c6c4ef6aa53508f3cb397e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ef486136c6c4ef6aa53508f3cb397e1" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 42643 } } }
I20260807 22:44:59.030616 26183 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ef486136c6c4ef6aa53508f3cb397e1 [sys.catalog]: This master's current role is: LEADER
I20260807 22:44:59.030813 26191 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:44:59.031723 26191 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:44:59.032413 26176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:59.026241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46945 (local address 127.22.212.126:42643)
0807 22:44:59.026443 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:59.026453 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:59.026488 (+ 35us) server_negotiation.cc:407] Connection header received
0807 22:44:59.026983 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:59.026993 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:59.027059 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:59.027222 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:59.027391 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:59.028829 (+ 1438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:59.029845 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:59.030480 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:59.030569 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:59.031479 (+ 910us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:59.031483 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:59.031483 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:44:59.031719 (+ 236us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:59.031761 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:44:59.031779 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:59.031848 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:59.032048 (+ 200us) server_negotiation.cc:299] Negotiation successful
0807 22:44:59.032130 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":90,"threads_started":1}
I20260807 22:44:59.033535 23377 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:44:59.033630 26191 catalog_manager.cc:1347] Generated new cluster ID: 3bdbaf5053c246929e5911bf8d88d367
I20260807 22:44:59.033666 26191 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:44:59.037823 26191 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:44:59.038691 26191 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:44:59.041666 26176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:44:59.037906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35675 (local address 127.22.212.126:42643)
0807 22:44:59.037940 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0807 22:44:59.037943 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:44:59.038171 (+ 228us) server_negotiation.cc:407] Connection header received
0807 22:44:59.038221 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:44:59.038221 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:44:59.038232 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:44:59.038300 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:44:59.038466 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:59.039221 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:59.040292 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:44:59.040589 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:44:59.040650 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:44:59.041394 (+ 744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:44:59.041395 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:44:59.041395 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:44:59.041400 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:44:59.041415 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:44:59.041420 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:44:59.041480 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0807 22:44:59.041556 (+ 76us) server_negotiation.cc:299] Negotiation successful
0807 22:44:59.041592 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":37,"server-negotiator.queue_time_us":14}
I20260807 22:44:59.043156 26191 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4ef486136c6c4ef6aa53508f3cb397e1: Generated new TSK 0
I20260807 22:44:59.043329 26191 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:44:59.049422 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 26040
2026-08-07T22:44:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1551 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142418640232-23377-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:44:59 dist-test-slave-2d19 krb5kdc[26228](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:44:59 dist-test-slave-2d19 krb5kdc[26228](info): set up 2 sockets
Aug 07 22:44:59 dist-test-slave-2d19 krb5kdc[26228](info): commencing operation
krb5kdc: starting...
W20260807 22:45:00.317098 23377 mini_kdc.cc:121] Time spent starting KDC: real 1.241s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Aug 07 22:45:00 dist-test-slave-2d19 krb5kdc[26228](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142700, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:45:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:45:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.212.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
I20260807 22:45:00.442945 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:46339
--webserver_interface=127.22.212.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:44511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:46339
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:45:00.525818 26259 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:45:00.526016 26259 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:45:00.526039 26259 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:45:00.527091 26259 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:45:00.527125 26259 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:45:00.527139 26259 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:45:00.527153 26259 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:45:00.527164 26259 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:45:00.528604 26259 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:44511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:46339
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:46339
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26259
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:45:00.528805 26259 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:45:00.528970 26259 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:45:00.533977 26273 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:45:00.533996 26271 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:45:00.533981 26269 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:45:00.534209 26259 server_base.cc:1034] running on GCE node
I20260807 22:45:00.534492 26259 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:45:00.534745 26259 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:45:00.535888 26259 hybrid_clock.cc:648] HybridClock initialized: now 1786142700535851 us; error 52 us; skew 500 ppm
Aug 07 22:45:00 dist-test-slave-2d19 krb5kdc[26228](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142700, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:45:00.538367 26259 init.cc:377] Logged in from keytab as kudu/127.22.212.126@KRBTEST.COM (short username kudu)
I20260807 22:45:00.538784 26259 webserver.cc:460] Webserver started at http://127.22.212.126:41855/ using document root <none> and password file <none>
I20260807 22:45:00.539042 26259 fs_manager.cc:359] Metadata directory not provided
I20260807 22:45:00.539093 26259 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:45:00.539223 26259 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:45:00.540328 26259 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "89aa542c7228457597dd82d0ad3b3fd7"
format_stamp: "Formatted at 2026-08-07 22:45:00 on dist-test-slave-2d19"
server_key: "49f92f294028c7a8ab6d69b86be3a698"
server_key_iv: "304e333cbe5cb1034499e011062a8259"
server_key_version: "encryptionkey@0"
I20260807 22:45:00.540696 26259 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "89aa542c7228457597dd82d0ad3b3fd7"
format_stamp: "Formatted at 2026-08-07 22:45:00 on dist-test-slave-2d19"
server_key: "49f92f294028c7a8ab6d69b86be3a698"
server_key_iv: "304e333cbe5cb1034499e011062a8259"
server_key_version: "encryptionkey@0"
I20260807 22:45:00.542001 26259 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 22:45:00.542758 26286 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:45:00.542941 26259 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 22:45:00.543066 26259 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "89aa542c7228457597dd82d0ad3b3fd7"
format_stamp: "Formatted at 2026-08-07 22:45:00 on dist-test-slave-2d19"
server_key: "49f92f294028c7a8ab6d69b86be3a698"
server_key_iv: "304e333cbe5cb1034499e011062a8259"
server_key_version: "encryptionkey@0"
I20260807 22:45:00.543138 26259 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:45:00.546469 26259 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:45:00.548756 26259 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:45:00.548914 26259 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:45:00.552816 26259 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:46339
I20260807 22:45:00.552868 26384 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:46339 every 8 connection(s)
I20260807 22:45:00.553194 26259 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:45:00.554219 26385 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:45:00.556629 26385 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 89aa542c7228457597dd82d0ad3b3fd7: Bootstrap starting.
I20260807 22:45:00.557245 26385 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 89aa542c7228457597dd82d0ad3b3fd7: Neither blocks nor log segments found. Creating new log.
I20260807 22:45:00.557530 26385 log.cc:824] T 00000000000000000000000000000000 P 89aa542c7228457597dd82d0ad3b3fd7: Log is configured to *not* fsync() on all Append() calls
I20260807 22:45:00.558275 26385 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 89aa542c7228457597dd82d0ad3b3fd7: No bootstrap required, opened a new log
I20260807 22:45:00.558274 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 26259
I20260807 22:45:00.558395 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:45:00.558601 23377 external_mini_cluster.cc:1428] Setting key 63d305036a02ed828147439241c98cb2
I20260807 22:45:00.560225 26385 raft_consensus.cc:348] T 00000000000000000000000000000000 P 89aa542c7228457597dd82d0ad3b3fd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89aa542c7228457597dd82d0ad3b3fd7" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 46339 } }
I20260807 22:45:00.560482 26385 raft_consensus.cc:374] T 00000000000000000000000000000000 P 89aa542c7228457597dd82d0ad3b3fd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 22:45:00.560539 26385 raft_consensus.cc:729] T 00000000000000000000000000000000 P 89aa542c7228457597dd82d0ad3b3fd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89aa542c7228457597dd82d0ad3b3fd7, State: Initialized, Role: FOLLOWER
I20260807 22:45:00.560678 26385 consensus_queue.cc:260] T 00000000000000000000000000000000 P 89aa542c7228457597dd82d0ad3b3fd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89aa542c7228457597dd82d0ad3b3fd7" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 46339 } }
I20260807 22:45:00.560765 26385 raft_consensus.cc:388] T 00000000000000000000000000000000 P 89aa542c7228457597dd82d0ad3b3fd7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 22:45:00.560787 26385 raft_consensus.cc:482] T 00000000000000000000000000000000 P 89aa542c7228457597dd82d0ad3b3fd7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 22:45:00.560853 26385 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 89aa542c7228457597dd82d0ad3b3fd7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:45:00.561592 26393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:00.559147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47579 (local address 127.22.212.126:46339)
0807 22:45:00.559324 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:00.559332 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:00.559357 (+ 25us) server_negotiation.cc:407] Connection header received
0807 22:45:00.560212 (+ 855us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:00.560220 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:00.560294 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:00.560427 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:00.561141 (+ 714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:45:00.561144 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:45:00.561145 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:45:00.561149 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:45:00.561195 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:45:00.561206 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:45:00.561276 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 22:45:00.561360 (+ 84us) server_negotiation.cc:299] Negotiation successful
0807 22:45:00.561402 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":87,"threads_started":1}
I20260807 22:45:00.561910 26385 raft_consensus.cc:504] T 00000000000000000000000000000000 P 89aa542c7228457597dd82d0ad3b3fd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89aa542c7228457597dd82d0ad3b3fd7" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 46339 } }
I20260807 22:45:00.562016 26385 leader_election.cc:302] T 00000000000000000000000000000000 P 89aa542c7228457597dd82d0ad3b3fd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 89aa542c7228457597dd82d0ad3b3fd7; no voters:
I20260807 22:45:00.562208 26385 leader_election.cc:288] T 00000000000000000000000000000000 P 89aa542c7228457597dd82d0ad3b3fd7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 22:45:00.562227 26395 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 89aa542c7228457597dd82d0ad3b3fd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:45:00.562342 26395 raft_consensus.cc:686] T 00000000000000000000000000000000 P 89aa542c7228457597dd82d0ad3b3fd7 [term 1 LEADER]: Becoming Leader. State: Replica: 89aa542c7228457597dd82d0ad3b3fd7, State: Running, Role: LEADER
I20260807 22:45:00.562423 26395 consensus_queue.cc:237] T 00000000000000000000000000000000 P 89aa542c7228457597dd82d0ad3b3fd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89aa542c7228457597dd82d0ad3b3fd7" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 46339 } }
I20260807 22:45:00.562465 26385 sys_catalog.cc:564] T 00000000000000000000000000000000 P 89aa542c7228457597dd82d0ad3b3fd7 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:45:00.562587 23377 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:45:00.562788 26397 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89aa542c7228457597dd82d0ad3b3fd7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "89aa542c7228457597dd82d0ad3b3fd7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89aa542c7228457597dd82d0ad3b3fd7" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 46339 } } }
I20260807 22:45:00.562857 26397 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89aa542c7228457597dd82d0ad3b3fd7 [sys.catalog]: This master's current role is: LEADER
I20260807 22:45:00.563028 26399 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89aa542c7228457597dd82d0ad3b3fd7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 89aa542c7228457597dd82d0ad3b3fd7. Latest consensus state: current_term: 1 leader_uuid: "89aa542c7228457597dd82d0ad3b3fd7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89aa542c7228457597dd82d0ad3b3fd7" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 46339 } } }
I20260807 22:45:00.563102 26399 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89aa542c7228457597dd82d0ad3b3fd7 [sys.catalog]: This master's current role is: LEADER
I20260807 22:45:00.563090 26402 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:45:00.563700 26402 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:45:00.565500 26402 catalog_manager.cc:1347] Generated new cluster ID: dba3699240de4eaebb0a5165f827a6d3
I20260807 22:45:00.565552 26402 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:45:00.575861 26402 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:45:00.576040 26402 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:45:00.577137 26393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:00.564540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47221 (local address 127.22.212.126:46339)
0807 22:45:00.564585 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:00.564587 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:00.575905 (+ 11318us) server_negotiation.cc:407] Connection header received
0807 22:45:00.576067 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:00.576068 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:00.576074 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:00.576143 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:00.576902 (+ 759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:45:00.576904 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:45:00.576904 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 22:45:00.576910 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:45:00.576928 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 22:45:00.576933 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:45:00.576997 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0807 22:45:00.577054 (+ 57us) server_negotiation.cc:299] Negotiation successful
0807 22:45:00.577069 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260807 22:45:00.585623 26402 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 89aa542c7228457597dd82d0ad3b3fd7: Generated new TSK 0
I20260807 22:45:00.585832 26402 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 22:45:00.592094 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 26259
2026-08-07T22:45:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1539 ms)
[----------] 18 tests from AuthTokenIssuingTest (28091 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:45:00 dist-test-slave-2d19 krb5kdc[26439](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:45:00 dist-test-slave-2d19 krb5kdc[26439](info): set up 2 sockets
Aug 07 22:45:00 dist-test-slave-2d19 krb5kdc[26439](info): commencing operation
krb5kdc: starting...
W20260807 22:45:01.860126 23377 mini_kdc.cc:121] Time spent starting KDC: real 1.245s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Aug 07 22:45:01 dist-test-slave-2d19 krb5kdc[26439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142701, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:45:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:45:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.212.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
I20260807 22:45:01.991623 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:40483
--webserver_interface=127.22.212.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:34421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:40483,127.22.212.125:45913,127.22.212.124:37131
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:45:02.075026 26461 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 22:45:02.075243 26461 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:45:02.075261 26461 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:45:02.075281 26461 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:45:02.076509 26461 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:45:02.076550 26461 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:45:02.076565 26461 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:45:02.076584 26461 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:45:02.076597 26461 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:45:02.078120 26461 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:34421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:40483,127.22.212.125:45913,127.22.212.124:37131
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:40483
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26461
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:45:02.078387 26461 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:45:02.078640 26461 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:45:02.084131 26467 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:45:02.084170 26461 server_base.cc:1034] running on GCE node
W20260807 22:45:02.084136 26468 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:45:02.084136 26471 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:45:02.084642 26461 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:45:02.084955 26461 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:45:02.086107 26461 hybrid_clock.cc:648] HybridClock initialized: now 1786142702086095 us; error 47 us; skew 500 ppm
Aug 07 22:45:02 dist-test-slave-2d19 krb5kdc[26439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142702, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:45:02.088860 26461 init.cc:377] Logged in from keytab as kudu/127.22.212.126@KRBTEST.COM (short username kudu)
I20260807 22:45:02.089311 26461 webserver.cc:460] Webserver started at http://127.22.212.126:41095/ using document root <none> and password file <none>
I20260807 22:45:02.089592 26461 fs_manager.cc:359] Metadata directory not provided
I20260807 22:45:02.089641 26461 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:45:02.089813 26461 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:45:02.090898 26461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "9d4913bffc7e43469d3b74a444db264e"
format_stamp: "Formatted at 2026-08-07 22:45:02 on dist-test-slave-2d19"
server_key: "8979c559012b6b12b2b125c547d7f1df"
server_key_iv: "716bab0d3af81e4d727add17ec930fe8"
server_key_version: "encryptionkey@0"
I20260807 22:45:02.091272 26461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "9d4913bffc7e43469d3b74a444db264e"
format_stamp: "Formatted at 2026-08-07 22:45:02 on dist-test-slave-2d19"
server_key: "8979c559012b6b12b2b125c547d7f1df"
server_key_iv: "716bab0d3af81e4d727add17ec930fe8"
server_key_version: "encryptionkey@0"
I20260807 22:45:02.092736 26461 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 22:45:02.093575 26479 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:45:02.093863 26461 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:45:02.093977 26461 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "9d4913bffc7e43469d3b74a444db264e"
format_stamp: "Formatted at 2026-08-07 22:45:02 on dist-test-slave-2d19"
server_key: "8979c559012b6b12b2b125c547d7f1df"
server_key_iv: "716bab0d3af81e4d727add17ec930fe8"
server_key_version: "encryptionkey@0"
I20260807 22:45:02.094059 26461 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:45:02.105119 26461 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:45:02.107446 26461 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:45:02.107620 26461 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:45:02.111521 26461 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:40483
I20260807 22:45:02.111586 26569 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:40483 every 8 connection(s)
I20260807 22:45:02.111925 26461 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:45:02.112855 26572 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:45:02.114449 26572 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.212.126" port: 40483 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:45:02.116982 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 26461
I20260807 22:45:02.117071 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:45:02.117255 23377 external_mini_cluster.cc:1428] Setting key a353ef732b014138989b0fef6dfddbf5
Aug 07 22:45:02 dist-test-slave-2d19 krb5kdc[26439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142702, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:45:02.124456 26578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:02.115347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33720 (local address 127.22.212.126:40483)
0807 22:45:02.115477 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:02.115481 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:02.115514 (+ 33us) server_negotiation.cc:407] Connection header received
0807 22:45:02.116028 (+ 514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:02.116030 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:02.116047 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:02.116128 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:02.116740 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.117666 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.118548 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.118855 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.118983 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:02.121150 (+ 2167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:45:02.121162 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:45:02.121162 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:45:02.121168 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:45:02.122787 (+ 1619us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:02.123188 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:02.123192 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:02.123192 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:02.123275 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:02.123502 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:02.123503 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:02.123503 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:02.123715 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:45:02.123812 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 22:45:02.124002 (+ 190us) server_negotiation.cc:299] Negotiation successful
0807 22:45:02.124157 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":64,"threads_started":1}
I20260807 22:45:02.124459 26577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:02.115191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:40483 (local address 127.0.0.1:33720)
0807 22:45:02.115368 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:02.115404 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 22:45:02.115887 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:45:02.116164 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:45:02.116166 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:45:02.116494 (+ 328us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:45:02.116653 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:45:02.116658 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.117781 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.117781 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:45:02.118447 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:45:02.118449 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.118954 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.118955 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:45:02.119018 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:02.119575 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:45:02.119585 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:45:02.121047 (+ 1462us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:45:02.122889 (+ 1842us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:45:02.122896 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:45:02.122898 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:45:02.123097 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:45:02.123343 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:45:02.123344 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:45:02.123345 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:45:02.123430 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:45:02.123790 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:45:02.123795 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:45:02.123856 (+ 61us) client_negotiation.cc:769] Sending connection context
0807 22:45:02.123968 (+ 112us) client_negotiation.cc:240] Negotiation successful
0807 22:45:02.124225 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"mutex_wait_us":109,"thread_start_us":70,"threads_started":1}
I20260807 22:45:02.125304 26572 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.212.125" port: 45913 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.22.212.125@KRBTEST.COM; defaulting to no policy
I20260807 22:45:02.125702 26577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:02.125575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.125:45913 (local address 127.0.0.1:56792)
0807 22:45:02.125626 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:02.125672 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.125:45913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260807 22:45:02.125837 26480 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.212.125:45913: connect: Connection refused (error 111)
I20260807 22:45:02.126261 26577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:02.126161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.125:45913 (local address 127.0.0.1:56804)
0807 22:45:02.126207 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:02.126232 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.125:45913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260807 22:45:02.126358 26572 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.212.125:45913: Network error: Client connection negotiation failed: client connection to 127.22.212.125:45913: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.125.keytab.
Entry for principal kudu/127.22.212.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.125.keytab.
I20260807 22:45:02.146869 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.125:45913
--webserver_interface=127.22.212.125
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.125.keytab
--principal=kudu/127.22.212.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:34421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:40483,127.22.212.125:45913,127.22.212.124:37131
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:45:02.175586 26572 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.212.125" port: 45913 } attempt: 1
I20260807 22:45:02.176082 26577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:02.175946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.125:45913 (local address 127.0.0.1:56816)
0807 22:45:02.176012 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:02.176052 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.125:45913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260807 22:45:02.176456 26577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:02.176351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.125:45913 (local address 127.0.0.1:56820)
0807 22:45:02.176398 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:02.176434 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.125:45913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260807 22:45:02.176574 26572 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.212.125:45913: Network error: Client connection negotiation failed: client connection to 127.22.212.125:45913: connect: Connection refused (error 111)
W20260807 22:45:02.230687 26584 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 22:45:02.230935 26584 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:45:02.230965 26584 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:45:02.231033 26584 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:45:02.232225 26584 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:45:02.232312 26584 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:45:02.232342 26584 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:45:02.232369 26584 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:45:02.232395 26584 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:45:02.233932 26584 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:34421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:40483,127.22.212.125:45913,127.22.212.124:37131
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.125.keytab
--principal=kudu/127.22.212.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.125:45913
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.22.212.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26584
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:45:02.234229 26584 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:45:02.234459 26584 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:45:02.239496 26589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:45:02.239529 26590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:45:02.239499 26593 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:45:02.239782 26584 server_base.cc:1034] running on GCE node
I20260807 22:45:02.240020 26584 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:45:02.240378 26584 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:45:02.241549 26584 hybrid_clock.cc:648] HybridClock initialized: now 1786142702241524 us; error 39 us; skew 500 ppm
Aug 07 22:45:02 dist-test-slave-2d19 krb5kdc[26439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142702, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:45:02.244115 26584 init.cc:377] Logged in from keytab as kudu/127.22.212.125@KRBTEST.COM (short username kudu)
I20260807 22:45:02.244583 26584 webserver.cc:460] Webserver started at http://127.22.212.125:41567/ using document root <none> and password file <none>
I20260807 22:45:02.244724 26572 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.212.125" port: 45913 } attempt: 2
I20260807 22:45:02.244874 26584 fs_manager.cc:359] Metadata directory not provided
I20260807 22:45:02.244939 26584 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:45:02.245093 26584 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:45:02.245107 26577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:02.244988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.125:45913 (local address 127.0.0.1:56824)
0807 22:45:02.245046 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:02.245075 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.125:45913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260807 22:45:02.245486 26577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:02.245380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.125:45913 (local address 127.0.0.1:56830)
0807 22:45:02.245428 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:02.245459 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.125:45913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260807 22:45:02.245633 26572 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.212.125:45913: Network error: Client connection negotiation failed: client connection to 127.22.212.125:45913: connect: Connection refused (error 111)
I20260807 22:45:02.246348 26584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-1/data/instance:
uuid: "ff0c003746fc41608f07fd3ae8335910"
format_stamp: "Formatted at 2026-08-07 22:45:02 on dist-test-slave-2d19"
server_key: "bfb64c9302607b2d7841e52ef87d005c"
server_key_iv: "972d0ab60632ea2d290338db9e12a999"
server_key_version: "encryptionkey@0"
I20260807 22:45:02.246714 26584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-1/wal/instance:
uuid: "ff0c003746fc41608f07fd3ae8335910"
format_stamp: "Formatted at 2026-08-07 22:45:02 on dist-test-slave-2d19"
server_key: "bfb64c9302607b2d7841e52ef87d005c"
server_key_iv: "972d0ab60632ea2d290338db9e12a999"
server_key_version: "encryptionkey@0"
I20260807 22:45:02.248034 26584 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 22:45:02.248901 26608 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:45:02.249104 26584 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 22:45:02.249186 26584 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-1/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-1/wal
uuid: "ff0c003746fc41608f07fd3ae8335910"
format_stamp: "Formatted at 2026-08-07 22:45:02 on dist-test-slave-2d19"
server_key: "bfb64c9302607b2d7841e52ef87d005c"
server_key_iv: "972d0ab60632ea2d290338db9e12a999"
server_key_version: "encryptionkey@0"
I20260807 22:45:02.249240 26584 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:45:02.278702 26584 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:45:02.281461 26584 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:45:02.281592 26584 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:45:02.285804 26584 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.125:45913
I20260807 22:45:02.285840 26694 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.125:45913 every 8 connection(s)
I20260807 22:45:02.286248 26584 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-1/data/info.pb
I20260807 22:45:02.287206 26695 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:45:02.288916 26695 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.212.126" port: 40483 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:45:02.292842 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 26584
I20260807 22:45:02.292927 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-1/wal/instance
I20260807 22:45:02.293129 23377 external_mini_cluster.cc:1428] Setting key 959c66b9284a5107526bcf04d2572a76
Aug 07 22:45:02 dist-test-slave-2d19 krb5kdc[26439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142702, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.125@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:45:02.298853 26578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:02.289647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33722 (local address 127.22.212.126:40483)
0807 22:45:02.289694 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:02.289696 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:02.289976 (+ 280us) server_negotiation.cc:407] Connection header received
0807 22:45:02.290505 (+ 529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:02.290507 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:02.290530 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:02.290593 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:02.291232 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.291739 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.292854 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.293173 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.293250 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:02.295555 (+ 2305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:45:02.295557 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:45:02.295557 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:45:02.295567 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:45:02.297090 (+ 1523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:02.297665 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:02.297666 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:02.297666 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:02.297720 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:02.298044 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:02.298045 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:02.298045 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:02.298151 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:45:02.298204 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0807 22:45:02.298561 (+ 357us) server_negotiation.cc:299] Negotiation successful
0807 22:45:02.298700 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 22:45:02.298908 26697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:02.289654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:40483 (local address 127.0.0.1:33722)
0807 22:45:02.289847 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:02.289887 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 22:45:02.290395 (+ 508us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:45:02.290686 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:45:02.290689 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:45:02.290934 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:45:02.291132 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:45:02.291137 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.291838 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.291839 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:45:02.292753 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:45:02.292755 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.293261 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.293262 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:45:02.293384 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:02.293928 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:45:02.293936 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:45:02.295451 (+ 1515us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:45:02.297173 (+ 1722us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:45:02.297181 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:45:02.297183 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:45:02.297583 (+ 400us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:45:02.297796 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:45:02.297797 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:45:02.297797 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:45:02.297971 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:45:02.298223 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:45:02.298232 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:45:02.298415 (+ 183us) client_negotiation.cc:769] Sending connection context
0807 22:45:02.298542 (+ 127us) client_negotiation.cc:240] Negotiation successful
0807 22:45:02.298729 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":92,"threads_started":1}
I20260807 22:45:02.299962 26695 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.212.125" port: 45913 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.22.212.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.124@KRBTEST.COM" created.
Aug 07 22:45:02 dist-test-slave-2d19 krb5kdc[26439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142702, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.125@KRBTEST.COM for kudu/127.22.212.125@KRBTEST.COM
I20260807 22:45:02.310215 26697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:02.300302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.125:45913 (local address 127.0.0.1:56832)
0807 22:45:02.300347 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:02.300360 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 22:45:02.300407 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:45:02.300687 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:45:02.300688 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:45:02.300842 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:45:02.300911 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:45:02.300913 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.301781 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.301783 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:45:02.302626 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:45:02.302629 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.303166 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.303166 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:45:02.303223 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:02.303583 (+ 360us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:45:02.303586 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:45:02.306616 (+ 3030us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:45:02.308814 (+ 2198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:45:02.308814 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:45:02.308815 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:45:02.309047 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:45:02.309299 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:45:02.309300 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:45:02.309301 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:45:02.309373 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:45:02.309751 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:45:02.309753 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:45:02.309824 (+ 71us) client_negotiation.cc:769] Sending connection context
0807 22:45:02.309900 (+ 76us) client_negotiation.cc:240] Negotiation successful
0807 22:45:02.310004 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
I20260807 22:45:02.310492 26699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:02.300366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56832 (local address 127.22.212.125:45913)
0807 22:45:02.300543 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:02.300547 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:02.300563 (+ 16us) server_negotiation.cc:407] Connection header received
0807 22:45:02.300583 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:02.300584 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:02.300596 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:02.300663 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:02.300991 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.301688 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.302755 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.303089 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.303148 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:02.306722 (+ 3574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:45:02.306732 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:45:02.306732 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:45:02.306739 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:45:02.308723 (+ 1984us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:02.309154 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:02.309158 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:02.309158 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:02.309220 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:02.309458 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:02.309459 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:02.309459 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:02.309619 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:45:02.309742 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0807 22:45:02.309969 (+ 227us) server_negotiation.cc:299] Negotiation successful
0807 22:45:02.310120 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":114,"threads_started":1}
I20260807 22:45:02.311292 26695 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37131 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:45:02.311681 26697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:02.311538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:37131 (local address 127.0.0.1:51338)
0807 22:45:02.311591 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:02.311649 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.124:37131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260807 22:45:02.311839 26612 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.212.124:37131: connect: Connection refused (error 111)
I20260807 22:45:02.312342 26697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:02.312206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:37131 (local address 127.0.0.1:51342)
0807 22:45:02.312277 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:02.312311 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.124:37131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260807 22:45:02.312476 26695 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.212.124:37131: Network error: Client connection negotiation failed: client connection to 127.22.212.124:37131: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.124.keytab.
Entry for principal kudu/127.22.212.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.124.keytab.
I20260807 22:45:02.323571 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.124:37131
--webserver_interface=127.22.212.124
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.124.keytab
--principal=kudu/127.22.212.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:34421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:40483,127.22.212.125:45913,127.22.212.124:37131
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:45:02.336779 26572 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.212.125" port: 45913 } attempt: 3
Aug 07 22:45:02 dist-test-slave-2d19 krb5kdc[26439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142702, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for kudu/127.22.212.125@KRBTEST.COM
I20260807 22:45:02.343950 26699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:02.337220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56840 (local address 127.22.212.125:45913)
0807 22:45:02.337289 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:02.337291 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:02.337319 (+ 28us) server_negotiation.cc:407] Connection header received
0807 22:45:02.337351 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:02.337352 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:02.337368 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:02.337438 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:02.337787 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.338280 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.338988 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.339210 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.339300 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:02.341233 (+ 1933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:45:02.341235 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:45:02.341235 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:45:02.341244 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:45:02.342708 (+ 1464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:02.343121 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:02.343123 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:02.343123 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:02.343184 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:02.343400 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:02.343401 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:02.343402 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:02.343518 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:45:02.343596 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 22:45:02.343758 (+ 162us) server_negotiation.cc:299] Negotiation successful
0807 22:45:02.343845 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 22:45:02.343950 26577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:02.337145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.125:45913 (local address 127.0.0.1:56840)
0807 22:45:02.337197 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:02.337215 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 22:45:02.337286 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:45:02.337445 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:45:02.337446 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:45:02.337615 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:45:02.337682 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:45:02.337683 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.338377 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.338380 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:45:02.338901 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:45:02.338902 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.339300 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.339301 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:45:02.339381 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:02.339869 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:45:02.339874 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:45:02.341141 (+ 1267us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:45:02.342838 (+ 1697us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:45:02.342839 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:45:02.342839 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:45:02.343026 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:45:02.343265 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:45:02.343265 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:45:02.343266 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:45:02.343330 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:45:02.343594 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:45:02.343595 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:45:02.343646 (+ 51us) client_negotiation.cc:769] Sending connection context
0807 22:45:02.343732 (+ 86us) client_negotiation.cc:240] Negotiation successful
0807 22:45:02.343844 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260807 22:45:02.344350 26572 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37131 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:45:02.344767 26577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:02.344659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:37131 (local address 127.0.0.1:51358)
0807 22:45:02.344716 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:02.344748 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.124:37131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260807 22:45:02.345100 26577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:02.345005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:37131 (local address 127.0.0.1:51364)
0807 22:45:02.345050 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:02.345080 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.124:37131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260807 22:45:02.345201 26572 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.212.124:37131: Network error: Client connection negotiation failed: client connection to 127.22.212.124:37131: connect: Connection refused (error 111)
I20260807 22:45:02.361738 26695 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37131 } attempt: 1
I20260807 22:45:02.362372 26697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:02.362195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:37131 (local address 127.0.0.1:51368)
0807 22:45:02.362267 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:02.362323 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.124:37131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260807 22:45:02.362790 26697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:02.362675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:37131 (local address 127.0.0.1:51372)
0807 22:45:02.362727 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:02.362763 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.124:37131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260807 22:45:02.362898 26695 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.212.124:37131: Network error: Client connection negotiation failed: client connection to 127.22.212.124:37131: connect: Connection refused (error 111)
I20260807 22:45:02.376322 26572 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37131 } attempt: 1
I20260807 22:45:02.376791 26577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:02.376654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:37131 (local address 127.0.0.1:51384)
0807 22:45:02.376721 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:02.376763 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.124:37131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260807 22:45:02.377213 26577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:02.377121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:37131 (local address 127.0.0.1:51400)
0807 22:45:02.377168 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:02.377195 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.124:37131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260807 22:45:02.377329 26572 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.212.124:37131: Network error: Client connection negotiation failed: client connection to 127.22.212.124:37131: connect: Connection refused (error 111)
W20260807 22:45:02.409294 26702 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 22:45:02.409526 26702 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:45:02.409555 26702 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:45:02.409598 26702 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:45:02.410722 26702 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:45:02.410789 26702 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:45:02.410815 26702 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:45:02.410845 26702 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:45:02.410871 26702 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:45:02.412432 26702 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:34421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:40483,127.22.212.125:45913,127.22.212.124:37131
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.124.keytab
--principal=kudu/127.22.212.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.124:37131
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.22.212.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26702
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:45:02.412705 26702 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:45:02.412943 26702 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:45:02.418444 26723 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:45:02.418457 26717 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:45:02.418462 26719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:45:02.418710 26702 server_base.cc:1034] running on GCE node
I20260807 22:45:02.418948 26702 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:45:02.419268 26702 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:45:02.420444 26702 hybrid_clock.cc:648] HybridClock initialized: now 1786142702420438 us; error 37 us; skew 500 ppm
Aug 07 22:45:02 dist-test-slave-2d19 krb5kdc[26439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142702, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:45:02.422999 26702 init.cc:377] Logged in from keytab as kudu/127.22.212.124@KRBTEST.COM (short username kudu)
I20260807 22:45:02.423430 26702 webserver.cc:460] Webserver started at http://127.22.212.124:40315/ using document root <none> and password file <none>
I20260807 22:45:02.423691 26702 fs_manager.cc:359] Metadata directory not provided
I20260807 22:45:02.423761 26702 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:45:02.423908 26702 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:45:02.425105 26702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-2/data/instance:
uuid: "340cb05ea90d4432b41115f665fee098"
format_stamp: "Formatted at 2026-08-07 22:45:02 on dist-test-slave-2d19"
server_key: "b109eaf29ad68d64aa81224be0d96113"
server_key_iv: "92bc85eec749fa693cbdb89e4f9d2739"
server_key_version: "encryptionkey@0"
I20260807 22:45:02.425480 26702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-2/wal/instance:
uuid: "340cb05ea90d4432b41115f665fee098"
format_stamp: "Formatted at 2026-08-07 22:45:02 on dist-test-slave-2d19"
server_key: "b109eaf29ad68d64aa81224be0d96113"
server_key_iv: "92bc85eec749fa693cbdb89e4f9d2739"
server_key_version: "encryptionkey@0"
I20260807 22:45:02.426846 26702 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260807 22:45:02.427557 26739 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:45:02.427729 26702 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 22:45:02.427839 26702 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-2/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-2/wal
uuid: "340cb05ea90d4432b41115f665fee098"
format_stamp: "Formatted at 2026-08-07 22:45:02 on dist-test-slave-2d19"
server_key: "b109eaf29ad68d64aa81224be0d96113"
server_key_iv: "92bc85eec749fa693cbdb89e4f9d2739"
server_key_version: "encryptionkey@0"
I20260807 22:45:02.427915 26702 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:45:02.431082 26695 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37131 } attempt: 2
I20260807 22:45:02.431479 26697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:02.431356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:37131 (local address 127.0.0.1:51406)
0807 22:45:02.431414 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:02.431451 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.124:37131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260807 22:45:02.431813 26697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:02.431732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:37131 (local address 127.0.0.1:51420)
0807 22:45:02.431771 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:02.431796 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.124:37131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260807 22:45:02.431928 26695 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.212.124:37131: Network error: Client connection negotiation failed: client connection to 127.22.212.124:37131: connect: Connection refused (error 111)
I20260807 22:45:02.437208 26702 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:45:02.439129 26702 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:45:02.439275 26702 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:45:02.443528 26702 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.124:37131
I20260807 22:45:02.443599 26809 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.124:37131 every 8 connection(s)
I20260807 22:45:02.443959 26702 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-2/data/info.pb
I20260807 22:45:02.444923 26810 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:45:02.446460 26810 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.212.126" port: 40483 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:45:02.449533 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 26702
I20260807 22:45:02.449637 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786142418640232-23377-0/minicluster-data/master-2/wal/instance
I20260807 22:45:02.449819 23377 external_mini_cluster.cc:1428] Setting key 9b23c0d8b0fca74e80ab0861caf34b39
I20260807 22:45:02.452476 26572 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37131 } attempt: 2
Aug 07 22:45:02 dist-test-slave-2d19 krb5kdc[26439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142702, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.124@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
Aug 07 22:45:02 dist-test-slave-2d19 krb5kdc[26439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142701, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.212.124@KRBTEST.COM
I20260807 22:45:02.456696 26578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:02.447173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33738 (local address 127.22.212.126:40483)
0807 22:45:02.447236 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:02.447239 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:02.447403 (+ 164us) server_negotiation.cc:407] Connection header received
0807 22:45:02.447833 (+ 430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:02.447834 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:02.447843 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:02.447905 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:02.448617 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.449103 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.450464 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.450793 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.450871 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:02.453498 (+ 2627us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:45:02.453499 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:45:02.453499 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:45:02.453507 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:45:02.455116 (+ 1609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:02.455626 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:02.455628 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:02.455628 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:02.455687 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:02.455991 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:02.455992 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:02.455993 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:02.456119 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:45:02.456195 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 22:45:02.456524 (+ 329us) server_negotiation.cc:299] Negotiation successful
0807 22:45:02.456605 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260807 22:45:02.456904 26814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:02.447114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:40483 (local address 127.0.0.1:33738)
0807 22:45:02.447276 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:02.447318 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 22:45:02.447755 (+ 437us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:45:02.447983 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:45:02.447986 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:45:02.448246 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:45:02.448505 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:45:02.448509 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.449188 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.449189 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:45:02.450354 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:45:02.450358 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.450876 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.450877 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:45:02.450977 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:02.451520 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:45:02.451529 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:45:02.453395 (+ 1866us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:45:02.455207 (+ 1812us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:45:02.455214 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:45:02.455217 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:45:02.455553 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:45:02.455768 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:45:02.455769 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:45:02.455769 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:45:02.455904 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:45:02.456201 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:45:02.456208 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:45:02.456382 (+ 174us) client_negotiation.cc:769] Sending connection context
0807 22:45:02.456499 (+ 117us) client_negotiation.cc:240] Negotiation successful
0807 22:45:02.456650 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":90,"threads_started":1}
Aug 07 22:45:02 dist-test-slave-2d19 krb5kdc[26439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142702, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for kudu/127.22.212.124@KRBTEST.COM
I20260807 22:45:02.457491 26810 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.212.125" port: 45913 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:45:02.461529 26577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:02.452738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:37131 (local address 127.0.0.1:51444)
0807 22:45:02.452784 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:02.452794 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 22:45:02.452829 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:45:02.453146 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:45:02.453147 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:45:02.453338 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:45:02.453370 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:45:02.453372 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.454241 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.454242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:45:02.454857 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:45:02.454859 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.455355 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.455356 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:45:02.455419 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:02.455831 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:45:02.455836 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:45:02.457641 (+ 1805us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:45:02.459973 (+ 2332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:45:02.459974 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:45:02.459975 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:45:02.460204 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:45:02.460465 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:45:02.460466 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:45:02.460467 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:45:02.460833 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:45:02.461180 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:45:02.461181 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:45:02.461233 (+ 52us) client_negotiation.cc:769] Sending connection context
0807 22:45:02.461304 (+ 71us) client_negotiation.cc:240] Negotiation successful
0807 22:45:02.461411 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
Aug 07 22:45:02 dist-test-slave-2d19 krb5kdc[26439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142702, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.124@KRBTEST.COM for kudu/127.22.212.125@KRBTEST.COM
I20260807 22:45:02.461858 26823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:02.452842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51444 (local address 127.22.212.124:37131)
0807 22:45:02.453001 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:02.453003 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:02.453019 (+ 16us) server_negotiation.cc:407] Connection header received
0807 22:45:02.453038 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:02.453039 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:02.453049 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:02.453121 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:02.453450 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.454148 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.454941 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.455278 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.455356 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:02.457733 (+ 2377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:45:02.457740 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:45:02.457741 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:45:02.457747 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:45:02.459870 (+ 2123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:02.460324 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:02.460328 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:02.460328 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:02.460388 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:02.460909 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:02.460910 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:02.460910 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:02.461100 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:45:02.461179 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 22:45:02.461665 (+ 486us) server_negotiation.cc:299] Negotiation successful
0807 22:45:02.461741 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":12,"server-negotiator.queue_time_us":138,"thread_start_us":113,"threads_started":1}
I20260807 22:45:02.461902 26819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:02.450222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51436 (local address 127.22.212.124:37131)
0807 22:45:02.450374 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:02.450379 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:02.450498 (+ 119us) server_negotiation.cc:407] Connection header received
0807 22:45:02.450542 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:02.450543 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:02.450562 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:02.450614 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:02.451348 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.452205 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.453289 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.453695 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.453780 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:02.457795 (+ 4015us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:45:02.457797 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:45:02.457797 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:45:02.457804 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:45:02.460460 (+ 2656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:02.460781 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:02.460782 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:02.460782 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:02.460903 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:02.461107 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:02.461108 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:02.461108 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:02.461214 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:45:02.461336 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 22:45:02.461416 (+ 80us) server_negotiation.cc:299] Negotiation successful
0807 22:45:02.461522 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":81,"threads_started":1}
I20260807 22:45:02.463910 26572 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d4913bffc7e43469d3b74a444db264e: Bootstrap starting.
I20260807 22:45:02.464767 26572 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9d4913bffc7e43469d3b74a444db264e: Neither blocks nor log segments found. Creating new log.
I20260807 22:45:02.465003 26814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:02.457740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.125:45913 (local address 127.0.0.1:56846)
0807 22:45:02.458040 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:02.458050 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 22:45:02.458095 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:45:02.458214 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:45:02.458214 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:45:02.458371 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:45:02.458426 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:45:02.458428 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.459206 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.459207 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:45:02.459842 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:45:02.459844 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.460283 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.460284 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:45:02.460348 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:02.460778 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:45:02.460784 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:45:02.462285 (+ 1501us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:45:02.463890 (+ 1605us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:45:02.463891 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:45:02.463891 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:45:02.464112 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:45:02.464343 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:45:02.464344 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:45:02.464345 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:45:02.464400 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:45:02.464684 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:45:02.464685 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:45:02.464734 (+ 49us) client_negotiation.cc:769] Sending connection context
0807 22:45:02.464812 (+ 78us) client_negotiation.cc:240] Negotiation successful
0807 22:45:02.464906 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285}
I20260807 22:45:02.465098 26572 log.cc:824] T 00000000000000000000000000000000 P 9d4913bffc7e43469d3b74a444db264e: Log is configured to *not* fsync() on all Append() calls
I20260807 22:45:02.465124 26699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:02.457845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56846 (local address 127.22.212.125:45913)
0807 22:45:02.457894 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:02.457897 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:02.458086 (+ 189us) server_negotiation.cc:407] Connection header received
0807 22:45:02.458157 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:02.458158 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:02.458167 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:02.458209 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:02.458498 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.459106 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.459981 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.460186 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.460298 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:02.462359 (+ 2061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:45:02.462361 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:45:02.462361 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:45:02.462370 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:45:02.463774 (+ 1404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:02.464206 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:02.464207 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:02.464207 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:02.464293 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:02.464473 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:02.464474 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:02.464475 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:02.464620 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:45:02.464693 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 22:45:02.464918 (+ 225us) server_negotiation.cc:299] Negotiation successful
0807 22:45:02.465004 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 22:45:02.465663 26810 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37131 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:45:02.466215 26572 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d4913bffc7e43469d3b74a444db264e: No bootstrap required, opened a new log
I20260807 22:45:02.467970 26572 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9d4913bffc7e43469d3b74a444db264e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4913bffc7e43469d3b74a444db264e" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 40483 } } peers { permanent_uuid: "ff0c003746fc41608f07fd3ae8335910" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 45913 } } peers { permanent_uuid: "340cb05ea90d4432b41115f665fee098" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37131 } }
I20260807 22:45:02.468156 26572 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9d4913bffc7e43469d3b74a444db264e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d4913bffc7e43469d3b74a444db264e, State: Initialized, Role: FOLLOWER
I20260807 22:45:02.468251 26572 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9d4913bffc7e43469d3b74a444db264e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4913bffc7e43469d3b74a444db264e" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 40483 } } peers { permanent_uuid: "ff0c003746fc41608f07fd3ae8335910" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 45913 } } peers { permanent_uuid: "340cb05ea90d4432b41115f665fee098" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37131 } }
I20260807 22:45:02.468570 26826 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d4913bffc7e43469d3b74a444db264e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4913bffc7e43469d3b74a444db264e" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 40483 } } peers { permanent_uuid: "ff0c003746fc41608f07fd3ae8335910" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 45913 } } peers { permanent_uuid: "340cb05ea90d4432b41115f665fee098" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37131 } } }
I20260807 22:45:02.468647 26572 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9d4913bffc7e43469d3b74a444db264e [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:45:02.468741 26826 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d4913bffc7e43469d3b74a444db264e [sys.catalog]: This master's current role is: FOLLOWER
Aug 07 22:45:02 dist-test-slave-2d19 krb5kdc[26439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142701, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
Aug 07 22:45:02 dist-test-slave-2d19 krb5kdc[26439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142702, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.124@KRBTEST.COM for kudu/127.22.212.124@KRBTEST.COM
W20260807 22:45:02.470602 26840 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9d4913bffc7e43469d3b74a444db264e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:45:02.470701 26840 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:45:02.474038 26814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:02.465913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:37131 (local address 127.0.0.1:51450)
0807 22:45:02.465962 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:02.465973 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 22:45:02.466012 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:45:02.466141 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:45:02.466142 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:45:02.466283 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:45:02.466321 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:45:02.466323 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.467204 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.467205 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:45:02.467942 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:45:02.467945 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.468510 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.468510 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:45:02.468569 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:02.468989 (+ 420us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:45:02.468995 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:45:02.470418 (+ 1423us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:45:02.472992 (+ 2574us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:45:02.472993 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:45:02.472993 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:45:02.473195 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:45:02.473383 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:45:02.473384 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:45:02.473384 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:45:02.473434 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:45:02.473764 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:45:02.473764 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:45:02.473799 (+ 35us) client_negotiation.cc:769] Sending connection context
0807 22:45:02.473857 (+ 58us) client_negotiation.cc:240] Negotiation successful
0807 22:45:02.473943 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260807 22:45:02.474236 26578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:02.464534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33746 (local address 127.22.212.126:40483)
0807 22:45:02.464576 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:02.464578 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:02.464586 (+ 8us) server_negotiation.cc:407] Connection header received
0807 22:45:02.464639 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:02.464639 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:02.464649 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:02.464700 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:02.465376 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.466051 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.467089 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.467334 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.467365 (+ 31us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:02.470949 (+ 3584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:45:02.470950 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:45:02.470950 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:45:02.470957 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:45:02.472784 (+ 1827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:02.473263 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:02.473265 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:02.473265 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:02.473329 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:02.473575 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:02.473576 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:02.473576 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:02.473700 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:45:02.473846 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0807 22:45:02.474066 (+ 220us) server_negotiation.cc:299] Negotiation successful
0807 22:45:02.474153 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260807 22:45:02.474720 26823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:02.465975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51450 (local address 127.22.212.124:37131)
0807 22:45:02.466006 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:02.466008 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:02.466015 (+ 7us) server_negotiation.cc:407] Connection header received
0807 22:45:02.466063 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:02.466064 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:02.466073 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:02.466136 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:02.466390 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.467121 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.468035 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.468411 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.469475 (+ 1064us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:02.470517 (+ 1042us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:45:02.470519 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:45:02.470519 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:45:02.470525 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:45:02.472902 (+ 2377us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:02.473271 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:02.473272 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:02.473273 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:02.473324 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:02.473491 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:02.473492 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:02.473492 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:02.473676 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:45:02.473742 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 22:45:02.474550 (+ 808us) server_negotiation.cc:299] Negotiation successful
0807 22:45:02.474632 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260807 22:45:02.472155 26461 master_runner.cc:186] Error getting master registration for 127.22.212.125:45913: OK, instance_id { permanent_uuid: "ff0c003746fc41608f07fd3ae8335910" instance_seqno: 1786142702284589 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 22:45:02.475768 26461 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 22:45:02.476159 26810 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 340cb05ea90d4432b41115f665fee098: Bootstrap starting.
I20260807 22:45:02.476877 26810 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 340cb05ea90d4432b41115f665fee098: Neither blocks nor log segments found. Creating new log.
I20260807 22:45:02.477174 26810 log.cc:824] T 00000000000000000000000000000000 P 340cb05ea90d4432b41115f665fee098: Log is configured to *not* fsync() on all Append() calls
I20260807 22:45:02.478027 26810 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 340cb05ea90d4432b41115f665fee098: No bootstrap required, opened a new log
I20260807 22:45:02.480031 26810 raft_consensus.cc:348] T 00000000000000000000000000000000 P 340cb05ea90d4432b41115f665fee098 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4913bffc7e43469d3b74a444db264e" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 40483 } } peers { permanent_uuid: "ff0c003746fc41608f07fd3ae8335910" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 45913 } } peers { permanent_uuid: "340cb05ea90d4432b41115f665fee098" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37131 } }
I20260807 22:45:02.480190 26810 raft_consensus.cc:729] T 00000000000000000000000000000000 P 340cb05ea90d4432b41115f665fee098 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 340cb05ea90d4432b41115f665fee098, State: Initialized, Role: FOLLOWER
I20260807 22:45:02.480305 26810 consensus_queue.cc:260] T 00000000000000000000000000000000 P 340cb05ea90d4432b41115f665fee098 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4913bffc7e43469d3b74a444db264e" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 40483 } } peers { permanent_uuid: "ff0c003746fc41608f07fd3ae8335910" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 45913 } } peers { permanent_uuid: "340cb05ea90d4432b41115f665fee098" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37131 } }
I20260807 22:45:02.480655 26810 sys_catalog.cc:564] T 00000000000000000000000000000000 P 340cb05ea90d4432b41115f665fee098 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:45:02.480602 26848 sys_catalog.cc:455] T 00000000000000000000000000000000 P 340cb05ea90d4432b41115f665fee098 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4913bffc7e43469d3b74a444db264e" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 40483 } } peers { permanent_uuid: "ff0c003746fc41608f07fd3ae8335910" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 45913 } } peers { permanent_uuid: "340cb05ea90d4432b41115f665fee098" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37131 } } }
I20260807 22:45:02.481019 26848 sys_catalog.cc:458] T 00000000000000000000000000000000 P 340cb05ea90d4432b41115f665fee098 [sys.catalog]: This master's current role is: FOLLOWER
Aug 07 22:45:02 dist-test-slave-2d19 krb5kdc[26439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142701, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.212.125@KRBTEST.COM
W20260807 22:45:02.483064 26865 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 340cb05ea90d4432b41115f665fee098: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:45:02.483166 26865 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:45:02.485872 26699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:02.476592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56848 (local address 127.22.212.125:45913)
0807 22:45:02.476637 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:02.476639 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:02.477514 (+ 875us) server_negotiation.cc:407] Connection header received
0807 22:45:02.477622 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:02.477623 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:02.477634 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:02.477666 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:02.478216 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.478685 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.479357 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.479561 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.479641 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:02.482424 (+ 2783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:45:02.482425 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:45:02.482426 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:45:02.482433 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:45:02.484240 (+ 1807us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:02.484693 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:02.484694 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:02.484694 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:02.484753 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:02.484939 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:02.484940 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:02.484940 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:02.485066 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:45:02.485244 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0807 22:45:02.485696 (+ 452us) server_negotiation.cc:299] Negotiation successful
0807 22:45:02.485775 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 22:45:02.484232 26702 master_runner.cc:186] Error getting master registration for 127.22.212.125:45913: OK, instance_id { permanent_uuid: "ff0c003746fc41608f07fd3ae8335910" instance_seqno: 1786142702284589 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 22:45:02.486526 26702 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 22:45:02.488142 23377 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:45:02.489326 26529 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "9d4913bffc7e43469d3b74a444db264e"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33746
I20260807 22:45:02.489509 26529 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9d4913bffc7e43469d3b74a444db264e [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 22:45:02.489571 26529 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9d4913bffc7e43469d3b74a444db264e [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:45:02.490614 26529 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9d4913bffc7e43469d3b74a444db264e [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4913bffc7e43469d3b74a444db264e" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 40483 } } peers { permanent_uuid: "ff0c003746fc41608f07fd3ae8335910" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 45913 } } peers { permanent_uuid: "340cb05ea90d4432b41115f665fee098" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37131 } }
I20260807 22:45:02.490899 26529 leader_election.cc:288] T 00000000000000000000000000000000 P 9d4913bffc7e43469d3b74a444db264e [CANDIDATE]: Term 1 election: Requested vote from peers ff0c003746fc41608f07fd3ae8335910 (127.22.212.125:45913), 340cb05ea90d4432b41115f665fee098 (127.22.212.124:37131)
I20260807 22:45:02.491310 26777 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9d4913bffc7e43469d3b74a444db264e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "340cb05ea90d4432b41115f665fee098"
I20260807 22:45:02.491477 26777 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 340cb05ea90d4432b41115f665fee098 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:45:02.492969 26777 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 340cb05ea90d4432b41115f665fee098 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d4913bffc7e43469d3b74a444db264e in term 1.
I20260807 22:45:02.493178 26482 leader_election.cc:302] T 00000000000000000000000000000000 P 9d4913bffc7e43469d3b74a444db264e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 340cb05ea90d4432b41115f665fee098, 9d4913bffc7e43469d3b74a444db264e; no voters:
I20260807 22:45:02.493323 26826 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9d4913bffc7e43469d3b74a444db264e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:45:02.493485 26826 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9d4913bffc7e43469d3b74a444db264e [term 1 LEADER]: Becoming Leader. State: Replica: 9d4913bffc7e43469d3b74a444db264e, State: Running, Role: LEADER
I20260807 22:45:02.493587 26826 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9d4913bffc7e43469d3b74a444db264e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4913bffc7e43469d3b74a444db264e" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 40483 } } peers { permanent_uuid: "ff0c003746fc41608f07fd3ae8335910" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 45913 } } peers { permanent_uuid: "340cb05ea90d4432b41115f665fee098" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37131 } }
I20260807 22:45:02.494091 26882 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d4913bffc7e43469d3b74a444db264e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d4913bffc7e43469d3b74a444db264e. Latest consensus state: current_term: 1 leader_uuid: "9d4913bffc7e43469d3b74a444db264e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4913bffc7e43469d3b74a444db264e" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 40483 } } peers { permanent_uuid: "ff0c003746fc41608f07fd3ae8335910" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 45913 } } peers { permanent_uuid: "340cb05ea90d4432b41115f665fee098" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37131 } } }
I20260807 22:45:02.494267 26882 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d4913bffc7e43469d3b74a444db264e [sys.catalog]: This master's current role is: LEADER
I20260807 22:45:02.504388 26884 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:45:02.505040 26884 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:45:02.507436 26823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:02.492625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51460 (local address 127.22.212.124:37131)
0807 22:45:02.492666 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:02.492668 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:02.496656 (+ 3988us) server_negotiation.cc:407] Connection header received
0807 22:45:02.496751 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:02.496752 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:02.496763 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:02.496792 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:02.497604 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.498379 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.499482 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.499782 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.499823 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:02.502065 (+ 2242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:45:02.502066 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:45:02.502067 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:45:02.502075 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:45:02.503772 (+ 1697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:02.505374 (+ 1602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:02.505375 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:02.505376 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:02.505456 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:02.506467 (+ 1011us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:02.506469 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:02.506469 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:02.506619 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:45:02.506716 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 22:45:02.507246 (+ 530us) server_negotiation.cc:299] Negotiation successful
0807 22:45:02.507327 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 22:45:02.508935 26699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:02.492971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56858 (local address 127.22.212.125:45913)
0807 22:45:02.493013 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:02.493014 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:02.500230 (+ 7216us) server_negotiation.cc:407] Connection header received
0807 22:45:02.500363 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:02.500364 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:02.500386 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:02.500417 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:02.501173 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.501900 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.502888 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.503180 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.503219 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:02.504986 (+ 1767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:45:02.504987 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:45:02.504987 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:45:02.504995 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:45:02.506697 (+ 1702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:02.507312 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:02.507313 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:02.507314 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:02.507384 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:02.508206 (+ 822us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:02.508207 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:02.508207 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:02.508384 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:45:02.508475 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 22:45:02.508741 (+ 266us) server_negotiation.cc:299] Negotiation successful
0807 22:45:02.508830 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 22:45:02.511713 26777 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 340cb05ea90d4432b41115f665fee098 [term 1 FOLLOWER]: Refusing update from remote peer 9d4913bffc7e43469d3b74a444db264e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:45:02.512151 26826 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9d4913bffc7e43469d3b74a444db264e [LEADER]: Connected to new peer: Peer: permanent_uuid: "340cb05ea90d4432b41115f665fee098" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:45:02.513672 26848 sys_catalog.cc:455] T 00000000000000000000000000000000 P 340cb05ea90d4432b41115f665fee098 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d4913bffc7e43469d3b74a444db264e. Latest consensus state: current_term: 1 leader_uuid: "9d4913bffc7e43469d3b74a444db264e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4913bffc7e43469d3b74a444db264e" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 40483 } } peers { permanent_uuid: "ff0c003746fc41608f07fd3ae8335910" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 45913 } } peers { permanent_uuid: "340cb05ea90d4432b41115f665fee098" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37131 } } }
I20260807 22:45:02.513774 26848 sys_catalog.cc:458] T 00000000000000000000000000000000 P 340cb05ea90d4432b41115f665fee098 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:45:02.515209 26578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:02.492206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33758 (local address 127.22.212.126:40483)
0807 22:45:02.492277 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:02.492279 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:02.496495 (+ 4216us) server_negotiation.cc:407] Connection header received
0807 22:45:02.496565 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:02.496578 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:02.496591 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:02.496656 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:02.497896 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.498638 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.504230 (+ 5592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.504532 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.504579 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:02.510624 (+ 6045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:45:02.510625 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:45:02.510626 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:45:02.510635 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:45:02.512378 (+ 1743us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:02.514327 (+ 1949us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:02.514328 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:02.514329 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:02.514391 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:02.514615 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:02.514616 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:02.514616 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:02.514750 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:45:02.514858 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 22:45:02.515023 (+ 165us) server_negotiation.cc:299] Negotiation successful
0807 22:45:02.515108 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 22:45:02.523064 26695 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37131 } attempt: 3
I20260807 22:45:02.525750 26826 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d4913bffc7e43469d3b74a444db264e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9d4913bffc7e43469d3b74a444db264e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4913bffc7e43469d3b74a444db264e" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 40483 } } peers { permanent_uuid: "ff0c003746fc41608f07fd3ae8335910" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 45913 } } peers { permanent_uuid: "340cb05ea90d4432b41115f665fee098" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37131 } } }
I20260807 22:45:02.525868 26826 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d4913bffc7e43469d3b74a444db264e [sys.catalog]: This master's current role is: LEADER
I20260807 22:45:02.527052 26848 sys_catalog.cc:455] T 00000000000000000000000000000000 P 340cb05ea90d4432b41115f665fee098 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9d4913bffc7e43469d3b74a444db264e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4913bffc7e43469d3b74a444db264e" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 40483 } } peers { permanent_uuid: "ff0c003746fc41608f07fd3ae8335910" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 45913 } } peers { permanent_uuid: "340cb05ea90d4432b41115f665fee098" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37131 } } }
I20260807 22:45:02.527140 26848 sys_catalog.cc:458] T 00000000000000000000000000000000 P 340cb05ea90d4432b41115f665fee098 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:45:02.527562 26885 mvcc.cc:205] Tried to move back new op lower bound from 7316040509483843584 to 7316040509414514688. Current Snapshot: MvccSnapshot[applied={T|T < 7316040509483843584}]
I20260807 22:45:02.527779 26886 mvcc.cc:205] Tried to move back new op lower bound from 7316040509483843584 to 7316040509414514688. Current Snapshot: MvccSnapshot[applied={T|T < 7316040509483843584}]
Aug 07 22:45:02 dist-test-slave-2d19 krb5kdc[26439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142702, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.125@KRBTEST.COM for kudu/127.22.212.124@KRBTEST.COM
I20260807 22:45:02.532173 26697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:02.523377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:37131 (local address 127.0.0.1:51468)
0807 22:45:02.523442 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:02.523453 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 22:45:02.523493 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:45:02.523791 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:45:02.523792 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:45:02.523986 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:45:02.524039 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:45:02.524041 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.524955 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.524957 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:45:02.525783 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:45:02.525786 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.526658 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.526659 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:45:02.526721 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:02.527271 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:45:02.527277 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:45:02.528869 (+ 1592us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:45:02.530982 (+ 2113us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:45:02.530983 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:45:02.530984 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:45:02.531218 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:45:02.531464 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:45:02.531465 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:45:02.531465 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:45:02.531535 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:45:02.531839 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:45:02.531840 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:45:02.531913 (+ 73us) client_negotiation.cc:769] Sending connection context
0807 22:45:02.531976 (+ 63us) client_negotiation.cc:240] Negotiation successful
0807 22:45:02.532076 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260807 22:45:02.532568 26823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:02.523601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51468 (local address 127.22.212.124:37131)
0807 22:45:02.523671 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:02.523673 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:02.523681 (+ 8us) server_negotiation.cc:407] Connection header received
0807 22:45:02.523704 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:02.523705 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:02.523715 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:02.523776 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:02.524133 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.524871 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.526222 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:02.526535 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:02.526599 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:02.528967 (+ 2368us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:45:02.528968 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:45:02.528969 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:45:02.528976 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:45:02.530824 (+ 1848us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:02.531309 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:02.531311 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:02.531311 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:02.531377 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:02.531608 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:02.531609 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:02.531609 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:02.531747 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:45:02.531802 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 22:45:02.532413 (+ 611us) server_negotiation.cc:299] Negotiation successful
0807 22:45:02.532489 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260807 22:45:02.532716 26884 catalog_manager.cc:1347] Generated new cluster ID: f6e38901bc1c440cba40b77ae30251d9
I20260807 22:45:02.532759 26884 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:45:02.534190 26695 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff0c003746fc41608f07fd3ae8335910: Bootstrap starting.
I20260807 22:45:02.534870 26695 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ff0c003746fc41608f07fd3ae8335910: Neither blocks nor log segments found. Creating new log.
I20260807 22:45:02.535145 26695 log.cc:824] T 00000000000000000000000000000000 P ff0c003746fc41608f07fd3ae8335910: Log is configured to *not* fsync() on all Append() calls
I20260807 22:45:02.536007 26695 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff0c003746fc41608f07fd3ae8335910: No bootstrap required, opened a new log
I20260807 22:45:02.537889 26695 raft_consensus.cc:348] T 00000000000000000000000000000000 P ff0c003746fc41608f07fd3ae8335910 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4913bffc7e43469d3b74a444db264e" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 40483 } } peers { permanent_uuid: "ff0c003746fc41608f07fd3ae8335910" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 45913 } } peers { permanent_uuid: "340cb05ea90d4432b41115f665fee098" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37131 } }
I20260807 22:45:02.538019 26695 raft_consensus.cc:729] T 00000000000000000000000000000000 P ff0c003746fc41608f07fd3ae8335910 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff0c003746fc41608f07fd3ae8335910, State: Initialized, Role: FOLLOWER
I20260807 22:45:02.538090 26695 consensus_queue.cc:260] T 00000000000000000000000000000000 P ff0c003746fc41608f07fd3ae8335910 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4913bffc7e43469d3b74a444db264e" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 40483 } } peers { permanent_uuid: "ff0c003746fc41608f07fd3ae8335910" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 45913 } } peers { permanent_uuid: "340cb05ea90d4432b41115f665fee098" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37131 } }
I20260807 22:45:02.538378 26695 sys_catalog.cc:564] T 00000000000000000000000000000000 P ff0c003746fc41608f07fd3ae8335910 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:45:02.538483 26651 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ff0c003746fc41608f07fd3ae8335910 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:45:02.539381 26651 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ff0c003746fc41608f07fd3ae8335910 [term 1 FOLLOWER]: Refusing update from remote peer 9d4913bffc7e43469d3b74a444db264e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:45:02.539577 26652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9d4913bffc7e43469d3b74a444db264e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "ff0c003746fc41608f07fd3ae8335910"
I20260807 22:45:02.541710 26652 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ff0c003746fc41608f07fd3ae8335910 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d4913bffc7e43469d3b74a444db264e in term 1.
I20260807 22:45:02.543802 26891 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9d4913bffc7e43469d3b74a444db264e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff0c003746fc41608f07fd3ae8335910" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 45913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:45:02.544018 26901 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff0c003746fc41608f07fd3ae8335910 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4913bffc7e43469d3b74a444db264e" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 40483 } } peers { permanent_uuid: "ff0c003746fc41608f07fd3ae8335910" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 45913 } } peers { permanent_uuid: "340cb05ea90d4432b41115f665fee098" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37131 } } }
I20260807 22:45:02.544152 26901 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff0c003746fc41608f07fd3ae8335910 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:45:02.546950 26901 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff0c003746fc41608f07fd3ae8335910 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d4913bffc7e43469d3b74a444db264e. Latest consensus state: current_term: 1 leader_uuid: "9d4913bffc7e43469d3b74a444db264e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4913bffc7e43469d3b74a444db264e" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 40483 } } peers { permanent_uuid: "ff0c003746fc41608f07fd3ae8335910" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 45913 } } peers { permanent_uuid: "340cb05ea90d4432b41115f665fee098" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37131 } } }
I20260807 22:45:02.547093 26901 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff0c003746fc41608f07fd3ae8335910 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:45:02.547190 26901 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff0c003746fc41608f07fd3ae8335910 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9d4913bffc7e43469d3b74a444db264e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4913bffc7e43469d3b74a444db264e" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 40483 } } peers { permanent_uuid: "ff0c003746fc41608f07fd3ae8335910" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 45913 } } peers { permanent_uuid: "340cb05ea90d4432b41115f665fee098" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37131 } } }
I20260807 22:45:02.547282 26901 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff0c003746fc41608f07fd3ae8335910 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:45:02.548085 26882 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d4913bffc7e43469d3b74a444db264e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9d4913bffc7e43469d3b74a444db264e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d4913bffc7e43469d3b74a444db264e" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 40483 } } peers { permanent_uuid: "ff0c003746fc41608f07fd3ae8335910" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 45913 } } peers { permanent_uuid: "340cb05ea90d4432b41115f665fee098" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 37131 } } }
I20260807 22:45:02.548187 26882 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d4913bffc7e43469d3b74a444db264e [sys.catalog]: This master's current role is: LEADER
I20260807 22:45:02.548539 26923 mvcc.cc:205] Tried to move back new op lower bound from 7316040509483843584 to 7316040509414514688. Current Snapshot: MvccSnapshot[applied={T|T < 7316040509483843584}]
I20260807 22:45:02.549149 26884 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:45:02.549854 26884 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:45:02.552976 26922 catalog_manager.cc:1259] Loaded cluster ID: f6e38901bc1c440cba40b77ae30251d9
I20260807 22:45:02.553069 26922 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ff0c003746fc41608f07fd3ae8335910: loading cluster ID for follower catalog manager: success
I20260807 22:45:02.554332 26922 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ff0c003746fc41608f07fd3ae8335910: acquiring CA information for follower catalog manager: success
W20260807 22:45:02.554529 26922 catalog_manager.cc:873] Not found: no TSK found in the system table: failed to prepare follower catalog manager, will retry
I20260807 22:45:02.571579 26884 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9d4913bffc7e43469d3b74a444db264e: Generated new TSK 0
I20260807 22:45:02.571803 26884 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 22:45:02.601795 26823 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:45:02.599802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51476 (local address 127.22.212.124:37131)
0807 22:45:02.599846 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:02.599848 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:02.600692 (+ 844us) server_negotiation.cc:407] Connection header received
0807 22:45:02.601055 (+ 363us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:02.601056 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:02.601068 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:02.601101 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:02.601723 (+ 622us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51476: BlockingRecv error: recv got EOF from 127.0.0.1:51476 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260807 22:45:02.602361 26699 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:45:02.599554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56864 (local address 127.22.212.125:45913)
0807 22:45:02.599603 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:02.599606 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:02.600794 (+ 1188us) server_negotiation.cc:407] Connection header received
0807 22:45:02.601177 (+ 383us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:02.601178 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:02.601190 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:02.601221 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:02.602295 (+ 1074us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56864: BlockingRecv error: recv got EOF from 127.0.0.1:56864 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260807 22:45:02.603061 26578 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:45:02.600033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33764 (local address 127.22.212.126:40483)
0807 22:45:02.600075 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:02.600077 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:02.600943 (+ 866us) server_negotiation.cc:407] Connection header received
0807 22:45:02.602601 (+ 1658us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:02.602602 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:02.602613 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:02.602644 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:02.602996 (+ 352us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33764: BlockingRecv error: recv got EOF from 127.0.0.1:33764 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260807 22:45:02.605829 26699 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:45:02.604948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56870 (local address 127.22.212.125:45913)
0807 22:45:02.604984 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:02.604986 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:02.605279 (+ 293us) server_negotiation.cc:407] Connection header received
0807 22:45:02.605403 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:02.605404 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:02.605425 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:02.605466 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:02.605782 (+ 316us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56870: BlockingRecv error: recv got EOF from 127.0.0.1:56870 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260807 22:45:02.608983 26699 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:45:02.608121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56876 (local address 127.22.212.125:45913)
0807 22:45:02.608157 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:02.608158 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:02.608481 (+ 323us) server_negotiation.cc:407] Connection header received
0807 22:45:02.608577 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:02.608578 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:02.608588 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:02.608617 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:02.608936 (+ 319us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56876: BlockingRecv error: recv got EOF from 127.0.0.1:56876 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260807 22:45:02.613008 26699 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:45:02.612183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56888 (local address 127.22.212.125:45913)
0807 22:45:02.612219 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:02.612221 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:02.612492 (+ 271us) server_negotiation.cc:407] Connection header received
0807 22:45:02.612593 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:02.612593 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:02.612604 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:02.612633 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:02.612958 (+ 325us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56888: BlockingRecv error: recv got EOF from 127.0.0.1:56888 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260807 22:45:02.619091 26699 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:45:02.618239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56900 (local address 127.22.212.125:45913)
0807 22:45:02.618277 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:02.618279 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:02.618535 (+ 256us) server_negotiation.cc:407] Connection header received
0807 22:45:02.618640 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:02.618641 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:02.618653 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:02.618683 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:02.619040 (+ 357us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56900: BlockingRecv error: recv got EOF from 127.0.0.1:56900 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260807 22:45:02.629525 26699 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:45:02.628570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56904 (local address 127.22.212.125:45913)
0807 22:45:02.628618 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:02.628620 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:02.628889 (+ 269us) server_negotiation.cc:407] Connection header received
0807 22:45:02.628997 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:02.628998 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:02.629011 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:02.629043 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:02.629450 (+ 407us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56904: BlockingRecv error: recv got EOF from 127.0.0.1:56904 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260807 22:45:02.647948 26699 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:45:02.646986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56920 (local address 127.22.212.125:45913)
0807 22:45:02.647036 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:02.647038 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:02.647302 (+ 264us) server_negotiation.cc:407] Connection header received
0807 22:45:02.647424 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:02.647425 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:02.647437 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:02.647469 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:02.647884 (+ 415us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56920: BlockingRecv error: recv got EOF from 127.0.0.1:56920 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260807 22:45:02.682392 26699 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:45:02.681554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56924 (local address 127.22.212.125:45913)
0807 22:45:02.681605 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:02.681608 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:02.681766 (+ 158us) server_negotiation.cc:407] Connection header received
0807 22:45:02.681845 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:02.681846 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:02.681859 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:02.681922 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:02.682326 (+ 404us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56924: BlockingRecv error: recv got EOF from 127.0.0.1:56924 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260807 22:45:02.748606 26699 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:45:02.747766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56928 (local address 127.22.212.125:45913)
0807 22:45:02.747852 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:02.747855 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:02.748006 (+ 151us) server_negotiation.cc:407] Connection header received
0807 22:45:02.748040 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:02.748041 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:02.748053 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:02.748111 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:02.748539 (+ 428us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56928: BlockingRecv error: recv got EOF from 127.0.0.1:56928 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260807 22:45:02.878674 26699 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:45:02.877996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56944 (local address 127.22.212.125:45913)
0807 22:45:02.878102 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:02.878104 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:02.878153 (+ 49us) server_negotiation.cc:407] Connection header received
0807 22:45:02.878223 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:02.878224 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:02.878235 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:02.878281 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:02.878595 (+ 314us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56944: BlockingRecv error: recv got EOF from 127.0.0.1:56944 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260807 22:45:03.136773 26699 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:45:03.136021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56948 (local address 127.22.212.125:45913)
0807 22:45:03.136119 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:03.136121 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:03.136132 (+ 11us) server_negotiation.cc:407] Connection header received
0807 22:45:03.136236 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:03.136238 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:03.136272 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:03.136347 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:03.136705 (+ 358us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56948: BlockingRecv error: recv got EOF from 127.0.0.1:56948 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 22:45:03.483645 26865 catalog_manager.cc:1259] Loaded cluster ID: f6e38901bc1c440cba40b77ae30251d9
I20260807 22:45:03.483714 26865 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 340cb05ea90d4432b41115f665fee098: loading cluster ID for follower catalog manager: success
I20260807 22:45:03.484581 26865 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 340cb05ea90d4432b41115f665fee098: acquiring CA information for follower catalog manager: success
I20260807 22:45:03.484908 26865 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 340cb05ea90d4432b41115f665fee098: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 22:45:03.555262 26922 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ff0c003746fc41608f07fd3ae8335910: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 22:45:03.652810 27035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:03.649931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56960 (local address 127.22.212.125:45913)
0807 22:45:03.650069 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:03.650071 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:03.650152 (+ 81us) server_negotiation.cc:407] Connection header received
0807 22:45:03.650254 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:03.650255 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:03.650326 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:03.650418 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:45:03.650591 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:03.651110 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:03.651901 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:03.652112 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:03.652186 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:03.652435 (+ 249us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:45:03.652559 (+ 124us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:45:03.652660 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 22:45:03.652684 (+ 24us) server_negotiation.cc:299] Negotiation successful
0807 22:45:03.652707 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":62,"threads_started":1}
I20260807 22:45:03.657061 27043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:03.654707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51490 (local address 127.22.212.124:37131)
0807 22:45:03.654842 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:03.654843 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:03.654851 (+ 8us) server_negotiation.cc:407] Connection header received
0807 22:45:03.654889 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:03.654890 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:03.654924 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:03.654990 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:45:03.655081 (+ 91us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:03.655545 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:03.656247 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:03.656518 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:03.656586 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:03.656729 (+ 143us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:45:03.656830 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:45:03.656895 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0807 22:45:03.656926 (+ 31us) server_negotiation.cc:299] Negotiation successful
0807 22:45:03.656943 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":72,"threads_started":1}
I20260807 22:45:03.661671 27035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:03.658930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56976 (local address 127.22.212.125:45913)
0807 22:45:03.658971 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:03.658973 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:03.658982 (+ 9us) server_negotiation.cc:407] Connection header received
0807 22:45:03.659009 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:03.659010 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:03.659022 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:03.659078 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:45:03.659286 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:03.660033 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:03.660895 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:03.661165 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:03.661229 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:03.661393 (+ 164us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:45:03.661433 (+ 40us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:45:03.661479 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0807 22:45:03.661561 (+ 82us) server_negotiation.cc:299] Negotiation successful
0807 22:45:03.661587 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 22:45:03.662153 27043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:03.659092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51506 (local address 127.22.212.124:37131)
0807 22:45:03.659155 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:03.659157 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:03.659429 (+ 272us) server_negotiation.cc:407] Connection header received
0807 22:45:03.659452 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:03.659453 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:03.659463 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:03.659512 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:45:03.659666 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:03.660356 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:03.661286 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:03.661562 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:03.661626 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:03.661778 (+ 152us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:45:03.661813 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:45:03.661867 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 22:45:03.661961 (+ 94us) server_negotiation.cc:299] Negotiation successful
0807 22:45:03.661985 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 22:45:03.662464 27056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:03.658779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33776 (local address 127.22.212.126:40483)
0807 22:45:03.659034 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:03.659036 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:03.659044 (+ 8us) server_negotiation.cc:407] Connection header received
0807 22:45:03.659092 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:03.659092 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:03.659147 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:03.659226 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:45:03.659360 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:03.659985 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:03.661071 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:03.661377 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:03.661443 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:03.661956 (+ 513us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:45:03.662141 (+ 185us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:45:03.662187 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0807 22:45:03.662346 (+ 159us) server_negotiation.cc:299] Negotiation successful
0807 22:45:03.662375 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":234,"thread_start_us":65,"threads_started":1}
I20260807 22:45:03.664381 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 26461
I20260807 22:45:03.687867 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 26584
I20260807 22:45:03.703081 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 26702
2026-08-07T22:45:03Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3112 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 22:45:03 dist-test-slave-2d19 krb5kdc[27061](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 22:45:03 dist-test-slave-2d19 krb5kdc[27061](info): set up 2 sockets
Aug 07 22:45:03 dist-test-slave-2d19 krb5kdc[27061](info): commencing operation
krb5kdc: starting...
W20260807 22:45:04.971083 23377 mini_kdc.cc:121] Time spent starting KDC: real 1.243s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/krb5kdc/test-user.keytab.
Aug 07 22:45:05 dist-test-slave-2d19 krb5kdc[27061](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142705, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T22:45:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T22:45:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.212.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
Entry for principal kudu/127.22.212.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab.
I20260807 22:45:05.104310 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:36871
--webserver_interface=127.22.212.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:45243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:36871,127.22.212.125:38437,127.22.212.124:40285
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 22:45:05.190970 27081 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 22:45:05.191236 27081 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:45:05.191277 27081 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:45:05.191316 27081 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:45:05.192530 27081 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:45:05.192598 27081 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:45:05.192620 27081 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:45:05.192641 27081 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:45:05.192670 27081 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:45:05.194206 27081 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:45243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:36871,127.22.212.125:38437,127.22.212.124:40285
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.126.keytab
--principal=kudu/127.22.212.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.126:36871
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.212.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27081
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:45:05.194520 27081 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:45:05.194775 27081 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:45:05.199908 27091 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:45:05.199895 27094 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:45:05.200125 27081 server_base.cc:1034] running on GCE node
W20260807 22:45:05.199892 27092 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:45:05.200538 27081 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:45:05.200843 27081 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:45:05.202031 27081 hybrid_clock.cc:648] HybridClock initialized: now 1786142705202007 us; error 30 us; skew 500 ppm
Aug 07 22:45:05 dist-test-slave-2d19 krb5kdc[27061](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142705, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:45:05.209533 27081 init.cc:377] Logged in from keytab as kudu/127.22.212.126@KRBTEST.COM (short username kudu)
I20260807 22:45:05.210099 27081 webserver.cc:460] Webserver started at http://127.22.212.126:45369/ using document root <none> and password file <none>
I20260807 22:45:05.210363 27081 fs_manager.cc:359] Metadata directory not provided
I20260807 22:45:05.210434 27081 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:45:05.210590 27081 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:45:05.211702 27081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-0/data/instance:
uuid: "ffbdb25ff5e4463680b9b8251f2eae10"
format_stamp: "Formatted at 2026-08-07 22:45:05 on dist-test-slave-2d19"
server_key: "892777385f76acb397c4de958f78db5b"
server_key_iv: "8cd4252b7f1e6240b9e841cb3e3b79f8"
server_key_version: "encryptionkey@0"
I20260807 22:45:05.212111 27081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-0/wal/instance:
uuid: "ffbdb25ff5e4463680b9b8251f2eae10"
format_stamp: "Formatted at 2026-08-07 22:45:05 on dist-test-slave-2d19"
server_key: "892777385f76acb397c4de958f78db5b"
server_key_iv: "8cd4252b7f1e6240b9e841cb3e3b79f8"
server_key_version: "encryptionkey@0"
I20260807 22:45:05.213655 27081 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 22:45:05.214464 27102 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:45:05.214670 27081 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260807 22:45:05.214779 27081 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-0/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-0/wal
uuid: "ffbdb25ff5e4463680b9b8251f2eae10"
format_stamp: "Formatted at 2026-08-07 22:45:05 on dist-test-slave-2d19"
server_key: "892777385f76acb397c4de958f78db5b"
server_key_iv: "8cd4252b7f1e6240b9e841cb3e3b79f8"
server_key_version: "encryptionkey@0"
I20260807 22:45:05.214869 27081 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:45:05.238845 27081 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:45:05.240983 27081 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:45:05.241168 27081 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:45:05.245538 27081 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.126:36871
I20260807 22:45:05.245576 27187 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.126:36871 every 8 connection(s)
I20260807 22:45:05.245954 27081 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-0/data/info.pb
I20260807 22:45:05.246860 27188 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:45:05.248544 27188 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36871 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:45:05.250358 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 27081
I20260807 22:45:05.250443 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-0/wal/instance
I20260807 22:45:05.250661 23377 external_mini_cluster.cc:1428] Setting key a30d5d12755c8699bdeef4bfa552f171
Aug 07 22:45:05 dist-test-slave-2d19 krb5kdc[27061](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142705, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.212.125@KRBTEST.COM; defaulting to no policy
I20260807 22:45:05.259840 27193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:05.249308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40232 (local address 127.22.212.126:36871)
0807 22:45:05.249516 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:05.249520 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:05.249545 (+ 25us) server_negotiation.cc:407] Connection header received
0807 22:45:05.250068 (+ 523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:05.250070 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:05.250088 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:05.250211 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:05.250861 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.252144 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.253457 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.253789 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.253886 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:05.256540 (+ 2654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:45:05.256548 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:45:05.256548 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:45:05.256555 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:45:05.258179 (+ 1624us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:05.258661 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:05.258664 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:05.258664 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:05.258744 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:05.259024 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:05.259025 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:05.259025 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:05.259237 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:45:05.259301 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0807 22:45:05.259570 (+ 269us) server_negotiation.cc:299] Negotiation successful
0807 22:45:05.259672 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":69,"threads_started":1}
I20260807 22:45:05.259968 27192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:05.249265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:36871 (local address 127.0.0.1:40232)
0807 22:45:05.249440 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:05.249475 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 22:45:05.249916 (+ 441us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:45:05.250219 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:45:05.250221 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:45:05.250571 (+ 350us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:45:05.250774 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:45:05.250779 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.252241 (+ 1462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.252242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:45:05.253363 (+ 1121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:45:05.253367 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.253876 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.253878 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:45:05.253936 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:05.254542 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:45:05.254550 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:45:05.256441 (+ 1891us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:45:05.258277 (+ 1836us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:45:05.258285 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:45:05.258288 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:45:05.258565 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:45:05.258817 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:45:05.258818 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:45:05.258818 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:45:05.258941 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:45:05.259319 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:45:05.259328 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:45:05.259417 (+ 89us) client_negotiation.cc:769] Sending connection context
0807 22:45:05.259534 (+ 117us) client_negotiation.cc:240] Negotiation successful
0807 22:45:05.259785 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"mutex_wait_us":73,"thread_start_us":93,"threads_started":1}
I20260807 22:45:05.260802 27188 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.212.125" port: 38437 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:45:05.261205 27192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:05.261072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.125:38437 (local address 127.0.0.1:42724)
0807 22:45:05.261129 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:05.261183 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.125:38437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260807 22:45:05.261492 27107 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.212.125:38437: connect: Connection refused (error 111)
I20260807 22:45:05.261950 27192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:05.261834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.125:38437 (local address 127.0.0.1:42738)
0807 22:45:05.261888 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:05.261922 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.125:38437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260807 22:45:05.262068 27188 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.212.125:38437: Network error: Client connection negotiation failed: client connection to 127.22.212.125:38437: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.125.keytab.
Entry for principal kudu/127.22.212.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.125.keytab.
I20260807 22:45:05.279191 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.125:38437
--webserver_interface=127.22.212.125
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.125.keytab
--principal=kudu/127.22.212.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:45243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:36871,127.22.212.125:38437,127.22.212.124:40285
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:45:05.311311 27188 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.212.125" port: 38437 } attempt: 1
I20260807 22:45:05.311892 27192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:05.311722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.125:38437 (local address 127.0.0.1:42740)
0807 22:45:05.311790 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:05.311844 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.125:38437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260807 22:45:05.312317 27192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:05.312199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.125:38437 (local address 127.0.0.1:42744)
0807 22:45:05.312245 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:05.312294 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.125:38437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260807 22:45:05.312443 27188 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.212.125:38437: Network error: Client connection negotiation failed: client connection to 127.22.212.125:38437: connect: Connection refused (error 111)
W20260807 22:45:05.363788 27200 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 22:45:05.364008 27200 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:45:05.364027 27200 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:45:05.364050 27200 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:45:05.365291 27200 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:45:05.365338 27200 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:45:05.365353 27200 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:45:05.365366 27200 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:45:05.365378 27200 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:45:05.366940 27200 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:45243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:36871,127.22.212.125:38437,127.22.212.124:40285
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.125.keytab
--principal=kudu/127.22.212.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.125:38437
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.22.212.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27200
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:45:05.367216 27200 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:45:05.367456 27200 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:45:05.372555 27215 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:45:05.372566 27210 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:45:05.372584 27200 server_base.cc:1034] running on GCE node
W20260807 22:45:05.372578 27213 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:45:05.372990 27200 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:45:05.373320 27200 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:45:05.374493 27200 hybrid_clock.cc:648] HybridClock initialized: now 1786142705374478 us; error 45 us; skew 500 ppm
Aug 07 22:45:05 dist-test-slave-2d19 krb5kdc[27061](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142705, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:45:05.377315 27200 init.cc:377] Logged in from keytab as kudu/127.22.212.125@KRBTEST.COM (short username kudu)
I20260807 22:45:05.377827 27200 webserver.cc:460] Webserver started at http://127.22.212.125:41659/ using document root <none> and password file <none>
I20260807 22:45:05.378024 27200 fs_manager.cc:359] Metadata directory not provided
I20260807 22:45:05.378067 27200 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:45:05.378160 27200 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:45:05.379216 27200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-1/data/instance:
uuid: "198f1e3398754e348adf2e1de80f8dce"
format_stamp: "Formatted at 2026-08-07 22:45:05 on dist-test-slave-2d19"
server_key: "4b7a40ed4292ac39606d537af1765a61"
server_key_iv: "2d988fc087eab4dbf64d2bae2afa1cb9"
server_key_version: "encryptionkey@0"
I20260807 22:45:05.379555 27200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-1/wal/instance:
uuid: "198f1e3398754e348adf2e1de80f8dce"
format_stamp: "Formatted at 2026-08-07 22:45:05 on dist-test-slave-2d19"
server_key: "4b7a40ed4292ac39606d537af1765a61"
server_key_iv: "2d988fc087eab4dbf64d2bae2afa1cb9"
server_key_version: "encryptionkey@0"
I20260807 22:45:05.380621 27188 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.212.125" port: 38437 } attempt: 2
I20260807 22:45:05.381103 27192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:05.380979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.125:38437 (local address 127.0.0.1:42760)
0807 22:45:05.381042 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:05.381076 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.125:38437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260807 22:45:05.381096 27200 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 22:45:05.381529 27192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:05.381437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.125:38437 (local address 127.0.0.1:42764)
0807 22:45:05.381484 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:05.381508 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.125:38437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260807 22:45:05.381619 27188 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.212.125:38437: Network error: Client connection negotiation failed: client connection to 127.22.212.125:38437: connect: Connection refused (error 111)
I20260807 22:45:05.382324 27231 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:45:05.382545 27200 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260807 22:45:05.382658 27200 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-1/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-1/wal
uuid: "198f1e3398754e348adf2e1de80f8dce"
format_stamp: "Formatted at 2026-08-07 22:45:05 on dist-test-slave-2d19"
server_key: "4b7a40ed4292ac39606d537af1765a61"
server_key_iv: "2d988fc087eab4dbf64d2bae2afa1cb9"
server_key_version: "encryptionkey@0"
I20260807 22:45:05.382745 27200 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:45:05.397532 27200 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:45:05.399664 27200 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:45:05.399847 27200 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:45:05.404163 27200 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.125:38437
I20260807 22:45:05.404192 27311 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.125:38437 every 8 connection(s)
I20260807 22:45:05.404585 27200 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-1/data/info.pb
I20260807 22:45:05.405488 27314 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:45:05.407080 27314 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36871 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 22:45:05 dist-test-slave-2d19 krb5kdc[27061](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142705, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.125@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:45:05.414584 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 27200
I20260807 22:45:05.414700 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-1/wal/instance
I20260807 22:45:05.414891 23377 external_mini_cluster.cc:1428] Setting key 61506ac768b886134a477950db5c704b
I20260807 22:45:05.416497 27193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:05.407838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40244 (local address 127.22.212.126:36871)
0807 22:45:05.407904 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:05.407906 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:05.408135 (+ 229us) server_negotiation.cc:407] Connection header received
0807 22:45:05.408699 (+ 564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:05.408700 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:05.408717 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:05.408769 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:05.409391 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.409901 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.410951 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.411175 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.411256 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:05.413521 (+ 2265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:45:05.413523 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:45:05.413523 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:45:05.413531 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:45:05.415080 (+ 1549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:05.415487 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:05.415488 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:05.415489 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:05.415560 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:05.415814 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:05.415815 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:05.415815 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:05.415948 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:45:05.416024 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 22:45:05.416319 (+ 295us) server_negotiation.cc:299] Negotiation successful
0807 22:45:05.416405 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 22:45:05.416712 27318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:05.407808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:36871 (local address 127.0.0.1:40244)
0807 22:45:05.407996 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:05.408053 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 22:45:05.408592 (+ 539us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:45:05.408853 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:45:05.408856 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:45:05.409103 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:45:05.409295 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:45:05.409299 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.410009 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.410010 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:45:05.410862 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:45:05.410864 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.411263 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.411264 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:45:05.411389 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:05.411923 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:45:05.411932 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:45:05.413416 (+ 1484us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:45:05.415167 (+ 1751us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:45:05.415175 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:45:05.415177 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:45:05.415397 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:45:05.415629 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:45:05.415630 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:45:05.415631 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:45:05.415744 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:45:05.416023 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:45:05.416031 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:45:05.416168 (+ 137us) client_negotiation.cc:769] Sending connection context
0807 22:45:05.416305 (+ 137us) client_negotiation.cc:240] Negotiation successful
0807 22:45:05.416461 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":91,"threads_started":1}
I20260807 22:45:05.417186 27314 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.212.125" port: 38437 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 22:45:05 dist-test-slave-2d19 krb5kdc[27061](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142705, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.125@KRBTEST.COM for kudu/127.22.212.125@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.212.124@KRBTEST.COM; defaulting to no policy
I20260807 22:45:05.425395 27318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:05.417464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.125:38437 (local address 127.0.0.1:42776)
0807 22:45:05.417527 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:05.417542 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:45:05.417595 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:45:05.417825 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:45:05.417826 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:45:05.417990 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:45:05.418050 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:45:05.418051 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.419309 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.419310 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:45:05.419801 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:45:05.419803 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.420404 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.420405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:45:05.420472 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:05.420936 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:45:05.420941 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:45:05.422332 (+ 1391us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:45:05.424212 (+ 1880us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:45:05.424213 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:45:05.424214 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:45:05.424418 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:45:05.424654 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:45:05.424655 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:45:05.424655 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:45:05.424712 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:45:05.425039 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:45:05.425040 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:45:05.425080 (+ 40us) client_negotiation.cc:769] Sending connection context
0807 22:45:05.425147 (+ 67us) client_negotiation.cc:240] Negotiation successful
0807 22:45:05.425250 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260807 22:45:05.425426 27320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:05.417502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42776 (local address 127.22.212.125:38437)
0807 22:45:05.417658 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:05.417663 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:05.417682 (+ 19us) server_negotiation.cc:407] Connection header received
0807 22:45:05.417707 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:05.417709 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:05.417722 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:05.417797 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:05.418142 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.419213 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.419910 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.420244 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.420404 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:05.422435 (+ 2031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:45:05.422444 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:45:05.422445 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:45:05.422459 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:45:05.424120 (+ 1661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:05.424521 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:05.424524 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:05.424525 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:05.424583 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:05.424784 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:05.424785 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:05.424785 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:05.424934 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:45:05.425036 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 22:45:05.425184 (+ 148us) server_negotiation.cc:299] Negotiation successful
0807 22:45:05.425304 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":53,"server-negotiator.queue_time_us":127,"thread_start_us":100,"threads_started":1}
I20260807 22:45:05.426055 27314 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.212.124" port: 40285 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:45:05.426473 27318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:05.426281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:40285 (local address 127.0.0.1:49470)
0807 22:45:05.426353 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:05.426435 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.124:40285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260807 22:45:05.426678 27234 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.212.124:40285: connect: Connection refused (error 111)
I20260807 22:45:05.427269 27318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:05.427069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:40285 (local address 127.0.0.1:49482)
0807 22:45:05.427173 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:05.427236 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.124:40285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
W20260807 22:45:05.427385 27314 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.212.124:40285: Network error: Client connection negotiation failed: client connection to 127.22.212.124:40285: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.212.124@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.212.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.124.keytab.
Entry for principal kudu/127.22.212.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.124.keytab.
I20260807 22:45:05.445405 23377 external_mini_cluster.cc:1326] Running /tmp/dist-test-task6SvSzn/build/release/bin/kudu
/tmp/dist-test-task6SvSzn/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.124:40285
--webserver_interface=127.22.212.124
--webserver_port=0
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.124.keytab
--principal=kudu/127.22.212.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.212.84:45243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.212.126:36871,127.22.212.125:38437,127.22.212.124:40285
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 22:45:05.472779 27188 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.212.125" port: 38437 } attempt: 3
I20260807 22:45:05.476648 27314 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.212.124" port: 40285 } attempt: 1
I20260807 22:45:05.477036 27318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:05.476913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:40285 (local address 127.0.0.1:49490)
0807 22:45:05.476968 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:05.477006 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.124:40285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
Aug 07 22:45:05 dist-test-slave-2d19 krb5kdc[27061](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142705, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for kudu/127.22.212.125@KRBTEST.COM
I20260807 22:45:05.477383 27318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:05.477294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:40285 (local address 127.0.0.1:49500)
0807 22:45:05.477325 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:05.477362 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.124:40285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
W20260807 22:45:05.477576 27314 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.212.124:40285: Network error: Client connection negotiation failed: client connection to 127.22.212.124:40285: connect: Connection refused (error 111)
I20260807 22:45:05.480393 27192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:05.473181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.125:38437 (local address 127.0.0.1:42788)
0807 22:45:05.473255 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:05.473275 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 22:45:05.473351 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:45:05.473548 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:45:05.473549 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:45:05.473720 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:45:05.473785 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:45:05.473787 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.474482 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.474483 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:45:05.475037 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:45:05.475038 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.475437 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.475438 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:45:05.475521 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:05.476058 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:45:05.476063 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:45:05.477602 (+ 1539us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:45:05.479365 (+ 1763us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:45:05.479366 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:45:05.479366 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:45:05.479541 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:45:05.479747 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:45:05.479747 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:45:05.479748 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:45:05.479801 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:45:05.480085 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:45:05.480085 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:45:05.480124 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 22:45:05.480177 (+ 53us) client_negotiation.cc:240] Negotiation successful
0807 22:45:05.480319 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260807 22:45:05.480434 27320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:05.473271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42788 (local address 127.22.212.125:38437)
0807 22:45:05.473342 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:05.473344 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:05.473356 (+ 12us) server_negotiation.cc:407] Connection header received
0807 22:45:05.473424 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:05.473425 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:05.473439 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:05.473536 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:05.473876 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.474381 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.475130 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.475357 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.475438 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:05.477710 (+ 2272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:45:05.477711 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:45:05.477712 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:45:05.477719 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:45:05.479273 (+ 1554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:05.479616 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:05.479617 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:05.479617 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:05.479678 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:05.479862 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:05.479863 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:05.479863 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:05.480013 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:45:05.480087 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 22:45:05.480264 (+ 177us) server_negotiation.cc:299] Negotiation successful
0807 22:45:05.480349 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 22:45:05.481164 27188 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.212.124" port: 40285 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:45:05.481495 27192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:05.481391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:40285 (local address 127.0.0.1:49502)
0807 22:45:05.481441 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:05.481467 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.124:40285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260807 22:45:05.481855 27192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:05.481773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:40285 (local address 127.0.0.1:49506)
0807 22:45:05.481816 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:05.481840 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.124:40285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260807 22:45:05.481961 27188 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.212.124:40285: Network error: Client connection negotiation failed: client connection to 127.22.212.124:40285: connect: Connection refused (error 111)
I20260807 22:45:05.513164 27188 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.212.124" port: 40285 } attempt: 1
I20260807 22:45:05.513715 27192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:05.513556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:40285 (local address 127.0.0.1:49518)
0807 22:45:05.513634 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:05.513683 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.124:40285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260807 22:45:05.514146 27192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:05.514025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:40285 (local address 127.0.0.1:49522)
0807 22:45:05.514083 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:05.514113 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.124:40285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260807 22:45:05.514259 27188 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.212.124:40285: Network error: Client connection negotiation failed: client connection to 127.22.212.124:40285: connect: Connection refused (error 111)
W20260807 22:45:05.533464 27329 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 22:45:05.533715 27329 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 22:45:05.533746 27329 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 22:45:05.533802 27329 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 22:45:05.535012 27329 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 22:45:05.535077 27329 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 22:45:05.535101 27329 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 22:45:05.535122 27329 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 22:45:05.535152 27329 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 22:45:05.536677 27329 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.212.84:45243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.22.212.126:36871,127.22.212.125:38437,127.22.212.124:40285
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/krb5kdc/kudu_127.22.212.124.keytab
--principal=kudu/127.22.212.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.212.124:40285
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.22.212.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27329
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 21:52:04 UTC on ccycloud.quasar-kxqltd.root.comops.site
build id 4573644
I20260807 22:45:05.536960 27329 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 22:45:05.537202 27329 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 22:45:05.542236 27338 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:45:05.542225 27340 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 22:45:05.542225 27337 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 22:45:05.542479 27329 server_base.cc:1034] running on GCE node
I20260807 22:45:05.542760 27329 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 22:45:05.543103 27329 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 22:45:05.544363 27329 hybrid_clock.cc:648] HybridClock initialized: now 1786142705544352 us; error 46 us; skew 500 ppm
I20260807 22:45:05.545743 27314 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.212.124" port: 40285 } attempt: 2
I20260807 22:45:05.546139 27318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:05.546009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:40285 (local address 127.0.0.1:49536)
0807 22:45:05.546074 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:05.546109 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.124:40285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260807 22:45:05.546463 27318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:05.546369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:40285 (local address 127.0.0.1:49552)
0807 22:45:05.546413 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:05.546439 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.212.124:40285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260807 22:45:05.546553 27314 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.212.124:40285: Network error: Client connection negotiation failed: client connection to 127.22.212.124:40285: connect: Connection refused (error 111)
Aug 07 22:45:05 dist-test-slave-2d19 krb5kdc[27061](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142705, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 22:45:05.547161 27329 init.cc:377] Logged in from keytab as kudu/127.22.212.124@KRBTEST.COM (short username kudu)
I20260807 22:45:05.547660 27329 webserver.cc:460] Webserver started at http://127.22.212.124:42109/ using document root <none> and password file <none>
I20260807 22:45:05.547925 27329 fs_manager.cc:359] Metadata directory not provided
I20260807 22:45:05.547973 27329 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 22:45:05.548144 27329 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 22:45:05.549260 27329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-2/data/instance:
uuid: "d8bde75f380b4b8bb6c2e2d669715cca"
format_stamp: "Formatted at 2026-08-07 22:45:05 on dist-test-slave-2d19"
server_key: "5992917f59f7861d1679b370f8f31790"
server_key_iv: "a2eeea4e2712bf3d2dacd303697f25d7"
server_key_version: "encryptionkey@0"
I20260807 22:45:05.549634 27329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-2/wal/instance:
uuid: "d8bde75f380b4b8bb6c2e2d669715cca"
format_stamp: "Formatted at 2026-08-07 22:45:05 on dist-test-slave-2d19"
server_key: "5992917f59f7861d1679b370f8f31790"
server_key_iv: "a2eeea4e2712bf3d2dacd303697f25d7"
server_key_version: "encryptionkey@0"
I20260807 22:45:05.551067 27329 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260807 22:45:05.551887 27349 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 22:45:05.552114 27329 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 22:45:05.552212 27329 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-2/data,/tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-2/wal
uuid: "d8bde75f380b4b8bb6c2e2d669715cca"
format_stamp: "Formatted at 2026-08-07 22:45:05 on dist-test-slave-2d19"
server_key: "5992917f59f7861d1679b370f8f31790"
server_key_iv: "a2eeea4e2712bf3d2dacd303697f25d7"
server_key_version: "encryptionkey@0"
I20260807 22:45:05.552340 27329 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 22:45:05.568938 27329 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 22:45:05.570999 27329 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 22:45:05.571250 27329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 22:45:05.575451 27329 rpc_server.cc:307] RPC server started. Bound to: 127.22.212.124:40285
I20260807 22:45:05.575485 27440 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.212.124:40285 every 8 connection(s)
I20260807 22:45:05.575857 27329 server_base.cc:1166] Dumped server information to /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-2/data/info.pb
I20260807 22:45:05.576872 27442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 22:45:05.578416 27442 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36871 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:45:05.581940 23377 external_mini_cluster.cc:1388] Started /tmp/dist-test-task6SvSzn/build/release/bin/kudu as pid 27329
I20260807 22:45:05.582036 23377 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task6SvSzn/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786142418640232-23377-0/minicluster-data/master-2/wal/instance
I20260807 22:45:05.582275 23377 external_mini_cluster.cc:1428] Setting key 73b8bb5573ddac373c53995ad2d93dba
Aug 07 22:45:05 dist-test-slave-2d19 krb5kdc[27061](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142705, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.124@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
Aug 07 22:45:05 dist-test-slave-2d19 krb5kdc[27061](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142705, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.212.124@KRBTEST.COM
I20260807 22:45:05.588622 27193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:05.579130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40254 (local address 127.22.212.126:36871)
0807 22:45:05.579208 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:05.579210 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:05.579367 (+ 157us) server_negotiation.cc:407] Connection header received
0807 22:45:05.579912 (+ 545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:05.579914 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:05.579926 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:05.579998 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:05.580673 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.581139 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.582165 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.582457 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.582540 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:05.585246 (+ 2706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:45:05.585248 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:45:05.585248 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:45:05.585255 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:45:05.586915 (+ 1660us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:05.587320 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:05.587321 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:05.587321 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:05.587387 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:05.587644 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:05.587645 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:05.587645 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:05.587786 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:45:05.587853 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 22:45:05.588434 (+ 581us) server_negotiation.cc:299] Negotiation successful
0807 22:45:05.588557 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 22:45:05.588845 27444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:05.579065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.126:36871 (local address 127.0.0.1:40254)
0807 22:45:05.579236 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:05.579279 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 22:45:05.579745 (+ 466us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:45:05.580074 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:45:05.580077 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:45:05.580381 (+ 304us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:45:05.580590 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:45:05.580595 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.581219 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.581219 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:45:05.582049 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:45:05.582052 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.582545 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.582546 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:45:05.582703 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:05.583312 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:45:05.583325 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:45:05.585158 (+ 1833us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:45:05.586993 (+ 1835us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:45:05.587000 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:45:05.587003 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:45:05.587240 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:45:05.587454 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:45:05.587455 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:45:05.587456 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:45:05.587568 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:45:05.587876 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:45:05.587883 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:45:05.588011 (+ 128us) client_negotiation.cc:769] Sending connection context
0807 22:45:05.588409 (+ 398us) client_negotiation.cc:240] Negotiation successful
0807 22:45:05.588598 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":93,"threads_started":1}
I20260807 22:45:05.589402 27188 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.212.124" port: 40285 } attempt: 2
I20260807 22:45:05.589586 27442 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.212.125" port: 38437 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:45:05.592355 27448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:05.582682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49558 (local address 127.22.212.124:40285)
0807 22:45:05.582858 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:05.582862 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:05.582958 (+ 96us) server_negotiation.cc:407] Connection header received
0807 22:45:05.583002 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:05.583004 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:05.583027 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:05.583099 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:05.583894 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.584972 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.585824 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.586315 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.586394 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:05.588938 (+ 2544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:45:05.588946 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:45:05.588946 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:45:05.588953 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:45:05.591075 (+ 2122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:05.591464 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:05.591467 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:05.591467 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:05.591532 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:05.591719 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:05.591720 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:05.591720 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:05.591899 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:45:05.592086 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0807 22:45:05.592132 (+ 46us) server_negotiation.cc:299] Negotiation successful
0807 22:45:05.592218 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":90,"threads_started":1}
Aug 07 22:45:05 dist-test-slave-2d19 krb5kdc[27061](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142705, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.126@KRBTEST.COM for kudu/127.22.212.124@KRBTEST.COM
Aug 07 22:45:05 dist-test-slave-2d19 krb5kdc[27061](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142705, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.124@KRBTEST.COM for kudu/127.22.212.125@KRBTEST.COM
Aug 07 22:45:05 dist-test-slave-2d19 krb5kdc[27061](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142705, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.212.126@KRBTEST.COM
I20260807 22:45:05.598295 27192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:05.589682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:40285 (local address 127.0.0.1:49562)
0807 22:45:05.589759 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:05.589771 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 22:45:05.589814 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:45:05.590195 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:45:05.590196 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:45:05.590364 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:45:05.590410 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:45:05.590412 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.591310 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.591311 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:45:05.592113 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:45:05.592116 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.592611 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.592612 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:45:05.592670 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:05.593063 (+ 393us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:45:05.593068 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:45:05.594457 (+ 1389us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:45:05.597167 (+ 2710us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:45:05.597168 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:45:05.597169 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:45:05.597393 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:45:05.597634 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:45:05.597635 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:45:05.597636 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:45:05.597706 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:45:05.597964 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:45:05.597965 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:45:05.598010 (+ 45us) client_negotiation.cc:769] Sending connection context
0807 22:45:05.598107 (+ 97us) client_negotiation.cc:240] Negotiation successful
0807 22:45:05.598200 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260807 22:45:05.598325 27450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:05.589880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49562 (local address 127.22.212.124:40285)
0807 22:45:05.590037 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:05.590038 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:05.590045 (+ 7us) server_negotiation.cc:407] Connection header received
0807 22:45:05.590063 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:05.590064 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:05.590074 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:05.590170 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:05.590514 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.591215 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.592201 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.592505 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.592806 (+ 301us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:05.594544 (+ 1738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:45:05.594546 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:45:05.594546 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:45:05.594553 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:45:05.597068 (+ 2515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:05.597476 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:05.597477 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:05.597477 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:05.597531 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:05.597775 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:05.597775 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:05.597776 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:05.597907 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:45:05.597972 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0807 22:45:05.598132 (+ 160us) server_negotiation.cc:299] Negotiation successful
0807 22:45:05.598200 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":95,"threads_started":1}
I20260807 22:45:05.598533 27320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:05.589934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42802 (local address 127.22.212.125:38437)
0807 22:45:05.589990 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:05.589992 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:05.590003 (+ 11us) server_negotiation.cc:407] Connection header received
0807 22:45:05.590316 (+ 313us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:05.590317 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:05.590330 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:05.590393 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:05.590710 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.591207 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.593389 (+ 2182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.593612 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.593698 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:05.595669 (+ 1971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:45:05.595671 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:45:05.595671 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:45:05.595681 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:45:05.597294 (+ 1613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:05.597668 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:05.597670 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:05.597670 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:05.597721 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:05.597942 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:05.597943 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:05.597944 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:05.598080 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:45:05.598150 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 22:45:05.598350 (+ 200us) server_negotiation.cc:299] Negotiation successful
0807 22:45:05.598427 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260807 22:45:05.598968 27444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:05.589859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.125:38437 (local address 127.0.0.1:42802)
0807 22:45:05.589901 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:05.589910 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 22:45:05.589945 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:45:05.590408 (+ 463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:45:05.590408 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:45:05.590574 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:45:05.590630 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:45:05.590632 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.592319 (+ 1687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.592321 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:45:05.593293 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:45:05.593295 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.593700 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.593701 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:45:05.593764 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:05.594186 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:45:05.594191 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:45:05.595574 (+ 1383us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:45:05.597382 (+ 1808us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:45:05.597383 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:45:05.597384 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:45:05.597610 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:45:05.597813 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:45:05.597814 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:45:05.597814 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:45:05.597862 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:45:05.598182 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:45:05.598183 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:45:05.598229 (+ 46us) client_negotiation.cc:769] Sending connection context
0807 22:45:05.598755 (+ 526us) client_negotiation.cc:240] Negotiation successful
0807 22:45:05.598853 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29,"mutex_wait_us":12}
I20260807 22:45:05.599507 27442 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.212.124" port: 40285 } has no permanent_uuid. Determining permanent_uuid...
I20260807 22:45:05.600718 27188 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ffbdb25ff5e4463680b9b8251f2eae10: Bootstrap starting.
I20260807 22:45:05.601527 27188 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ffbdb25ff5e4463680b9b8251f2eae10: Neither blocks nor log segments found. Creating new log.
I20260807 22:45:05.601863 27188 log.cc:824] T 00000000000000000000000000000000 P ffbdb25ff5e4463680b9b8251f2eae10: Log is configured to *not* fsync() on all Append() calls
I20260807 22:45:05.602082 27193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:05.593163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40270 (local address 127.22.212.126:36871)
0807 22:45:05.593204 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:05.593206 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:05.593215 (+ 9us) server_negotiation.cc:407] Connection header received
0807 22:45:05.593237 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:05.593237 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:05.593246 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:05.593303 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:05.593900 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.594628 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.595509 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.595758 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.595788 (+ 30us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:05.598917 (+ 3129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:45:05.598918 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:45:05.598919 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:45:05.598926 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:45:05.600531 (+ 1605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:05.600891 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:05.600893 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:05.600893 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:05.600950 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:05.601358 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:05.601359 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:05.601359 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:05.601498 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:45:05.601642 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0807 22:45:05.601769 (+ 127us) server_negotiation.cc:299] Negotiation successful
0807 22:45:05.601845 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 22:45:05.602988 27188 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ffbdb25ff5e4463680b9b8251f2eae10: No bootstrap required, opened a new log
I20260807 22:45:05.604966 27188 raft_consensus.cc:348] T 00000000000000000000000000000000 P ffbdb25ff5e4463680b9b8251f2eae10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffbdb25ff5e4463680b9b8251f2eae10" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36871 } } peers { permanent_uuid: "198f1e3398754e348adf2e1de80f8dce" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 38437 } } peers { permanent_uuid: "d8bde75f380b4b8bb6c2e2d669715cca" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 40285 } }
I20260807 22:45:05.605135 27188 raft_consensus.cc:729] T 00000000000000000000000000000000 P ffbdb25ff5e4463680b9b8251f2eae10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffbdb25ff5e4463680b9b8251f2eae10, State: Initialized, Role: FOLLOWER
I20260807 22:45:05.605252 27188 consensus_queue.cc:260] T 00000000000000000000000000000000 P ffbdb25ff5e4463680b9b8251f2eae10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffbdb25ff5e4463680b9b8251f2eae10" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36871 } } peers { permanent_uuid: "198f1e3398754e348adf2e1de80f8dce" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 38437 } } peers { permanent_uuid: "d8bde75f380b4b8bb6c2e2d669715cca" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 40285 } }
I20260807 22:45:05.605754 27188 sys_catalog.cc:564] T 00000000000000000000000000000000 P ffbdb25ff5e4463680b9b8251f2eae10 [sys.catalog]: configured and running, proceeding with master startup.
Aug 07 22:45:05 dist-test-slave-2d19 krb5kdc[27061](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142705, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.124@KRBTEST.COM for kudu/127.22.212.124@KRBTEST.COM
Aug 07 22:45:05 dist-test-slave-2d19 krb5kdc[27061](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142705, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.212.125@KRBTEST.COM
I20260807 22:45:05.605913 27455 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffbdb25ff5e4463680b9b8251f2eae10 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffbdb25ff5e4463680b9b8251f2eae10" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36871 } } peers { permanent_uuid: "198f1e3398754e348adf2e1de80f8dce" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 38437 } } peers { permanent_uuid: "d8bde75f380b4b8bb6c2e2d669715cca" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 40285 } } }
I20260807 22:45:05.611063 27320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:05.602713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42804 (local address 127.22.212.125:38437)
0807 22:45:05.602757 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:05.602759 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:05.602767 (+ 8us) server_negotiation.cc:407] Connection header received
0807 22:45:05.602788 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:05.602789 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:05.602797 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:05.602846 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:05.603421 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.604112 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.604970 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.605290 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.605362 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:05.608068 (+ 2706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:45:05.608070 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:45:05.608070 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:45:05.608078 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:45:05.609748 (+ 1670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:05.610136 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:05.610137 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:05.610137 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:05.610191 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:05.610370 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:05.610371 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:05.610371 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:05.610487 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:45:05.610634 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0807 22:45:05.610842 (+ 208us) server_negotiation.cc:299] Negotiation successful
0807 22:45:05.610920 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 22:45:05.617388 23377 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 22:45:05.615849 27455 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffbdb25ff5e4463680b9b8251f2eae10 [sys.catalog]: This master's current role is: FOLLOWER
W20260807 22:45:05.617889 27474 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ffbdb25ff5e4463680b9b8251f2eae10: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:45:05.617944 27474 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:45:05.618392 27141 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "ffbdb25ff5e4463680b9b8251f2eae10"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40270
I20260807 22:45:05.618511 27141 raft_consensus.cc:482] T 00000000000000000000000000000000 P ffbdb25ff5e4463680b9b8251f2eae10 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 22:45:05.618554 27141 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ffbdb25ff5e4463680b9b8251f2eae10 [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:45:05.618703 27444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:05.599963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:40285 (local address 127.0.0.1:49574)
0807 22:45:05.600002 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:05.600017 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 22:45:05.600046 (+ 29us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:45:05.602698 (+ 2652us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:45:05.602699 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:45:05.603025 (+ 326us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:45:05.603068 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:45:05.603070 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.603852 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.603853 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:45:05.604562 (+ 709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:45:05.604565 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.605071 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.605072 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:45:05.605128 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:05.605637 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:45:05.605642 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:45:05.607094 (+ 1452us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:45:05.617184 (+ 10090us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:45:05.617184 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:45:05.617185 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:45:05.617408 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:45:05.617603 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:45:05.617603 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:45:05.617604 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:45:05.617663 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:45:05.618383 (+ 720us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:45:05.618383 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:45:05.618432 (+ 49us) client_negotiation.cc:769] Sending connection context
0807 22:45:05.618504 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 22:45:05.618603 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260807 22:45:05.619000 27450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:05.600324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49574 (local address 127.22.212.124:40285)
0807 22:45:05.602383 (+ 2059us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:05.602385 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:05.602393 (+ 8us) server_negotiation.cc:407] Connection header received
0807 22:45:05.602419 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:05.602420 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:05.602448 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:05.602502 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:05.603169 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.603763 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.604652 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.604976 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.605067 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:05.607190 (+ 2123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:45:05.607191 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:45:05.607191 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:45:05.607197 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:45:05.617112 (+ 9915us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:05.617490 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:05.617491 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:05.617491 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:05.617543 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:05.617723 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:05.617723 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:05.617724 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:05.617907 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:45:05.618364 (+ 457us) server_negotiation.cc:1035] Waiting for connection context
0807 22:45:05.618815 (+ 451us) server_negotiation.cc:299] Negotiation successful
0807 22:45:05.618917 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2041}
I20260807 22:45:05.619807 27141 raft_consensus.cc:504] T 00000000000000000000000000000000 P ffbdb25ff5e4463680b9b8251f2eae10 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffbdb25ff5e4463680b9b8251f2eae10" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36871 } } peers { permanent_uuid: "198f1e3398754e348adf2e1de80f8dce" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 38437 } } peers { permanent_uuid: "d8bde75f380b4b8bb6c2e2d669715cca" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 40285 } }
I20260807 22:45:05.620074 27141 leader_election.cc:288] T 00000000000000000000000000000000 P ffbdb25ff5e4463680b9b8251f2eae10 [CANDIDATE]: Term 1 election: Requested vote from peers 198f1e3398754e348adf2e1de80f8dce (127.22.212.125:38437), d8bde75f380b4b8bb6c2e2d669715cca (127.22.212.124:40285)
I20260807 22:45:05.620481 27442 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8bde75f380b4b8bb6c2e2d669715cca: Bootstrap starting.
I20260807 22:45:05.621243 27442 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d8bde75f380b4b8bb6c2e2d669715cca: Neither blocks nor log segments found. Creating new log.
I20260807 22:45:05.619221 27081 master_runner.cc:186] Error getting master registration for 127.22.212.125:38437: OK, instance_id { permanent_uuid: "198f1e3398754e348adf2e1de80f8dce" instance_seqno: 1786142705402992 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 22:45:05.621528 27081 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 22:45:05.621583 27442 log.cc:824] T 00000000000000000000000000000000 P d8bde75f380b4b8bb6c2e2d669715cca: Log is configured to *not* fsync() on all Append() calls
I20260807 22:45:05.622509 27442 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8bde75f380b4b8bb6c2e2d669715cca: No bootstrap required, opened a new log
I20260807 22:45:05.624984 27442 raft_consensus.cc:348] T 00000000000000000000000000000000 P d8bde75f380b4b8bb6c2e2d669715cca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffbdb25ff5e4463680b9b8251f2eae10" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36871 } } peers { permanent_uuid: "198f1e3398754e348adf2e1de80f8dce" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 38437 } } peers { permanent_uuid: "d8bde75f380b4b8bb6c2e2d669715cca" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 40285 } }
I20260807 22:45:05.625144 27442 raft_consensus.cc:729] T 00000000000000000000000000000000 P d8bde75f380b4b8bb6c2e2d669715cca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8bde75f380b4b8bb6c2e2d669715cca, State: Initialized, Role: FOLLOWER
I20260807 22:45:05.625231 27442 consensus_queue.cc:260] T 00000000000000000000000000000000 P d8bde75f380b4b8bb6c2e2d669715cca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffbdb25ff5e4463680b9b8251f2eae10" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36871 } } peers { permanent_uuid: "198f1e3398754e348adf2e1de80f8dce" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 38437 } } peers { permanent_uuid: "d8bde75f380b4b8bb6c2e2d669715cca" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 40285 } }
I20260807 22:45:05.625567 27442 sys_catalog.cc:564] T 00000000000000000000000000000000 P d8bde75f380b4b8bb6c2e2d669715cca [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:45:05.625619 27397 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ffbdb25ff5e4463680b9b8251f2eae10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d8bde75f380b4b8bb6c2e2d669715cca"
I20260807 22:45:05.625775 27397 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d8bde75f380b4b8bb6c2e2d669715cca [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:45:05.625571 27491 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8bde75f380b4b8bb6c2e2d669715cca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffbdb25ff5e4463680b9b8251f2eae10" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36871 } } peers { permanent_uuid: "198f1e3398754e348adf2e1de80f8dce" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 38437 } } peers { permanent_uuid: "d8bde75f380b4b8bb6c2e2d669715cca" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 40285 } } }
I20260807 22:45:05.625893 27491 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8bde75f380b4b8bb6c2e2d669715cca [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:45:05.627104 27397 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d8bde75f380b4b8bb6c2e2d669715cca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffbdb25ff5e4463680b9b8251f2eae10 in term 1.
I20260807 22:45:05.627424 27107 leader_election.cc:302] T 00000000000000000000000000000000 P ffbdb25ff5e4463680b9b8251f2eae10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d8bde75f380b4b8bb6c2e2d669715cca, ffbdb25ff5e4463680b9b8251f2eae10; no voters:
I20260807 22:45:05.627580 27455 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ffbdb25ff5e4463680b9b8251f2eae10 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 22:45:05.627748 27455 raft_consensus.cc:686] T 00000000000000000000000000000000 P ffbdb25ff5e4463680b9b8251f2eae10 [term 1 LEADER]: Becoming Leader. State: Replica: ffbdb25ff5e4463680b9b8251f2eae10, State: Running, Role: LEADER
I20260807 22:45:05.627858 27455 consensus_queue.cc:237] T 00000000000000000000000000000000 P ffbdb25ff5e4463680b9b8251f2eae10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffbdb25ff5e4463680b9b8251f2eae10" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36871 } } peers { permanent_uuid: "198f1e3398754e348adf2e1de80f8dce" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 38437 } } peers { permanent_uuid: "d8bde75f380b4b8bb6c2e2d669715cca" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 40285 } }
I20260807 22:45:05.629065 27455 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffbdb25ff5e4463680b9b8251f2eae10 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ffbdb25ff5e4463680b9b8251f2eae10. Latest consensus state: current_term: 1 leader_uuid: "ffbdb25ff5e4463680b9b8251f2eae10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffbdb25ff5e4463680b9b8251f2eae10" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36871 } } peers { permanent_uuid: "198f1e3398754e348adf2e1de80f8dce" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 38437 } } peers { permanent_uuid: "d8bde75f380b4b8bb6c2e2d669715cca" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 40285 } } }
I20260807 22:45:05.629171 27455 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffbdb25ff5e4463680b9b8251f2eae10 [sys.catalog]: This master's current role is: LEADER
W20260807 22:45:05.629478 27510 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d8bde75f380b4b8bb6c2e2d669715cca: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:45:05.629539 27510 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:45:05.630488 27329 master_runner.cc:186] Error getting master registration for 127.22.212.125:38437: OK, instance_id { permanent_uuid: "198f1e3398754e348adf2e1de80f8dce" instance_seqno: 1786142705402992 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 22:45:05.632910 27329 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 22:45:05.634747 27517 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 22:45:05.635069 27517 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 22:45:05.637663 27314 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.212.124" port: 40285 } attempt: 3
I20260807 22:45:05.640048 27193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:05.628544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40284 (local address 127.22.212.126:36871)
0807 22:45:05.628615 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:05.628617 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:05.628889 (+ 272us) server_negotiation.cc:407] Connection header received
0807 22:45:05.628912 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:05.628913 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:05.628922 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:05.628972 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:05.630597 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.631355 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.632448 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.632748 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.632788 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:05.634381 (+ 1593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:45:05.634382 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:45:05.634383 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:45:05.634389 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:45:05.636212 (+ 1823us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:05.639180 (+ 2968us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:05.639182 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:05.639182 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:05.639247 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:05.639454 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:05.639455 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:05.639455 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:05.639592 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:45:05.639672 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 22:45:05.639875 (+ 203us) server_negotiation.cc:299] Negotiation successful
0807 22:45:05.639963 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260807 22:45:05.640381 27320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:05.622938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42814 (local address 127.22.212.125:38437)
0807 22:45:05.622983 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:05.622985 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:05.628716 (+ 5731us) server_negotiation.cc:407] Connection header received
0807 22:45:05.628775 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:05.628776 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:05.628800 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:05.628854 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:05.632153 (+ 3299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.632867 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.633955 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.634300 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.634345 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:05.637021 (+ 2676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:45:05.637023 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:45:05.637023 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:45:05.637031 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:45:05.638698 (+ 1667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:05.639282 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:05.639283 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:05.639284 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:05.639353 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:05.639640 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:05.639640 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:05.639641 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:05.639778 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:45:05.639859 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 22:45:05.640181 (+ 322us) server_negotiation.cc:299] Negotiation successful
0807 22:45:05.640301 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260807 22:45:05.643872 27450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:05.623431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49578 (local address 127.22.212.124:40285)
0807 22:45:05.623467 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:05.623469 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:05.631281 (+ 7812us) server_negotiation.cc:407] Connection header received
0807 22:45:05.631366 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:05.631367 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:05.631378 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:05.631408 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:05.633920 (+ 2512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.635161 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.636138 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.636460 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.636528 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:05.637989 (+ 1461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:45:05.637991 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:45:05.637991 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:45:05.637999 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:45:05.642616 (+ 4617us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:05.643049 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:05.643051 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:05.643051 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:05.643108 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:05.643336 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:05.643337 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:05.643337 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:05.643454 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:45:05.643596 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0807 22:45:05.643684 (+ 88us) server_negotiation.cc:299] Negotiation successful
0807 22:45:05.643766 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
Aug 07 22:45:05 dist-test-slave-2d19 krb5kdc[27061](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786142705, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.212.125@KRBTEST.COM for kudu/127.22.212.124@KRBTEST.COM
I20260807 22:45:05.647655 27318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:05.638134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.212.124:40285 (local address 127.0.0.1:49592)
0807 22:45:05.638220 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0807 22:45:05.638230 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 22:45:05.638265 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 22:45:05.638512 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 22:45:05.638513 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 22:45:05.638905 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0807 22:45:05.638949 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:45:05.638951 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.639962 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.639964 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:45:05.640703 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 22:45:05.640706 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.641791 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.641792 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 22:45:05.641855 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:05.642763 (+ 908us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 22:45:05.642769 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 22:45:05.644364 (+ 1595us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 22:45:05.646330 (+ 1966us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:45:05.646331 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:45:05.646332 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:45:05.646605 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:45:05.646953 (+ 348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 22:45:05.646954 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 22:45:05.646954 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 22:45:05.647044 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 22:45:05.647343 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 22:45:05.647344 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 22:45:05.647389 (+ 45us) client_negotiation.cc:769] Sending connection context
0807 22:45:05.647461 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 22:45:05.647559 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":70}
I20260807 22:45:05.647743 27448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:05.638332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49592 (local address 127.22.212.124:40285)
0807 22:45:05.638397 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:05.638399 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:05.638407 (+ 8us) server_negotiation.cc:407] Connection header received
0807 22:45:05.638429 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:05.638430 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:05.638443 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:05.638507 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:05.639151 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.639880 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.641458 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:05.641711 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:05.641793 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:05.644498 (+ 2705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 22:45:05.644499 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 22:45:05.644499 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 22:45:05.644506 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 22:45:05.646218 (+ 1712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:05.646740 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:05.646741 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:05.646742 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:05.646820 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 22:45:05.647120 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 22:45:05.647121 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 22:45:05.647121 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 22:45:05.647253 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 22:45:05.647315 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0807 22:45:05.647529 (+ 214us) server_negotiation.cc:299] Negotiation successful
0807 22:45:05.647631 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 22:45:05.649516 27314 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 198f1e3398754e348adf2e1de80f8dce: Bootstrap starting.
I20260807 22:45:05.650285 27314 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 198f1e3398754e348adf2e1de80f8dce: Neither blocks nor log segments found. Creating new log.
I20260807 22:45:05.650687 27314 log.cc:824] T 00000000000000000000000000000000 P 198f1e3398754e348adf2e1de80f8dce: Log is configured to *not* fsync() on all Append() calls
I20260807 22:45:05.651564 27314 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 198f1e3398754e348adf2e1de80f8dce: No bootstrap required, opened a new log
I20260807 22:45:05.653859 27314 raft_consensus.cc:348] T 00000000000000000000000000000000 P 198f1e3398754e348adf2e1de80f8dce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffbdb25ff5e4463680b9b8251f2eae10" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36871 } } peers { permanent_uuid: "198f1e3398754e348adf2e1de80f8dce" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 38437 } } peers { permanent_uuid: "d8bde75f380b4b8bb6c2e2d669715cca" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 40285 } }
I20260807 22:45:05.654021 27314 raft_consensus.cc:729] T 00000000000000000000000000000000 P 198f1e3398754e348adf2e1de80f8dce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 198f1e3398754e348adf2e1de80f8dce, State: Initialized, Role: FOLLOWER
I20260807 22:45:05.654124 27314 consensus_queue.cc:260] T 00000000000000000000000000000000 P 198f1e3398754e348adf2e1de80f8dce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffbdb25ff5e4463680b9b8251f2eae10" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36871 } } peers { permanent_uuid: "198f1e3398754e348adf2e1de80f8dce" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 38437 } } peers { permanent_uuid: "d8bde75f380b4b8bb6c2e2d669715cca" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 40285 } }
I20260807 22:45:05.654491 27524 sys_catalog.cc:455] T 00000000000000000000000000000000 P 198f1e3398754e348adf2e1de80f8dce [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffbdb25ff5e4463680b9b8251f2eae10" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36871 } } peers { permanent_uuid: "198f1e3398754e348adf2e1de80f8dce" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 38437 } } peers { permanent_uuid: "d8bde75f380b4b8bb6c2e2d669715cca" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 40285 } } }
I20260807 22:45:05.654572 27314 sys_catalog.cc:564] T 00000000000000000000000000000000 P 198f1e3398754e348adf2e1de80f8dce [sys.catalog]: configured and running, proceeding with master startup.
I20260807 22:45:05.654603 27524 sys_catalog.cc:458] T 00000000000000000000000000000000 P 198f1e3398754e348adf2e1de80f8dce [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:45:05.654619 27267 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ffbdb25ff5e4463680b9b8251f2eae10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "198f1e3398754e348adf2e1de80f8dce"
I20260807 22:45:05.654729 27267 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 198f1e3398754e348adf2e1de80f8dce [term 0 FOLLOWER]: Advancing to term 1
I20260807 22:45:05.655782 27267 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 198f1e3398754e348adf2e1de80f8dce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffbdb25ff5e4463680b9b8251f2eae10 in term 1.
W20260807 22:45:05.657223 27542 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 198f1e3398754e348adf2e1de80f8dce: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 22:45:05.657281 27542 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 22:45:05.661402 27397 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d8bde75f380b4b8bb6c2e2d669715cca [term 1 FOLLOWER]: Refusing update from remote peer ffbdb25ff5e4463680b9b8251f2eae10: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:45:05.661377 27267 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 198f1e3398754e348adf2e1de80f8dce [term 1 FOLLOWER]: Refusing update from remote peer ffbdb25ff5e4463680b9b8251f2eae10: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 22:45:05.661794 27511 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ffbdb25ff5e4463680b9b8251f2eae10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "198f1e3398754e348adf2e1de80f8dce" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 38437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:45:05.662036 27511 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ffbdb25ff5e4463680b9b8251f2eae10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8bde75f380b4b8bb6c2e2d669715cca" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 40285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 22:45:05.663367 27524 sys_catalog.cc:455] T 00000000000000000000000000000000 P 198f1e3398754e348adf2e1de80f8dce [sys.catalog]: SysCatalogTable state changed. Reason: New leader ffbdb25ff5e4463680b9b8251f2eae10. Latest consensus state: current_term: 1 leader_uuid: "ffbdb25ff5e4463680b9b8251f2eae10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffbdb25ff5e4463680b9b8251f2eae10" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36871 } } peers { permanent_uuid: "198f1e3398754e348adf2e1de80f8dce" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 38437 } } peers { permanent_uuid: "d8bde75f380b4b8bb6c2e2d669715cca" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 40285 } } }
I20260807 22:45:05.663465 27524 sys_catalog.cc:458] T 00000000000000000000000000000000 P 198f1e3398754e348adf2e1de80f8dce [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:45:05.664535 27491 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8bde75f380b4b8bb6c2e2d669715cca [sys.catalog]: SysCatalogTable state changed. Reason: New leader ffbdb25ff5e4463680b9b8251f2eae10. Latest consensus state: current_term: 1 leader_uuid: "ffbdb25ff5e4463680b9b8251f2eae10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffbdb25ff5e4463680b9b8251f2eae10" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36871 } } peers { permanent_uuid: "198f1e3398754e348adf2e1de80f8dce" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 38437 } } peers { permanent_uuid: "d8bde75f380b4b8bb6c2e2d669715cca" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 40285 } } }
I20260807 22:45:05.664636 27491 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8bde75f380b4b8bb6c2e2d669715cca [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:45:05.669778 27455 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffbdb25ff5e4463680b9b8251f2eae10 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ffbdb25ff5e4463680b9b8251f2eae10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffbdb25ff5e4463680b9b8251f2eae10" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36871 } } peers { permanent_uuid: "198f1e3398754e348adf2e1de80f8dce" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 38437 } } peers { permanent_uuid: "d8bde75f380b4b8bb6c2e2d669715cca" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 40285 } } }
I20260807 22:45:05.669909 27455 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffbdb25ff5e4463680b9b8251f2eae10 [sys.catalog]: This master's current role is: LEADER
I20260807 22:45:05.670401 27524 sys_catalog.cc:455] T 00000000000000000000000000000000 P 198f1e3398754e348adf2e1de80f8dce [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ffbdb25ff5e4463680b9b8251f2eae10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffbdb25ff5e4463680b9b8251f2eae10" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36871 } } peers { permanent_uuid: "198f1e3398754e348adf2e1de80f8dce" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 38437 } } peers { permanent_uuid: "d8bde75f380b4b8bb6c2e2d669715cca" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 40285 } } }
I20260807 22:45:05.670496 27524 sys_catalog.cc:458] T 00000000000000000000000000000000 P 198f1e3398754e348adf2e1de80f8dce [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:45:05.670634 27546 mvcc.cc:205] Tried to move back new op lower bound from 7316040522385698816 to 7316040522253561856. Current Snapshot: MvccSnapshot[applied={T|T < 7316040522385698816}]
I20260807 22:45:05.671850 27511 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffbdb25ff5e4463680b9b8251f2eae10 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ffbdb25ff5e4463680b9b8251f2eae10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffbdb25ff5e4463680b9b8251f2eae10" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36871 } } peers { permanent_uuid: "198f1e3398754e348adf2e1de80f8dce" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 38437 } } peers { permanent_uuid: "d8bde75f380b4b8bb6c2e2d669715cca" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 40285 } } }
I20260807 22:45:05.671983 27511 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffbdb25ff5e4463680b9b8251f2eae10 [sys.catalog]: This master's current role is: LEADER
I20260807 22:45:05.672478 27491 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8bde75f380b4b8bb6c2e2d669715cca [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ffbdb25ff5e4463680b9b8251f2eae10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffbdb25ff5e4463680b9b8251f2eae10" member_type: VOTER last_known_addr { host: "127.22.212.126" port: 36871 } } peers { permanent_uuid: "198f1e3398754e348adf2e1de80f8dce" member_type: VOTER last_known_addr { host: "127.22.212.125" port: 38437 } } peers { permanent_uuid: "d8bde75f380b4b8bb6c2e2d669715cca" member_type: VOTER last_known_addr { host: "127.22.212.124" port: 40285 } } }
I20260807 22:45:05.672590 27491 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8bde75f380b4b8bb6c2e2d669715cca [sys.catalog]: This master's current role is: FOLLOWER
I20260807 22:45:05.672821 27550 mvcc.cc:205] Tried to move back new op lower bound from 7316040522385698816 to 7316040522253561856. Current Snapshot: MvccSnapshot[applied={T|T < 7316040522385698816}]
I20260807 22:45:05.673391 27517 catalog_manager.cc:1347] Generated new cluster ID: bbb54dc434d44aa4b93f758f55c564b8
I20260807 22:45:05.673451 27517 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 22:45:05.696028 27517 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 22:45:05.696875 27517 catalog_manager.cc:1504] Loading token signing keys...
I20260807 22:45:05.703536 27517 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ffbdb25ff5e4463680b9b8251f2eae10: Generated new TSK 0
I20260807 22:45:05.703768 27517 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 22:45:05.745594 27320 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:45:05.744216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42822 (local address 127.22.212.125:38437)
0807 22:45:05.744282 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:05.744284 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:05.744987 (+ 703us) server_negotiation.cc:407] Connection header received
0807 22:45:05.745080 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:05.745081 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:05.745092 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:05.745122 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:05.745527 (+ 405us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42822: BlockingRecv error: recv got EOF from 127.0.0.1:42822 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260807 22:45:05.745592 27193 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:45:05.743847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40300 (local address 127.22.212.126:36871)
0807 22:45:05.743911 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:05.743914 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:05.744837 (+ 923us) server_negotiation.cc:407] Connection header received
0807 22:45:05.744914 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:05.744915 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:05.744929 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:05.745008 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:05.745516 (+ 508us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40300: BlockingRecv error: recv got EOF from 127.0.0.1:40300 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
W20260807 22:45:05.746332 27448 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:45:05.744565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49602 (local address 127.22.212.124:40285)
0807 22:45:05.744607 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:05.744609 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:05.745826 (+ 1217us) server_negotiation.cc:407] Connection header received
0807 22:45:05.745946 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:05.745947 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:05.745958 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:05.745987 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:05.746275 (+ 288us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49602: BlockingRecv error: recv got EOF from 127.0.0.1:49602 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260807 22:45:05.748426 27320 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:45:05.747658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42832 (local address 127.22.212.125:38437)
0807 22:45:05.747694 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:05.747696 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:05.747899 (+ 203us) server_negotiation.cc:407] Connection header received
0807 22:45:05.748006 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:05.748007 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:05.748024 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:05.748053 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:05.748370 (+ 317us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42832: BlockingRecv error: recv got EOF from 127.0.0.1:42832 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260807 22:45:05.751415 27320 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:45:05.750541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42846 (local address 127.22.212.125:38437)
0807 22:45:05.750587 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:05.750588 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:05.750850 (+ 262us) server_negotiation.cc:407] Connection header received
0807 22:45:05.750959 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:05.750959 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:05.750970 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:05.750998 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:05.751364 (+ 366us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42846: BlockingRecv error: recv got EOF from 127.0.0.1:42846 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260807 22:45:05.755242 27320 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:45:05.754461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42862 (local address 127.22.212.125:38437)
0807 22:45:05.754507 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:05.754508 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:05.754766 (+ 258us) server_negotiation.cc:407] Connection header received
0807 22:45:05.754858 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:05.754859 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:05.754869 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:05.754898 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:05.755202 (+ 304us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42862: BlockingRecv error: recv got EOF from 127.0.0.1:42862 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260807 22:45:05.761399 27320 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:45:05.760473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42878 (local address 127.22.212.125:38437)
0807 22:45:05.760517 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:05.760519 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:05.760802 (+ 283us) server_negotiation.cc:407] Connection header received
0807 22:45:05.760914 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:05.760915 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:05.760927 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:05.760959 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:05.761331 (+ 372us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42878: BlockingRecv error: recv got EOF from 127.0.0.1:42878 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260807 22:45:05.771601 27320 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:45:05.770638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42880 (local address 127.22.212.125:38437)
0807 22:45:05.770680 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:05.770682 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:05.770983 (+ 301us) server_negotiation.cc:407] Connection header received
0807 22:45:05.771095 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:05.771096 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:05.771108 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:05.771139 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:05.771544 (+ 405us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42880: BlockingRecv error: recv got EOF from 127.0.0.1:42880 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260807 22:45:05.789966 27320 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:45:05.788996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42882 (local address 127.22.212.125:38437)
0807 22:45:05.789047 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:05.789049 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:05.789348 (+ 299us) server_negotiation.cc:407] Connection header received
0807 22:45:05.789473 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:05.789474 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:05.789487 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:05.789517 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:05.789906 (+ 389us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42882: BlockingRecv error: recv got EOF from 127.0.0.1:42882 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260807 22:45:05.824318 27320 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:45:05.823342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42892 (local address 127.22.212.125:38437)
0807 22:45:05.823397 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:05.823399 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:05.823712 (+ 313us) server_negotiation.cc:407] Connection header received
0807 22:45:05.823815 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:05.823816 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:05.823828 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:05.823858 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:05.824231 (+ 373us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42892: BlockingRecv error: recv got EOF from 127.0.0.1:42892 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260807 22:45:05.890661 27320 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:45:05.889853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42904 (local address 127.22.212.125:38437)
0807 22:45:05.889928 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:05.889931 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:05.890071 (+ 140us) server_negotiation.cc:407] Connection header received
0807 22:45:05.890140 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:05.890141 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:05.890153 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:05.890197 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:05.890600 (+ 403us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42904: BlockingRecv error: recv got EOF from 127.0.0.1:42904 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
W20260807 22:45:06.020653 27320 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:45:06.019865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42918 (local address 127.22.212.125:38437)
0807 22:45:06.019975 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:06.019977 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:06.020075 (+ 98us) server_negotiation.cc:407] Connection header received
0807 22:45:06.020109 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:06.020110 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:06.020121 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:06.020176 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:06.020581 (+ 405us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42918: BlockingRecv error: recv got EOF from 127.0.0.1:42918 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
W20260807 22:45:06.278699 27320 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 22:45:06.277940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40598 (local address 127.22.212.125:38437)
0807 22:45:06.278015 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:06.278017 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:06.278045 (+ 28us) server_negotiation.cc:407] Connection header received
0807 22:45:06.278126 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:06.278127 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:06.278140 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:06.278196 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 22:45:06.278607 (+ 411us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40598: BlockingRecv error: recv got EOF from 127.0.0.1:40598 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 22:45:06.629984 27510 catalog_manager.cc:1259] Loaded cluster ID: bbb54dc434d44aa4b93f758f55c564b8
I20260807 22:45:06.630107 27510 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d8bde75f380b4b8bb6c2e2d669715cca: loading cluster ID for follower catalog manager: success
I20260807 22:45:06.630913 27510 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d8bde75f380b4b8bb6c2e2d669715cca: acquiring CA information for follower catalog manager: success
I20260807 22:45:06.631229 27510 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d8bde75f380b4b8bb6c2e2d669715cca: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 22:45:06.657759 27542 catalog_manager.cc:1259] Loaded cluster ID: bbb54dc434d44aa4b93f758f55c564b8
I20260807 22:45:06.657845 27542 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 198f1e3398754e348adf2e1de80f8dce: loading cluster ID for follower catalog manager: success
I20260807 22:45:06.658681 27542 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 198f1e3398754e348adf2e1de80f8dce: acquiring CA information for follower catalog manager: success
I20260807 22:45:06.658965 27542 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 198f1e3398754e348adf2e1de80f8dce: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 22:45:06.794772 27661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:06.791937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40604 (local address 127.22.212.125:38437)
0807 22:45:06.792083 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:06.792085 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:06.792213 (+ 128us) server_negotiation.cc:407] Connection header received
0807 22:45:06.792322 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:06.792324 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:06.792402 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:06.792480 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:45:06.792636 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:06.793196 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:06.793946 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:06.794172 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:06.794236 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:06.794391 (+ 155us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:45:06.794511 (+ 120us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:45:06.794577 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 22:45:06.794614 (+ 37us) server_negotiation.cc:299] Negotiation successful
0807 22:45:06.794634 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":57,"threads_started":1}
I20260807 22:45:06.799234 27675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:06.796740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56696 (local address 127.22.212.124:40285)
0807 22:45:06.796918 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:06.796920 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:06.796929 (+ 9us) server_negotiation.cc:407] Connection header received
0807 22:45:06.796970 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:06.796971 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:06.797008 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:06.797084 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:45:06.797171 (+ 87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:06.797696 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:06.798446 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:06.798676 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:06.798744 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:06.798862 (+ 118us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:45:06.798971 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:45:06.799031 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0807 22:45:06.799076 (+ 45us) server_negotiation.cc:299] Negotiation successful
0807 22:45:06.799093 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":58,"threads_started":1}
I20260807 22:45:06.803797 27661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:06.800934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40620 (local address 127.22.212.125:38437)
0807 22:45:06.800982 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:06.800985 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:06.801132 (+ 147us) server_negotiation.cc:407] Connection header received
0807 22:45:06.801237 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:06.801238 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:06.801249 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:06.801292 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:45:06.801467 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:06.802210 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:06.803069 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:06.803280 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:06.803356 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:06.803500 (+ 144us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:45:06.803534 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:45:06.803582 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0807 22:45:06.803685 (+ 103us) server_negotiation.cc:299] Negotiation successful
0807 22:45:06.803713 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260807 22:45:06.804383 27675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:06.801268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56706 (local address 127.22.212.124:40285)
0807 22:45:06.801308 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:06.801310 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:06.801564 (+ 254us) server_negotiation.cc:407] Connection header received
0807 22:45:06.801629 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:06.801630 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:06.801642 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:06.801692 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:45:06.801800 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:06.802476 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:06.803548 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:06.803843 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:06.803927 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:06.804105 (+ 178us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:45:06.804134 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:45:06.804205 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 22:45:06.804285 (+ 80us) server_negotiation.cc:299] Negotiation successful
0807 22:45:06.804305 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 22:45:06.804780 27684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 22:45:06.800942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39594 (local address 127.22.212.126:36871)
0807 22:45:06.801085 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0807 22:45:06.801088 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 22:45:06.801155 (+ 67us) server_negotiation.cc:407] Connection header received
0807 22:45:06.801218 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 22:45:06.801219 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 22:45:06.801274 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 22:45:06.801424 (+ 150us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 22:45:06.801532 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:06.802182 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:06.803428 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 22:45:06.803784 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 22:45:06.803833 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 22:45:06.804319 (+ 486us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 22:45:06.804442 (+ 123us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 22:45:06.804482 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0807 22:45:06.804628 (+ 146us) server_negotiation.cc:299] Negotiation successful
0807 22:45:06.804657 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":58,"threads_started":1}
I20260807 22:45:06.806607 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 27081
I20260807 22:45:06.821297 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 27200
I20260807 22:45:06.833352 23377 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task6SvSzn/build/release/bin/kudu with pid 27329
2026-08-07T22:45:06Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3132 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6244 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (288205 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST